Skip to content
KernelIndex
Search⌘K
Sign in

amd-mixture-of-experts · submission 17038

KernelBot user 45 · python · License unknown
Kernel source · 1 lines ↓

Use it

Vendorable · source mirrored · license unknownView source →

No package. Vendor the mirrored source: 1 lines, June 9 Researcher Reciprocity License v1.0.

amd-mixture-of-experts.py
curl "https://kernelindex.com/api/v1/implementations/kernelbot-amd-mixture-of-experts-17038?include=source"
interfacepython
Compatibility
measured onAMD Instinct MI300X
declared hardwareAMD Instinct MI300X
architecturesgfx942
dtypesfp16

Benchmark evidence

2 measurements across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
AMD DeepSeek-style MoE layerfp16 · [1, 8192, 7168]
AMD Instinct MI300X
6.14s
#87 of 118
2025-05-06
Run →
AMD DeepSeek-style MoE layerfp16 · [1, 2048, 7168]
AMD Instinct MI300X
6.14s
#90 of 118
2025-05-06
Run →

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:bedd97af54a9ab4c990193abc16c285a350a55b4fafa0f82b7fea6ff9ce247b3
license declaredunknown
license concludedunknown
imported2026-08-15

Kernel source

amd-mixture-of-experts.py1 lines
IyFQT1BDT1JOIGxlYWRlcmJvYXJkIGFtZC1taXh0dXJlLW9mLWV4cGVydHMKCiMgVGhpcyBpcyBhIHN1Ym1pc3Npb24gdGVtcGxhdGUgZm9yIHBvcGNvcm4gbGVhZGVyYm9hcmQgJ2FtZC1taXh0dXJlLW9mLWV4cGVydHMnLgojIFlvdXIgdGFzayBpcyBhcyBmb2xsb3dzOgojID4gRm9yIGEgbW9yZSBjb21wbGV0ZSBkZXNjcmlwdGlvbiwgc2VlOiBodHRwczovL3Rpbnl1cmwuY29tL2FtZC1jb21wLW1vZQojID4gSW1wbGVtZW50IGEgRGVlcFNlZWstc3R5bGUgTWl4dHVyZSBvZiBFeHBlcnRzIChNb0UpIGxheWVyIGZvciBlZmZpY2llbnQgdHJhbnNmb3JtZXIgbW9kZWxzCiMgPiBvbiBhIHNpbmdsZSBNSTMwMFggZGV2aWNlLgojID4gCiMgPiBNb0UgaXMgYSB0ZWNobmlxdWUgdGhhdCBhbGxvd3Mgc2NhbGluZyBtb2RlbCBjYXBhY2l0eSB3aXRob3V0IHByb3BvcnRpb25hbGx5IGluY3JlYXNpbmcgY29tcHV0YXRpb25hbCBjb3N0cwojID4gYnkgdXNpbmcgYSByb3V0aW5nIG1lY2hhbmlzbSB0byBzZWxlY3RpdmVseSBhY3RpdmF0ZSBvbmx5IGEgc3Vic2V0IG9mIHBhcmFtZXRlcnMgZm9yIGVhY2ggdG9rZW4uCiMgPiAKIyA+IFlvdXIgdGFzazoKIyA+IC0gSW1wbGVtZW50IHRva2VuIHJvdXRpbmcgdXNpbmcgYSBzaW1wbGUgc29mdG1heC1iYXNlZCBsZWFybmVkIHJvdXRlcgojID4gLSBSb3V0ZSB0b2tlbnMgdG8gdGhlIHRvcC1rIGV4cGVydHMgYmFzZWQgb24gcm91dGVyIHByb2JhYmlsaXRpZXMKIyA+IC0gUHJvY2VzcyB0b2tlbnMgdGhyb3VnaCB0aGVpciBhc3NpZ25lZCBleHBlcnRzCiMgPiAtIENvbWJpbmUgZXhwZXJ0IG91dHB1dHMgd2VpZ2h0ZWQgYnkgcm91dGVyIHByb2JhYmlsaXRpZXMKIyA+IC0gQ2FsY3VsYXRlIGFwcHJvcHJpYXRlIGF1eGlsaWFyeSBsb3NzZXMgZm9yIHRyYWluaW5nIHN0YWJpbGl0eQojID4gCiMgPiBJbnB1dDoKIyA+IC0gYGRhdGFgOiBUdXBsZSBvZiAoaW5wdXQ6IHRvcmNoLlRlbnNvciwgd2VpZ2h0czogRGljdFtzdHIsIHRvcmNoLlRlbnNvcl0sIGNvbmZpZzogRGljdCkKIyA+ICAgLSBpbnB1dDogSW5wdXQgdGVuc29yIG9mIHNoYXBlIFticywgc2VxX2xlbiwgZF9oaWRkZW5dCiMgPiAgIC0gd2VpZ2h0czogRGljdGlvbmFyeSBjb250YWluaW5nIG1vZGVsIHdlaWdodHMKIyA+ICAgLSBjb25maWc6IERpY3Rpb25hcnkgY29udGFpbmluZyBtb2RlbCBjb25maWd1cmF0aW9uIHBhcmFtZXRlcnMKIyA+IAojID4gT3V0cHV0OgojID4gLSBUdXBsZSBjb250YWluaW5nOgojID4gICAtIG91dHB1dDogUHJvY2Vzc2VkIHRlbnNvciBbYnMsIHNlcV9sZW4sIGRfbW9kZWxdCiMgPiAgIC0gYXV4X2RhdGE6IERpY3Rpb25hcnkgd2l0aCBhdXhpbGlhcnkgZGF0YSBsaWtlIHJvdXRlciBwcm9iYWJpbGl0aWVzIGFuZCBsb3NzZXMKIyBUaGUgZGVhZGxpbmUgZm9yIHRoaXMgbGVhZGVyYm9hcmQgaXMgMjAyNS0wNS0yNyAwMDowMDowMCswMDowMAoKIyBZb3UgY2FuIGF1dG9tYXRpY2FsbHkgcm91dGUgdGhpcyBmaWxlIHRvIHNwZWNpZmljIEdQVXMgYnkgYWRkaW5nIGEgbGluZQojIGAjIVBPUENPUk4gZ3B1cyA8R1BVcz5gIHRvIHRoZSBoZWFkZXIgb2YgdGhpcyBmaWxlLgojIEhhcHB5IGhhY2tpbmchCgppbXBvcnQgbWF0aAppbXBvcnQgdG9yY2gKaW1wb3J0IHRvcmNoLm5uIGFzIG5uCmltcG9ydCB0b3JjaC5ubi5mdW5jdGlvbmFsIGFzIEYKZnJvbSB0eXBpbmcgaW1wb3J0IERpY3QsIFR1cGxlLCBPcHRpb25hbApmcm9tIHRhc2sgaW1wb3J0IGlucHV0X3QsIG91dHB1dF90CgpjbGFzcyBFeHBlcnQobm4uTW9kdWxlKToKICAgIGRlZiBfX2luaXRfXyhzZWxmLCBjb25maWc6IERpY3QsIGRfZXhwZXJ0OiBPcHRpb25hbFtpbnRdID0gTm9uZSk6CiAgICAgICAgc3VwZXIoKS5fX2luaXRfXygpCiAgICAgICAgc2VsZi5jb25maWcgPSBjb25maWcKICAgICAgICBzZWxmLmFjdF9mbiA9IG5uLlNpTFUoKQogICAgICAgIHNlbGYuZF9oaWRkZW46IGludCA9IGNvbmZpZ1siZF9oaWRkZW4iXQogICAgICAgIHNlbGYuZF9leHBlcnQ6IGludCA9IGNvbmZpZ1siZF9leHBlcnQiXSBpZiBkX2V4cGVydCBpcyBOb25lIGVsc2UgZF9leHBlcnQKCiAgICAgICAgc2VsZi5XX2dhdGUgPSBubi5MaW5lYXIoc2VsZi5kX2hpZGRlbiwgc2VsZi5kX2V4cGVydCwgYmlhcz1GYWxzZSkKICAgICAgICBzZWxmLldfdXAgPSBubi5MaW5lYXIoc2VsZi5kX2hpZGRlbiwgc2VsZi5kX2V4cGVydCwgYmlhcz1GYWxzZSkKICAgICAgICBzZWxmLldfZG93biA9IG5uLkxpbmVhcihzZWxmLmRfZXhwZXJ0LCBzZWxmLmRfaGlkZGVuLCBiaWFzPUZhbHNlKQoKICAgIGRlZiBmb3J3YXJkKHNlbGYsIHg6IHRvcmNoLlRlbnNvcikgLT4gdG9yY2guVGVuc29yOgogICAgICAgIGdhdGUgPSBzZWxmLmFjdF9mbihzZWxmLldfZ2F0ZSh4KSkKICAgICAgICBvdXQgPSBzZWxmLldfZG93bihnYXRlICogc2VsZi5XX3VwKHgpKQogICAgICAgIHJldHVybiBvdXQKCgpjbGFzcyBNb0VHYXRlKG5uLk1vZHVsZSk6CiAgICBkZWYgX19pbml0X18oc2VsZiwgY29uZmlnOiBEaWN0KToKICAgICAgICBzdXBlcigpLl9faW5pdF9fKCkKICAgICAgICBzZWxmLnRvcF9rOiBpbnQgPSBjb25maWdbIm5fZXhwZXJ0c19wZXJfdG9rZW4iXQogICAgICAgIHNlbGYubnVtX2V4cGVydHM6IGludCA9IGNvbmZpZ1sibl9yb3V0ZWRfZXhwZXJ0cyJdCiAgICAgICAgc2VsZi5kX2hpZGRlbjogaW50ID0gY29uZmlnWyJkX2hpZGRlbiJdCgogICAgICAgIHNlbGYuV19nID0gbm4uTGluZWFyKHNlbGYuZF9oaWRkZW4sIHNlbGYubnVtX2V4cGVydHMsIGJpYXM9RmFsc2UpCgogICAgZGVmIGZvcndhcmQoc2VsZiwgeDogdG9yY2guVGVuc29yKSAtPiBUdXBsZVt0b3JjaC5UZW5zb3IsIHRvcmNoLlRlbnNvcl06CiAgICAgICAgbG9naXRzID0gc2VsZi5XX2coeCkKICAgICAgICBzY29yZXMgPSBsb2dpdHMuc29mdG1heChkaW09LTEpCiAgICAgICAgdG9wa19zY29yZXMsIHRvcGtfaW5kaWNlcyA9IHRvcmNoLnRvcGsoc2NvcmVzLCBrPXNlbGYudG9wX2ssIGRpbT0tMSwgc29ydGVkPUZhbHNlKQoKICAgICAgICByZXR1cm4gdG9wa19pbmRpY2VzLCB0b3BrX3Njb3JlcwoKCmNsYXNzIE1vRShubi5Nb2R1bGUpOgogICAgZGVmIF9faW5pdF9fKHNlbGYsIGNvbmZpZzogRGljdCk6CiAgICAgICAgc3VwZXIoKS5fX2luaXRfXygpCiAgICAgICAgc2VsZi5jb25maWcgPSBjb25maWcKICAgICAgICBzZWxmLmV4cGVydHMgPSBubi5Nb2R1bGVMaXN0KFsKICAgICAgICAgICAgRXhwZXJ0KGNvbmZpZykKICAgICAgICAgICAgZm9yIF8gaW4gcmFuZ2UoY29uZmlnWyJuX3JvdXRlZF9leHBlcnRzIl0pCiAgICAgICAgXSkKICAgICAgICBzZWxmLmdhdGluZ19uZXR3b3JrID0gTW9FR2F0ZShjb25maWcpCiAgICAgICAgc2hhcmVkX2V4cGVydF9kaW0gPSBjb25maWdbImRfZXhwZXJ0Il0gKiBjb25maWdbIm5fc2hhcmVkX2V4cGVydHMiXQogICAgICAgIHNlbGYuc2hhcmVkX2V4cGVydCA9IEV4cGVydChjb25maWc9Y29uZmlnLCBkX2V4cGVydD1zaGFyZWRfZXhwZXJ0X2RpbSkKCiAgICBkZWYgZm9yd2FyZChzZWxmLCB4OiB0b3JjaC5UZW5zb3IpIC0+IHRvcmNoLlRlbnNvcjoKICAgICAgICBzaGFyZWRfb3V0cHV0ID0gc2VsZi5zaGFyZWRfZXhwZXJ0KHgpCiAgICAgICAgZXhwZXJ0X2luZGljZXMsIGV4cGVydF9zY29yZXMgPSBzZWxmLmdhdGluZ19uZXR3b3JrKHgpCiAgICAgICAgYmF0Y2hfc2l6ZSwgc2VxX2xlbiwgaGlkZGVuX2RpbSA9IHguc2hhcGUKICAgICAgICBvcmlnX3NoYXBlID0geC5zaGFwZQogICAgICAgIHhfZmxhdCA9IHgudmlldygtMSwgaGlkZGVuX2RpbSkKICAgICAgICBmbGF0X2V4cGVydF9pbmRpY2VzID0gZXhwZXJ0X2luZGljZXMudmlldygtMSkKICAgICAgICBmbGF0X2V4cGVydF93ZWlnaHRzID0gZXhwZXJ0X3Njb3Jlcy52aWV3KC0xLCAxKQogICAgICAgIHJvdXRlZF9vdXRwdXRfZmxhdCA9IHNlbGYubW9lX2luZmVyKHhfZmxhdCwKICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICBmbGF0X2V4cGVydF9pbmRpY2VzLAogICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgICAgIGZsYXRfZXhwZXJ0X3dlaWdodHMpCgogICAgICAgIHJvdXRlZF9vdXRwdXQgPSByb3V0ZWRfb3V0cHV0X2ZsYXQudmlldygqb3JpZ19zaGFwZSkKICAgICAgICByZXR1cm4gcm91dGVkX291dHB1dCArIHNoYXJlZF9vdXRwdXQKCiAgICBAdG9yY2gubm9fZ3JhZCgpCiAgICBkZWYgbW9lX2luZmVyKHNlbGYsCiAgICAgICAgICAgICAgICAgIHg6IHRvcmNoLlRlbnNvciwKICAgICAgICAgICAgICAgICAgZmxhdF9leHBlcnRfaW5kaWNlczogdG9yY2guVGVuc29yLAogICAgICAgICAgICAgICAgICBmbGF0X2V4cGVydF93ZWlnaHRzOiB0b3JjaC5UZW5zb3IKICAgICAgICAgICAgICAgICApIC0+IHRvcmNoLlRlbnNvcjoKICAgICAgICBleHBlcnRfY2FjaGUgPSB0b3JjaC56ZXJvc19saWtlKHgpCiAgICAgICAgaWR4cyA9IGZsYXRfZXhwZXJ0X2luZGljZXMuYXJnc29ydCgpCiAgICAgICAgY291bnRzID0gZmxhdF9leHBlcnRfaW5kaWNlcy5iaW5jb3VudCgpLmNwdSgpLm51bXB5KCkKICAgICAgICB0b2tlbnNfcGVyX2V4cGVydCA9IGNvdW50cy5jdW1zdW0oKQogICAgICAgIG51bV9wZXJfdG9rID0gc2VsZi5jb25maWdbIm5fZXhwZXJ0c19wZXJfdG9rZW4iXQogICAgICAgIHRva2VuX2lkeHMgPSBpZHhzIC8vIG51bV9wZXJfdG9rCiAgICAgICAgZm9yIGV4cGVydF9pZCwgZW5kX2lkeCBpbiBlbnVtZXJhdGUodG9rZW5zX3Blcl9leHBlcnQpOgogICAgICAgICAgICBzdGFydF9pZHggPSAwIGlmIGV4cGVydF9pZCA9PSAwIGVsc2UgdG9rZW5zX3Blcl9leHBlcnRbZXhwZXJ0X2lkIC0gMV0KICAgICAgICAgICAgaWYgc3RhcnRfaWR4ID09IGVuZF9pZHg6CiAgICAgICAgICAgICAgICBjb250aW51ZQoKICAgICAgICAgICAgZXhwZXJ0ID0gc2VsZi5leHBlcnRzW2V4cGVydF9pZF0KICAgICAgICAgICAgZXhwX3Rva2VuX2lkeHMgPSB0b2tlbl9pZHhzW3N0YXJ0X2lkeDplbmRfaWR4XQogICAgICAgICAgICBleHBlcnRfdG9rZW5zID0geFtleHBfdG9rZW5faWR4c10KICAgICAgICAgICAgZXhwZXJ0X291dCAgICA9IGV4cGVydChleHBlcnRfdG9rZW5zKQogICAgICAgICAgICBleHBlcnRfb3V0Lm11bF8oZmxhdF9leHBlcnRfd2VpZ2h0c1tpZHhzW3N0YXJ0X2lkeDplbmRfaWR4XV0pCiAgICAgICAgICAgIGV4cGVydF9jYWNoZS5zY2F0dGVyX3JlZHVjZV8oCiAgICAgICAgICAgICAgICAwLAogICAgICAgICAgICAgICAgZXhwX3Rva2VuX2lkeHMudmlldygtMSwgMSkucmVwZWF0KDEsIHguc2hhcGVbLTFdKSwKICAgICAgICAgICAgICAgIGV4cGVydF9vdXQsCiAgICAgICAgICAgICAgICByZWR1Y2U9J3N1bScKICAgICAgICAgICAgKQoKICAgICAgICByZXR1cm4gZXhwZXJ0X2NhY2hlCgoKZGVmIGN1c3RvbV9rZXJuZWwoZGF0YTogaW5wdXRfdCkgLT4gb3V0cHV0X3Q6CiAgICAiIiIKICAgIFN1Ym1pc3Npb24gdGVtcGxhdGUgZm9yIERlZXBTZWVrLXN0eWxlIE1peHR1cmUgb2YgRXhwZXJ0cyB1c2luZyBQeVRvcmNoLgogICAgCiAgICBBcmdzOgogICAgICAgIGRhdGE6IFR1cGxlIG9mIChpbnB1dDogdG9yY2guVGVuc29yLCB3ZWlnaHRzOiBEaWN0W3N0ciwgdG9yY2guVGVuc29yXSwgY29uZmlnOiBEaWN0KQogICAgICAgICAgICAtIGlucHV0OiBJbnB1dCB0ZW5zb3Igb2Ygc2hhcGUgW2JhdGNoX3NpemUsIHNlcV9sZW4sIGhpZGRlbl9zaXplXQogICAgICAgICAgICAtIHdlaWdodHM6IERpY3Rpb25hcnkgY29udGFpbmluZyBtb2RlbCB3ZWlnaHRzCiAgICAgICAgICAgIC0gY29uZmlnOiBEaWN0aW9uYXJ5IGNvbnRhaW5pbmcgbW9kZWwgY29uZmlndXJhdGlvbiBwYXJhbWV0ZXJzCiAgICAgICAgICAgIAogICAgUmV0dXJuczoKICAgICAgICBUdXBsZSBjb250YWluaW5nOgogICAgICAgICAgICAtIG91dHB1dDogUHJvY2Vzc2VkIHRlbnNvciBbYmF0Y2hfc2l6ZSwgc2VxX2xlbiwgZF9tb2RlbF0KICAgICAgICAgICAgLSBhdXhfZGF0YTogRGljdGlvbmFyeSB3aXRoIGF1eGlsaWFyeSBkYXRhCiAgICAiIiIKICAgIGlucHV0X3RlbnNvciwgd2VpZ2h0cywgY29uZmlnID0gZGF0YQogICAgbnVtX2V4cGVydHMgPSBjb25maWdbIm5fcm91dGVkX2V4cGVydHMiXQogICAgbW9lID0gTW9FKGNvbmZpZykKCiAgICAjIEZpbGwgaW4gdGhlIGdpdmVuIHdlaWdodHMgb2YgdGhlIG1vZGVsCiAgICBtb2UuZ2F0aW5nX25ldHdvcmsuV19nLndlaWdodCA9IG5uLlBhcmFtZXRlcih3ZWlnaHRzWydyb3V0ZXIud2VpZ2h0J10pCgogICAgZm9yIGkgaW4gcmFuZ2UobnVtX2V4cGVydHMpOgogICAgICAgIGdhdGVfcHJval93ZWlnaHQgPSB3ZWlnaHRzW2YnZXhwZXJ0cy57aX0uMC53ZWlnaHQnXQogICAgICAgIHVwX3Byb2pfd2VpZ2h0ID0gd2VpZ2h0c1tmJ2V4cGVydHMue2l9LjEud2VpZ2h0J10KICAgICAgICBkb3duX3Byb2pfd2VpZ2h0ID0gd2VpZ2h0c1tmJ2V4cGVydHMue2l9LjIud2VpZ2h0J10KCiAgICAgICAgIyBUcmFuc3Bvc2Ugd2VpZ2h0cyB0byBtYXRjaCBleHBlY3RlZCBzaGFwZSBmb3Igbm4uTGluZWFyCiAgICAgICAgbW9lLmV4cGVydHNbaV0uV19nYXRlLndlaWdodCA9IG5uLlBhcmFtZXRlcihnYXRlX3Byb2pfd2VpZ2h0LnQoKSkKICAgICAgICBtb2UuZXhwZXJ0c1tpXS5XX3VwLndlaWdodCA9IG5uLlBhcmFtZXRlcih1cF9wcm9qX3dlaWdodC50KCkpCiAgICAgICAgbW9lLmV4cGVydHNbaV0uV19kb3duLndlaWdodCA9IG5uLlBhcmFtZXRlcihkb3duX3Byb2pfd2VpZ2h0LnQoKSkKCiAgICBtb2Uuc2hhcmVkX2V4cGVydC5XX2dhdGUud2VpZ2h0ID0gbm4uUGFyYW1ldGVyKHdlaWdodHNbJ3NoYXJlZF9leHBlcnRzLjAud2VpZ2h0J10udCgpKQogICAgbW9lLnNoYXJlZF9leHBlcnQuV191cC53ZWlnaHQgPSBubi5QYXJhbWV0ZXIod2VpZ2h0c1snc2hhcmVkX2V4cGVydHMuMS53ZWlnaHQnXS50KCkpCiAgICBtb2Uuc2hhcmVkX2V4cGVydC5XX2Rvd24ud2VpZ2h0ID0gbm4uUGFyYW1ldGVyKHdlaWdodHNbJ3NoYXJlZF9leHBlcnRzLjIud2VpZ2h0J10udCgpKQoKICAgICMgUnVuIHRoZSBtb2RlbAogICAgb3V0cHV0ID0gbW9lKGlucHV0X3RlbnNvcikKCiAgICByZXR1cm4gb3V0cHV0Cg==

Source code from GPU Mode and the KernelBot dataset · June 9 Researcher Reciprocity License v1.0

Best evidence level for this revision: reported

JSON