Skip to content
KernelIndex
Search⌘K
Sign in

amd-mixture-of-experts · submission 15074

KernelBot user 247 · python · License unknown
Kernel source · 1 lines ↓

Use it

Vendorable · source mirrored · license unknownView source →

No package. Vendor the mirrored source: 1 lines, June 9 Researcher Reciprocity License v1.0.

triton_v03.py
curl "https://kernelindex.com/api/v1/implementations/kernelbot-amd-mixture-of-experts-15074?include=source"
interfacepython
Compatibility
measured onAMD Instinct MI300X
declared hardwareAMD Instinct MI300X
architecturesgfx942
dtypesfp16

Benchmark evidence

2 measurements across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
AMD DeepSeek-style MoE layerfp16 · [1, 2048, 7168]
AMD Instinct MI300X
13.5ms
#60 of 118
2025-05-03
Run →
AMD DeepSeek-style MoE layerfp16 · [1, 8192, 7168]
AMD Instinct MI300X
35.4ms
#65 of 118
2025-05-03
Run →

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:133c6932aa9651d1e36a525debc707f71091372109e4afbfbbf6875b7009b007
license declaredunknown
license concludedunknown
imported2026-08-15

Kernel source

triton_v03.py1 lines
ZnJvbSBmdW5jdG9vbHMgaW1wb3J0IHBhcnRpYWwKZnJvbSB0eXBpbmcgaW1wb3J0IERpY3QsIFR1cGxlLCBDYWxsYWJsZQppbXBvcnQgdGltZQoKaW1wb3J0IHRvcmNoCmltcG9ydCB0b3JjaC5ubiBhcyBubgppbXBvcnQgdHJpdG9uCmltcG9ydCB0cml0b24ubGFuZ3VhZ2UgYXMgdGwKCmZyb20gdGFzayBpbXBvcnQgaW5wdXRfdCwgb3V0cHV0X3QKCgpAdHJpdG9uLmppdApkZWYgZXhwZXJ0X3VwX2tlcm5lbCgKICAgIHhfcHRyLAogICAgZ2F0ZV9wdHIsCiAgICB1cF9wdHIsCiAgICBvdXRfcHRyLAogICAgTSwKICAgIE46IHRsLmNvbnN0ZXhwciwKICAgIEs6IHRsLmNvbnN0ZXhwciwKICAgIEJMT0NLX006IHRsLmNvbnN0ZXhwciwKICAgIEJMT0NLX046IHRsLmNvbnN0ZXhwciwKICAgIEJMT0NLX0s6IHRsLmNvbnN0ZXhwciwKKToKICAgIGJfcGlkID0gdGwucHJvZ3JhbV9pZCgwKQogICAgcGlkID0gdGwucHJvZ3JhbV9pZCgxKQogICAgbV9ibG9ja3MgPSB0bC5jZGl2KE0sIEJMT0NLX00pCiAgICBwaWRfbSA9IHBpZCAlIG1fYmxvY2tzCiAgICBwaWRfbiA9IHBpZCAvLyBtX2Jsb2NrcwoKICAgIG1fcmFuZ2UgPSB0bC5hcmFuZ2UoMCwgQkxPQ0tfTSlbOiwgTm9uZV0gKyBwaWRfbSAqIEJMT0NLX00KICAgIG5fcmFuZ2UgPSB0bC5hcmFuZ2UoMCwgQkxPQ0tfTilbTm9uZSwgOl0gKyBwaWRfbiAqIEJMT0NLX04KICAgIGsxX3JhbmdlID0gdGwuYXJhbmdlKDAsIEJMT0NLX0spW05vbmUsIDpdCiAgICBrMl9yYW5nZSA9IHRsLmFyYW5nZSgwLCBCTE9DS19LKVs6LCBOb25lXQoKICAgIHhfb2Zmc2V0ID0geF9wdHIgKyBtX3JhbmdlICogSyArIGJfcGlkICogKE0gKiBLKQogICAgZ2F0ZV9vZmZzZXQgPSBnYXRlX3B0ciArIG5fcmFuZ2UKICAgIHVwX29mZnNldCA9IHVwX3B0ciArIG5fcmFuZ2UKICAgIHVwID0gdGwuemVyb3MoKEJMT0NLX00sIEJMT0NLX04pLCBkdHlwZT10bC5mbG9hdDMyKQogICAgZ2F0ZSA9IHRsLnplcm9zKChCTE9DS19NLCBCTE9DS19OKSwgZHR5cGU9dGwuZmxvYXQzMikKICAgIGZvciBrIGluIHRsLnJhbmdlKDAsIHRsLmNkaXYoSywgQkxPQ0tfSykpOgogICAgICAgIHggPSB0bC5sb2FkKHhfb2Zmc2V0ICsgazFfcmFuZ2UsIChtX3JhbmdlIDwgTSkgJiAoazFfcmFuZ2UgPCBLKSkKICAgICAgICB3ID0gdGwubG9hZChnYXRlX29mZnNldCArIGsyX3JhbmdlICogTiwgKG5fcmFuZ2UgPCBOKSAmIChrMl9yYW5nZSA8IEspKQogICAgICAgIGdhdGUgPSB0bC5kb3QoeCwgdywgZ2F0ZSkKICAgICAgICB3ID0gdGwubG9hZCh1cF9vZmZzZXQgKyBrMl9yYW5nZSAqIE4sIChuX3JhbmdlIDwgTikgJiAoazJfcmFuZ2UgPCBLKSkKICAgICAgICB1cCA9IHRsLmRvdCh4LCB3LCB1cCkKICAgICAgICBrMV9yYW5nZSArPSBCTE9DS19LCiAgICAgICAgazJfcmFuZ2UgKz0gQkxPQ0tfSwoKICAgIG91dCA9IHVwICogZ2F0ZSAqIHRsLnNpZ21vaWQoZ2F0ZSkKICAgIG91dF9yYW5nZSA9IG1fcmFuZ2UgKiBOICsgbl9yYW5nZSArIGJfcGlkICogKE0gKiBOKQogICAgdGwuc3RvcmUob3V0X3B0ciArIG91dF9yYW5nZSwgb3V0LnRvKHRsLmZsb2F0MTYpLCAobV9yYW5nZSA8IE0pICYgKG5fcmFuZ2UgPCBOKSkKCgpAdHJpdG9uLmppdApkZWYgZXhwZXJ0X2Rvd25fa2VybmVsKAogICAgaW5fcHRyLAogICAgZG93bl9wdHIsCiAgICBvdXRfcHRyLAogICAgTSwKICAgIE46IHRsLmNvbnN0ZXhwciwKICAgIEs6IHRsLmNvbnN0ZXhwciwKICAgIEJMT0NLX006IHRsLmNvbnN0ZXhwciwKICAgIEJMT0NLX046IHRsLmNvbnN0ZXhwciwKICAgIEJMT0NLX0s6IHRsLmNvbnN0ZXhwciwKKToKICAgIGJfcGlkID0gdGwucHJvZ3JhbV9pZCgwKQogICAgcGlkID0gdGwucHJvZ3JhbV9pZCgxKQogICAgbV9ibG9ja3MgPSB0bC5jZGl2KE0sIEJMT0NLX00pCiAgICBwaWRfbSA9IHBpZCAlIG1fYmxvY2tzCiAgICBwaWRfbiA9IHBpZCAvLyBtX2Jsb2NrcwoKICAgIG1fcmFuZ2UgPSB0bC5hcmFuZ2UoMCwgQkxPQ0tfTSlbOiwgTm9uZV0gKyBwaWRfbSAqIEJMT0NLX00KICAgIG5fcmFuZ2UgPSB0bC5hcmFuZ2UoMCwgQkxPQ0tfTilbTm9uZSwgOl0gKyBwaWRfbiAqIEJMT0NLX04KICAgIGsxX3JhbmdlID0gdGwuYXJhbmdlKDAsIEJMT0NLX0spW05vbmUsIDpdCiAgICBrMl9yYW5nZSA9IHRsLmFyYW5nZSgwLCBCTE9DS19LKVs6LCBOb25lXQoKICAgIGluX29mZnNldCA9IGluX3B0ciArIG1fcmFuZ2UgKiBLICsgYl9waWQgKiAoTSAqIEspCiAgICBkb3duX29mZnNldCA9IGRvd25fcHRyICsgbl9yYW5nZQogICAgb3V0ID0gdGwuemVyb3MoKEJMT0NLX00sIEJMT0NLX04pLCBkdHlwZT10bC5mbG9hdDMyKQogICAgZm9yIGsgaW4gdGwucmFuZ2UoMCwgdGwuY2RpdihLLCBCTE9DS19LKSk6CiAgICAgICAgeCA9IHRsLmxvYWQoaW5fb2Zmc2V0ICsgazFfcmFuZ2UsIChtX3JhbmdlIDwgTSkgJiAoazFfcmFuZ2UgPCBLKSkKICAgICAgICB3ID0gdGwubG9hZChkb3duX29mZnNldCArIGsyX3JhbmdlICogTiwgKG5fcmFuZ2UgPCBOKSAmIChrMl9yYW5nZSA8IEspKQogICAgICAgIG91dCA9IHRsLmRvdCh4LCB3LCBvdXQpCiAgICAgICAgazFfcmFuZ2UgKz0gQkxPQ0tfSwogICAgICAgIGsyX3JhbmdlICs9IEJMT0NLX0sKCiAgICBvdXRfcmFuZ2UgPSBtX3JhbmdlICogTiArIG5fcmFuZ2UgKyBiX3BpZCAqIChNICogTikKICAgIHRsLnN0b3JlKG91dF9wdHIgKyBvdXRfcmFuZ2UsIG91dC50byh0bC5mbG9hdDE2KSwgKG1fcmFuZ2UgPCBNKSAmIChuX3JhbmdlIDwgTikpCgoKZGVmIGV4cGVydCh3X2dhdGUsIHdfdXAsIHdfZG93biwgeCk6CiAgICBpZiBsZW4oeC5zaGFwZSkgPT0gMjoKICAgICAgICBCID0gMQogICAgICAgIE0sIEsgPSB4LnNoYXBlCiAgICBlbHNlOgogICAgICAgIEIsIE0sIEsgPSB4LnNoYXBlCgogICAgSywgTiA9IHdfZ2F0ZS5zaGFwZQoKICAgIG91dCA9IHRvcmNoLnplcm9zX2xpa2UoeCkKICAgIHRtcCA9IHRvcmNoLnplcm9zKChCLCBNLCBOKSwgZHR5cGU9eC5kdHlwZSwgZGV2aWNlPXguZGV2aWNlKQoKICAgIEJMT0NLX00gPSAzMgogICAgQkxPQ0tfTiA9IDMyCiAgICBCTE9DS19LID0gMTI4CgogICAgZ3JpZCA9IChCLCB0cml0b24uY2RpdihNLCBCTE9DS19NKSAqIHRyaXRvbi5jZGl2KE4sIEJMT0NLX04pKSAgICAKICAgIGV4cGVydF91cF9rZXJuZWxbZ3JpZF0oCiAgICAgICAgeCwKICAgICAgICB3X2dhdGUsCiAgICAgICAgd191cCwKICAgICAgICB0bXAsCiAgICAgICAgTSwKICAgICAgICBOLAogICAgICAgIEssCiAgICAgICAgQkxPQ0tfTSwKICAgICAgICBCTE9DS19OLAogICAgICAgIEJMT0NLX0ssCiAgICAgICAgbnVtX3N0YWdlcyA9IDEsCiAgICAgICAgbnVtX3dhcnBzID0gMiwKICAgICkKCiAgICBCTE9DS19OID0gMTI4CiAgICBCTE9DS19LID0gMzIKICAgIGdyaWQgPSAoQiwgdHJpdG9uLmNkaXYoTSwgQkxPQ0tfTSkgKiB0cml0b24uY2RpdihLLCBCTE9DS19LKSkKICAgIGV4cGVydF9kb3duX2tlcm5lbFtncmlkXSgKICAgICAgICB0bXAsCiAgICAgICAgd19kb3duLAogICAgICAgIG91dCwKICAgICAgICBNLAogICAgICAgIEssCiAgICAgICAgTiwKICAgICAgICBCTE9DS19NLAogICAgICAgIEJMT0NLX0ssCiAgICAgICAgQkxPQ0tfTiwKICAgICAgICBudW1fc3RhZ2VzID0gMSwKICAgICAgICBudW1fd2FycHMgPSAyLAogICAgKSAgICAKICAgIGRlbCB0bXAKICAgIHJldHVybiBvdXQKCgpjbGFzcyBNb0VHYXRlKG5uLk1vZHVsZSk6CiAgICBkZWYgX19pbml0X18oc2VsZiwgY29uZmlnOiBEaWN0KToKICAgICAgICBzdXBlcigpLl9faW5pdF9fKCkKICAgICAgICBzZWxmLnRvcF9rOiBpbnQgPSBjb25maWdbIm5fZXhwZXJ0c19wZXJfdG9rZW4iXQogICAgICAgIHNlbGYubnVtX2V4cGVydHM6IGludCA9IGNvbmZpZ1sibl9yb3V0ZWRfZXhwZXJ0cyJdCiAgICAgICAgc2VsZi5kX2hpZGRlbjogaW50ID0gY29uZmlnWyJkX2hpZGRlbiJdCgogICAgICAgIHNlbGYuV19nID0gbm4uTGluZWFyKHNlbGYuZF9oaWRkZW4sIHNlbGYubnVtX2V4cGVydHMsIGJpYXM9RmFsc2UpCgogICAgZGVmIGZvcndhcmQoc2VsZiwgeDogdG9yY2guVGVuc29yKSAtPiBUdXBsZVt0b3JjaC5UZW5zb3IsIHRvcmNoLlRlbnNvcl06CiAgICAgICAgbG9naXRzID0gc2VsZi5XX2coeCkKICAgICAgICBzY29yZXMgPSBsb2dpdHMuc29mdG1heChkaW09LTEpCiAgICAgICAgdG9wa19zY29yZXMsIHRvcGtfaW5kaWNlcyA9IHRvcmNoLnRvcGsoCiAgICAgICAgICAgIHNjb3Jlcywgaz1zZWxmLnRvcF9rLCBkaW09LTEsIHNvcnRlZD1GYWxzZQogICAgICAgICkKCiAgICAgICAgcmV0dXJuIHRvcGtfaW5kaWNlcywgdG9wa19zY29yZXMKCgpjbGFzcyBNb0Uobm4uTW9kdWxlKToKICAgIGRlZiBfX2luaXRfXyhzZWxmLCBjb25maWc6IERpY3QsIGV4cGVydHM6IGxpc3RbQ2FsbGFibGVdLCBzX2V4cGVydDogQ2FsbGFibGUpOgogICAgICAgIHN1cGVyKCkuX19pbml0X18oKQogICAgICAgIHNlbGYuY29uZmlnID0gY29uZmlnCiAgICAgICAgc2VsZi5leHBlcnRzID0gZXhwZXJ0cwogICAgICAgIHNlbGYuZ2F0aW5nX25ldHdvcmsgPSBNb0VHYXRlKGNvbmZpZykKICAgICAgICBzZWxmLnNoYXJlZF9leHBlcnQgPSBzX2V4cGVydAoKICAgIGRlZiBmb3J3YXJkKHNlbGYsIHg6IHRvcmNoLlRlbnNvcikgLT4gdG9yY2guVGVuc29yOgogICAgICAgIHNoYXJlZF9vdXRwdXQgPSBzZWxmLnNoYXJlZF9leHBlcnQoeCkKICAgICAgICBleHBlcnRfaW5kaWNlcywgZXhwZXJ0X3Njb3JlcyA9IHNlbGYuZ2F0aW5nX25ldHdvcmsoeCkKICAgICAgICBiYXRjaF9zaXplLCBzZXFfbGVuLCBoaWRkZW5fZGltID0geC5zaGFwZQogICAgICAgIG9yaWdfc2hhcGUgPSB4LnNoYXBlCiAgICAgICAgeF9mbGF0ID0geC52aWV3KC0xLCBoaWRkZW5fZGltKQogICAgICAgIGZsYXRfZXhwZXJ0X2luZGljZXMgPSBleHBlcnRfaW5kaWNlcy52aWV3KC0xKQogICAgICAgIGZsYXRfZXhwZXJ0X3dlaWdodHMgPSBleHBlcnRfc2NvcmVzLnZpZXcoLTEsIDEpCiAgICAgICAgcm91dGVkX291dHB1dF9mbGF0ID0gc2VsZi5tb2VfaW5mZXIoCiAgICAgICAgICAgIHhfZmxhdCwgZmxhdF9leHBlcnRfaW5kaWNlcywgZmxhdF9leHBlcnRfd2VpZ2h0cwogICAgICAgICkKCiAgICAgICAgcm91dGVkX291dHB1dCA9IHJvdXRlZF9vdXRwdXRfZmxhdC52aWV3KCpvcmlnX3NoYXBlKQogICAgICAgIHJldHVybiByb3V0ZWRfb3V0cHV0ICsgc2hhcmVkX291dHB1dAoKICAgIEB0b3JjaC5ub19ncmFkKCkKICAgIGRlZiBtb2VfaW5mZXIoCiAgICAgICAgc2VsZiwKICAgICAgICB4OiB0b3JjaC5UZW5zb3IsCiAgICAgICAgZmxhdF9leHBlcnRfaW5kaWNlczogdG9yY2guVGVuc29yLAogICAgICAgIGZsYXRfZXhwZXJ0X3dlaWdodHM6IHRvcmNoLlRlbnNvciwKICAgICkgLT4gdG9yY2guVGVuc29yOgogICAgICAgIGV4cGVydF9jYWNoZSA9IHRvcmNoLnplcm9zX2xpa2UoeCkKICAgICAgICBpZHhzID0gZmxhdF9leHBlcnRfaW5kaWNlcy5hcmdzb3J0KCkKICAgICAgICBjb3VudHMgPSBmbGF0X2V4cGVydF9pbmRpY2VzLmJpbmNvdW50KCkuY3B1KCkubnVtcHkoKQogICAgICAgIHRva2Vuc19wZXJfZXhwZXJ0ID0gY291bnRzLmN1bXN1bSgpCiAgICAgICAgbnVtX3Blcl90b2sgPSBzZWxmLmNvbmZpZ1sibl9leHBlcnRzX3Blcl90b2tlbiJdCiAgICAgICAgdG9rZW5faWR4cyA9IGlkeHMgLy8gbnVtX3Blcl90b2sKICAgICAgICBmb3IgZXhwZXJ0X2lkLCBlbmRfaWR4IGluIGVudW1lcmF0ZSh0b2tlbnNfcGVyX2V4cGVydCk6CiAgICAgICAgICAgIHN0YXJ0X2lkeCA9IDAgaWYgZXhwZXJ0X2lkID09IDAgZWxzZSB0b2tlbnNfcGVyX2V4cGVydFtleHBlcnRfaWQgLSAxXQogICAgICAgICAgICBpZiBzdGFydF9pZHggPT0gZW5kX2lkeDoKICAgICAgICAgICAgICAgIGNvbnRpbnVlCiAgICAgICAgICAgIGV4cF90b2tlbl9pZHhzID0gdG9rZW5faWR4c1tzdGFydF9pZHg6ZW5kX2lkeF0KICAgICAgICAgICAgZXhwZXJ0X3Rva2VucyA9IHhbZXhwX3Rva2VuX2lkeHNdCiAgICAgICAgICAgIGV4cGVydF9vdXQgPSBzZWxmLmV4cGVydHNbZXhwZXJ0X2lkXShleHBlcnRfdG9rZW5zKQogICAgICAgICAgICBleHBlcnRfb3V0Lm11bF8oZmxhdF9leHBlcnRfd2VpZ2h0c1tpZHhzW3N0YXJ0X2lkeDplbmRfaWR4XV0pCiAgICAgICAgICAgIGV4cGVydF9jYWNoZS5zY2F0dGVyX3JlZHVjZV8oCiAgICAgICAgICAgICAgICAwLAogICAgICAgICAgICAgICAgZXhwX3Rva2VuX2lkeHMudmlldygtMSwgMSkucmVwZWF0KDEsIHguc2hhcGVbLTFdKSwKICAgICAgICAgICAgICAgIGV4cGVydF9vdXQsCiAgICAgICAgICAgICAgICByZWR1Y2U9InN1bSIsCiAgICAgICAgICAgICkKCiAgICAgICAgcmV0dXJuIGV4cGVydF9jYWNoZQoKCmRlZiBjdXN0b21fa2VybmVsKGRhdGE6IGlucHV0X3QpIC0+IG91dHB1dF90OgogICAgIiIiCiAgICBTdWJtaXNzaW9uIHRlbXBsYXRlIGZvciBEZWVwU2Vlay1zdHlsZSBNaXh0dXJlIG9mIEV4cGVydHMgdXNpbmcgUHlUb3JjaC4KCiAgICBBcmdzOgogICAgICAgIGRhdGE6IFR1cGxlIG9mIChpbnB1dDogdG9yY2guVGVuc29yLCB3ZWlnaHRzOiBEaWN0W3N0ciwgdG9yY2guVGVuc29yXSwgY29uZmlnOiBEaWN0KQogICAgICAgICAgICAtIGlucHV0OiBJbnB1dCB0ZW5zb3Igb2Ygc2hhcGUgW2JhdGNoX3NpemUsIHNlcV9sZW4sIGhpZGRlbl9zaXplXQogICAgICAgICAgICAtIHdlaWdodHM6IERpY3Rpb25hcnkgY29udGFpbmluZyBtb2RlbCB3ZWlnaHRzCiAgICAgICAgICAgIC0gY29uZmlnOiBEaWN0aW9uYXJ5IGNvbnRhaW5pbmcgbW9kZWwgY29uZmlndXJhdGlvbiBwYXJhbWV0ZXJzCgogICAgUmV0dXJuczoKICAgICAgICBUdXBsZSBjb250YWluaW5nOgogICAgICAgICAgICAtIG91dHB1dDogUHJvY2Vzc2VkIHRlbnNvciBbYmF0Y2hfc2l6ZSwgc2VxX2xlbiwgZF9tb2RlbF0KICAgICAgICAgICAgLSBhdXhfZGF0YTogRGljdGlvbmFyeSB3aXRoIGF1eGlsaWFyeSBkYXRhCiAgICAiIiIKICAgIGlucHV0X3RlbnNvciwgd2VpZ2h0cywgY29uZmlnID0gZGF0YQogICAgbnVtX2V4cGVydHMgPSBjb25maWdbIm5fcm91dGVkX2V4cGVydHMiXQoKICAgIGV4cGVydHMgPSBbICAgIAogICAgICAgIHBhcnRpYWwoCiAgICAgICAgICAgIGV4cGVydCwKICAgICAgICAgICAgd2VpZ2h0c1tmImV4cGVydHMue2l9LjAud2VpZ2h0Il0sCiAgICAgICAgICAgIHdlaWdodHNbZiJleHBlcnRzLntpfS4xLndlaWdodCJdLAogICAgICAgICAgICB3ZWlnaHRzW2YiZXhwZXJ0cy57aX0uMi53ZWlnaHQiXSwKICAgICAgICApICAgICAgICAKICAgICAgICBmb3IgaSBpbiByYW5nZShudW1fZXhwZXJ0cykKICAgIF0KICAgIAogICAgc19leHBlcnQgPSBwYXJ0aWFsKAogICAgICAgIGV4cGVydCwKICAgICAgICB3ZWlnaHRzWyJzaGFyZWRfZXhwZXJ0cy4wLndlaWdodCJdLAogICAgICAgIHdlaWdodHNbInNoYXJlZF9leHBlcnRzLjEud2VpZ2h0Il0sCiAgICAgICAgd2VpZ2h0c1sic2hhcmVkX2V4cGVydHMuMi53ZWlnaHQiXSwKICAgICkKICAgIAogICAgbW9lID0gTW9FKGNvbmZpZywgZXhwZXJ0cywgc19leHBlcnQpCgogICAgIyBGaWxsIGluIHRoZSBnaXZlbiB3ZWlnaHRzIG9mIHRoZSBtb2RlbAogICAgbW9lLmdhdGluZ19uZXR3b3JrLldfZy53ZWlnaHQgPSBubi5QYXJhbWV0ZXIod2VpZ2h0c1sicm91dGVyLndlaWdodCJdKQoKICAgICMgUnVuIHRoZSBtb2RlbAogICAgb3V0cHV0ID0gbW9lKGlucHV0X3RlbnNvcikKCiAgICByZXR1cm4gb3V0cHV0Cg==

Source code from GPU Mode and the KernelBot dataset · June 9 Researcher Reciprocity License v1.0

Best evidence level for this revision: reported

JSON