Skip to content
KernelIndex
Search⌘K
Sign in

amd-mixture-of-experts · submission 23050

KernelBot user 25 · python · License unknown
Kernel source · 1 lines ↓

Use it

Vendorable · source mirrored · license unknownView source →

No package. Vendor the mirrored source: 1 lines, June 9 Researcher Reciprocity License v1.0.

template-moe.py
curl "https://kernelindex.com/api/v1/implementations/kernelbot-amd-mixture-of-experts-23050?include=source"
interfacepython
Compatibility
measured onAMD Instinct MI300X
declared hardwareAMD Instinct MI300X
architecturesgfx942
dtypesfp16

Benchmark evidence

2 measurements across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
AMD DeepSeek-style MoE layerfp16 · [1, 2048, 7168]
AMD Instinct MI300X
6.20s
#97 of 118
2025-05-16
Run →
AMD DeepSeek-style MoE layerfp16 · [1, 8192, 7168]
AMD Instinct MI300X
6.22s
#98 of 118
2025-05-16
Run →

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:330c413e692d9f05090594976d34d1b5df0c85f956c7a493006c207c7d6eea65
license declaredunknown
license concludedunknown
imported2026-08-15

Kernel source

template-moe.py1 lines
aW1wb3J0IHRvcmNoCmltcG9ydCB0b3JjaC5ubiBhcyBubgppbXBvcnQgdG9yY2gubm4uZnVuY3Rpb25hbCBhcyBGCmZyb20gdHlwaW5nIGltcG9ydCBEaWN0LCBUdXBsZSwgT3B0aW9uYWwKaW1wb3J0IG1hdGgKCmNsYXNzIEV4cGVydChubi5Nb2R1bGUpOgogICAgZGVmIF9faW5pdF9fKHNlbGYsIGNvbmZpZzogRGljdCwgZF9leHBlcnQ6IE9wdGlvbmFsW2ludF0gPSBOb25lKToKICAgICAgICBzdXBlcigpLl9faW5pdF9fKCkKICAgICAgICBzZWxmLmNvbmZpZyA9IGNvbmZpZwogICAgICAgIHNlbGYuYWN0X2ZuID0gbm4uU2lMVSgpCiAgICAgICAgc2VsZi5kX2hpZGRlbjogaW50ID0gY29uZmlnWyJkX2hpZGRlbiJdCiAgICAgICAgc2VsZi5kX2V4cGVydDogaW50ID0gY29uZmlnWyJkX2V4cGVydCJdIGlmIGRfZXhwZXJ0IGlzIE5vbmUgZWxzZSBkX2V4cGVydAoKICAgICAgICBzZWxmLldfZ2F0ZSA9IG5uLkxpbmVhcihzZWxmLmRfaGlkZGVuLCBzZWxmLmRfZXhwZXJ0LCBiaWFzPUZhbHNlKQogICAgICAgIHNlbGYuV191cCA9IG5uLkxpbmVhcihzZWxmLmRfaGlkZGVuLCBzZWxmLmRfZXhwZXJ0LCBiaWFzPUZhbHNlKQogICAgICAgIHNlbGYuV19kb3duID0gbm4uTGluZWFyKHNlbGYuZF9leHBlcnQsIHNlbGYuZF9oaWRkZW4sIGJpYXM9RmFsc2UpCgogICAgZGVmIGZvcndhcmQoc2VsZiwgeDogdG9yY2guVGVuc29yKSAtPiB0b3JjaC5UZW5zb3I6CiAgICAgICAgZ2F0ZSA9IHNlbGYuYWN0X2ZuKHNlbGYuV19nYXRlKHgpKQogICAgICAgIHVwX2hpZGRlbiA9IHNlbGYuV191cCh4KQogICAgICAgIG91dCA9IHNlbGYuV19kb3duKGdhdGUgKiB1cF9oaWRkZW4pCiAgICAgICAgcmV0dXJuIG91dAoKY2xhc3MgTW9FR2F0ZShubi5Nb2R1bGUpOgogICAgZGVmIF9faW5pdF9fKHNlbGYsIGNvbmZpZzogRGljdCk6CiAgICAgICAgc3VwZXIoKS5fX2luaXRfXygpCiAgICAgICAgc2VsZi50b3BfazogaW50ID0gY29uZmlnWyJuX2V4cGVydHNfcGVyX3Rva2VuIl0KICAgICAgICBzZWxmLm51bV9leHBlcnRzOiBpbnQgPSBjb25maWdbIm5fcm91dGVkX2V4cGVydHMiXQogICAgICAgIHNlbGYuZF9oaWRkZW46IGludCA9IGNvbmZpZ1siZF9oaWRkZW4iXQoKICAgICAgICBzZWxmLldfZyA9IG5uLkxpbmVhcihzZWxmLmRfaGlkZGVuLCBzZWxmLm51bV9leHBlcnRzLCBiaWFzPUZhbHNlKQoKICAgIGRlZiBmb3J3YXJkKHNlbGYsIHg6IHRvcmNoLlRlbnNvcikgLT4gVHVwbGVbdG9yY2guVGVuc29yLCB0b3JjaC5UZW5zb3IsIHRvcmNoLlRlbnNvcl06CiAgICAgICAgbG9naXRzID0gc2VsZi5XX2coeCkKICAgICAgICBzY29yZXMgPSBGLnNvZnRtYXgobG9naXRzLCBkaW09LTEpCiAgICAgICAgdG9wa19zY29yZXMsIHRvcGtfaW5kaWNlcyA9IHRvcmNoLnRvcGsoc2NvcmVzLCBrPXNlbGYudG9wX2ssIGRpbT0tMSwgc29ydGVkPUZhbHNlKQogICAgICAgIHJldHVybiB0b3BrX2luZGljZXMsIHRvcGtfc2NvcmVzLCBzY29yZXMKCmNsYXNzIE1vRShubi5Nb2R1bGUpOgogICAgZGVmIF9faW5pdF9fKHNlbGYsIGNvbmZpZzogRGljdCk6CiAgICAgICAgc3VwZXIoKS5fX2luaXRfXygpCiAgICAgICAgc2VsZi5jb25maWcgPSBjb25maWcKICAgICAgICBzZWxmLmV4cGVydHMgPSBubi5Nb2R1bGVMaXN0KFsKICAgICAgICAgICAgRXhwZXJ0KGNvbmZpZykgZm9yIF8gaW4gcmFuZ2UoY29uZmlnWyJuX3JvdXRlZF9leHBlcnRzIl0pCiAgICAgICAgXSkKICAgICAgICBzZWxmLmdhdGluZ19uZXR3b3JrID0gTW9FR2F0ZShjb25maWcpCiAgICAgICAgCiAgICAgICAgc2hhcmVkX2V4cGVydF9jb25maWcgPSBjb25maWcuY29weSgpIAogICAgICAgIG5fc2hhcmVkX2V4cGVydHMgPSBjb25maWcuZ2V0KCJuX3NoYXJlZF9leHBlcnRzIiwgMSkgCiAgICAgICAgZF9leHBlcnRfc2hhcmVkID0gY29uZmlnWyJkX2V4cGVydCJdICogbl9zaGFyZWRfZXhwZXJ0cwogICAgICAgIAogICAgICAgIHNlbGYuc2hhcmVkX2V4cGVydCA9IEV4cGVydChzaGFyZWRfZXhwZXJ0X2NvbmZpZywgZF9leHBlcnQ9ZF9leHBlcnRfc2hhcmVkKQogICAgICAgIAogICAgICAgIHNlbGYuYXV4X2xvc3Nfd2VpZ2h0ID0gY29uZmlnLmdldCgiYXV4X2xvc3Nfd2VpZ2h0IiwgMC4wMSkKCiAgICBkZWYgZm9yd2FyZChzZWxmLCB4OiB0b3JjaC5UZW5zb3IpIC0+IFR1cGxlW3RvcmNoLlRlbnNvciwgRGljdF06CiAgICAgICAgYmF0Y2hfc2l6ZSwgc2VxX2xlbiwgaGlkZGVuX2RpbSA9IHguc2hhcGUKICAgICAgICBvcmlnX3NoYXBlID0geC5zaGFwZQoKICAgICAgICBzaGFyZWRfb3V0cHV0ID0gc2VsZi5zaGFyZWRfZXhwZXJ0KHgpCiAgICAgICAgCiAgICAgICAgZXhwZXJ0X2luZGljZXMsIGV4cGVydF9zY29yZXMsIGFsbF9yb3V0ZXJfc2NvcmVzID0gc2VsZi5nYXRpbmdfbmV0d29yayh4KQogICAgICAgIAogICAgICAgIHhfZmxhdCA9IHgudmlldygtMSwgaGlkZGVuX2RpbSkKICAgICAgICBmbGF0X2V4cGVydF9pbmRpY2VzID0gZXhwZXJ0X2luZGljZXMudmlldygtMSkKICAgICAgICBmbGF0X2V4cGVydF93ZWlnaHRzID0gZXhwZXJ0X3Njb3Jlcy52aWV3KC0xLCAxKQogICAgICAgIAogICAgICAgIHJvdXRlZF9vdXRwdXRfZmxhdCA9IHNlbGYubW9lX2luZmVyKAogICAgICAgICAgICB4X2ZsYXQsIGZsYXRfZXhwZXJ0X2luZGljZXMsIGZsYXRfZXhwZXJ0X3dlaWdodHMKICAgICAgICApCiAgICAgICAgCiAgICAgICAgcm91dGVkX291dHB1dCA9IHJvdXRlZF9vdXRwdXRfZmxhdC52aWV3KCpvcmlnX3NoYXBlKQogICAgICAgIGZpbmFsX291dHB1dCA9IHJvdXRlZF9vdXRwdXQgKyBzaGFyZWRfb3V0cHV0CiAgICAgICAgCiAgICAgICAgYXV4X2RhdGEgPSBzZWxmLmNvbXB1dGVfYXV4X2xvc3NlcyhhbGxfcm91dGVyX3Njb3JlcywgZXhwZXJ0X2luZGljZXMpCiAgICAgICAgCiAgICAgICAgcmV0dXJuIGZpbmFsX291dHB1dCwgYXV4X2RhdGEKCiAgICBAdG9yY2gubm9fZ3JhZCgpCiAgICBkZWYgbW9lX2luZmVyKHNlbGYsIHg6IHRvcmNoLlRlbnNvciwgZmxhdF9leHBlcnRfaW5kaWNlczogdG9yY2guVGVuc29yLAogICAgICAgICAgICAgICAgIGZsYXRfZXhwZXJ0X3dlaWdodHM6IHRvcmNoLlRlbnNvcikgLT4gdG9yY2guVGVuc29yOgogICAgICAgIGV4cGVydF9jYWNoZSA9IHRvcmNoLnplcm9zX2xpa2UoeCkKICAgICAgICAKICAgICAgICBpZHhzID0gZmxhdF9leHBlcnRfaW5kaWNlcy5hcmdzb3J0KCkKICAgICAgICBjb3VudHMgPSBmbGF0X2V4cGVydF9pbmRpY2VzLmJpbmNvdW50KG1pbmxlbmd0aD1zZWxmLmNvbmZpZ1sibl9yb3V0ZWRfZXhwZXJ0cyJdKS5jcHUoKS5udW1weSgpCiAgICAgICAgdG9rZW5zX3Blcl9leHBlcnRfY3Vtc3VtID0gY291bnRzLmN1bXN1bSgpCgogICAgICAgIG51bV9wZXJfdG9rID0gc2VsZi5jb25maWdbIm5fZXhwZXJ0c19wZXJfdG9rZW4iXQogICAgICAgIHRva2VuX2lkeHNfZm9yX3NvcnRlZF9hc3NpZ25tZW50cyA9IGlkeHMgLy8gbnVtX3Blcl90b2sKCiAgICAgICAgZm9yIGV4cGVydF9pZCwgZW5kX2lkeF9pbl9zb3J0ZWRfbGlzdCBpbiBlbnVtZXJhdGUodG9rZW5zX3Blcl9leHBlcnRfY3Vtc3VtKToKICAgICAgICAgICAgc3RhcnRfaWR4X2luX3NvcnRlZF9saXN0ID0gMCBpZiBleHBlcnRfaWQgPT0gMCBlbHNlIHRva2Vuc19wZXJfZXhwZXJ0X2N1bXN1bVtleHBlcnRfaWQgLSAxXQogICAgICAgICAgICBpZiBzdGFydF9pZHhfaW5fc29ydGVkX2xpc3QgPT0gZW5kX2lkeF9pbl9zb3J0ZWRfbGlzdDoKICAgICAgICAgICAgICAgIGNvbnRpbnVlCgogICAgICAgICAgICBleHBlcnQgPSBzZWxmLmV4cGVydHNbZXhwZXJ0X2lkXQogICAgICAgICAgICBjdXJyZW50X2V4cGVydF9vcmlnaW5hbF90b2tlbl9pbmRpY2VzID0gdG9rZW5faWR4c19mb3Jfc29ydGVkX2Fzc2lnbm1lbnRzW3N0YXJ0X2lkeF9pbl9zb3J0ZWRfbGlzdDplbmRfaWR4X2luX3NvcnRlZF9saXN0XQogICAgICAgICAgICBleHBlcnRfdG9rZW5zX2lucHV0ID0geFtjdXJyZW50X2V4cGVydF9vcmlnaW5hbF90b2tlbl9pbmRpY2VzXQogICAgICAgICAgICBleHBlcnRfdG9rZW5zX291dHB1dCA9IGV4cGVydChleHBlcnRfdG9rZW5zX2lucHV0KQogICAgICAgICAgICAKICAgICAgICAgICAgd2VpZ2h0c19mb3JfY3VycmVudF9hc3NpZ25tZW50cyA9IGZsYXRfZXhwZXJ0X3dlaWdodHNbaWR4c1tzdGFydF9pZHhfaW5fc29ydGVkX2xpc3Q6ZW5kX2lkeF9pbl9zb3J0ZWRfbGlzdF1dCiAgICAgICAgICAgIGV4cGVydF90b2tlbnNfb3V0cHV0Lm11bF8od2VpZ2h0c19mb3JfY3VycmVudF9hc3NpZ25tZW50cykKICAgICAgICAgICAgCiAgICAgICAgICAgIGV4cGVydF9jYWNoZS5zY2F0dGVyX3JlZHVjZV8oCiAgICAgICAgICAgICAgICAwLCAKICAgICAgICAgICAgICAgIGN1cnJlbnRfZXhwZXJ0X29yaWdpbmFsX3Rva2VuX2luZGljZXMudmlldygtMSwgMSkucmVwZWF0KDEsIHguc2hhcGVbLTFdKSwKICAgICAgICAgICAgICAgIGV4cGVydF90b2tlbnNfb3V0cHV0LAogICAgICAgICAgICAgICAgcmVkdWNlPSdzdW0nLAogICAgICAgICAgICAgICAgaW5jbHVkZV9zZWxmPVRydWUgCiAgICAgICAgICAgICkKICAgICAgICByZXR1cm4gZXhwZXJ0X2NhY2hlCgogICAgZGVmIGNvbXB1dGVfYXV4X2xvc3NlcyhzZWxmLCByb3V0ZXJfcHJvYnNfYWxsX2V4cGVydHM6IHRvcmNoLlRlbnNvciwgCiAgICAgICAgICAgICAgICAgICAgICAgICB0b3BrX2V4cGVydF9pbmRpY2VzOiB0b3JjaC5UZW5zb3IpIC0+IERpY3Q6CiAgICAgICAgbnVtX2V4cGVydHMgPSBzZWxmLmNvbmZpZ1sibl9yb3V0ZWRfZXhwZXJ0cyJdCiAgICAgICAgCiAgICAgICAgdG9wa19leHBlcnRfaW5kaWNlc19mbGF0ID0gdG9wa19leHBlcnRfaW5kaWNlcy52aWV3KC0xKQogICAgICAgIGNvdW50cyA9IHRvcmNoLmJpbmNvdW50KHRvcGtfZXhwZXJ0X2luZGljZXNfZmxhdCwgbWlubGVuZ3RoPW51bV9leHBlcnRzKS5mbG9hdCgpCiAgICAgICAgdG90YWxfYXNzaWdubWVudHMgPSB0b3BrX2V4cGVydF9pbmRpY2VzLm51bWVsKCkgCiAgICAgICAgZnJhY3Rpb25fYXNzaWdubWVudHNfcGVyX2V4cGVydCA9IGNvdW50cyAvIHRvdGFsX2Fzc2lnbm1lbnRzCiAgICAgICAgbG9hZF9iYWxhbmNlX2xvc3MgPSBudW1fZXhwZXJ0cyAqIHRvcmNoLnN1bShmcmFjdGlvbl9hc3NpZ25tZW50c19wZXJfZXhwZXJ0LnBvdygyKSkgLSAxLjAgCgogICAgICAgIHpfbG9zcyA9IChyb3V0ZXJfcHJvYnNfYWxsX2V4cGVydHMucG93KDIpKS5tZWFuKCkKICAgICAgICB0b3RhbF9hdXhfbG9zcyA9IHNlbGYuYXV4X2xvc3Nfd2VpZ2h0ICogKGxvYWRfYmFsYW5jZV9sb3NzICsgel9sb3NzKQogICAgICAgIAogICAgICAgIHJldHVybiB7CiAgICAgICAgICAgICJyb3V0ZXJfcHJvYnMiOiByb3V0ZXJfcHJvYnNfYWxsX2V4cGVydHMsCiAgICAgICAgICAgICJsb2FkX2JhbGFuY2VfbG9zcyI6IGxvYWRfYmFsYW5jZV9sb3NzLAogICAgICAgICAgICAiel9sb3NzIjogel9sb3NzLAogICAgICAgICAgICAidG90YWxfYXV4X2xvc3MiOiB0b3RhbF9hdXhfbG9zcwogICAgICAgIH0KCmRlZiBjdXN0b21fa2VybmVsKGRhdGE6IFR1cGxlW3RvcmNoLlRlbnNvciwgRGljdFtzdHIsIHRvcmNoLlRlbnNvcl0sIERpY3RdKSAtPiB0b3JjaC5UZW5zb3I6CiAgICBpbnB1dF90ZW5zb3IsIHdlaWdodHMsIGNvbmZpZyA9IGRhdGEKICAgIG51bV9leHBlcnRzID0gY29uZmlnWyJuX3JvdXRlZF9leHBlcnRzIl0KICAgIAogICAgaW5wdXRfdGVuc29yID0gaW5wdXRfdGVuc29yLnRvKGR0eXBlPXRvcmNoLmZsb2F0MTYpCiAgICAKICAgIG1vZV9tb2R1bGUgPSBNb0UoY29uZmlnKQogICAgCiAgICBtb2VfbW9kdWxlLmdhdGluZ19uZXR3b3JrLldfZy53ZWlnaHQgPSBubi5QYXJhbWV0ZXIod2VpZ2h0c1sncm91dGVyLndlaWdodCddLnRvKGR0eXBlPXRvcmNoLmZsb2F0MTYpKQogICAgCiAgICBmb3IgaSBpbiByYW5nZShudW1fZXhwZXJ0cyk6CiAgICAgICAgZ2F0ZV93ZWlnaHRfdCA9IHdlaWdodHNbZidleHBlcnRzLntpfS4wLndlaWdodCddLnQoKS50byhkdHlwZT10b3JjaC5mbG9hdDE2KQogICAgICAgIHVwX3dlaWdodF90ID0gd2VpZ2h0c1tmJ2V4cGVydHMue2l9LjEud2VpZ2h0J10udCgpLnRvKGR0eXBlPXRvcmNoLmZsb2F0MTYpCiAgICAgICAgZG93bl93ZWlnaHRfdCA9IHdlaWdodHNbZidleHBlcnRzLntpfS4yLndlaWdodCddLnQoKS50byhkdHlwZT10b3JjaC5mbG9hdDE2KQogICAgICAgIAogICAgICAgIG1vZV9tb2R1bGUuZXhwZXJ0c1tpXS5XX2dhdGUud2VpZ2h0ID0gbm4uUGFyYW1ldGVyKGdhdGVfd2VpZ2h0X3QpCiAgICAgICAgbW9lX21vZHVsZS5leHBlcnRzW2ldLldfdXAud2VpZ2h0ID0gbm4uUGFyYW1ldGVyKHVwX3dlaWdodF90KQogICAgICAgIG1vZV9tb2R1bGUuZXhwZXJ0c1tpXS5XX2Rvd24ud2VpZ2h0ID0gbm4uUGFyYW1ldGVyKGRvd25fd2VpZ2h0X3QpCiAgICAKICAgIG1vZV9tb2R1bGUuc2hhcmVkX2V4cGVydC5XX2dhdGUud2VpZ2h0ID0gbm4uUGFyYW1ldGVyKHdlaWdodHNbJ3NoYXJlZF9leHBlcnRzLjAud2VpZ2h0J10udCgpLnRvKGR0eXBlPXRvcmNoLmZsb2F0MTYpKQogICAgbW9lX21vZHVsZS5zaGFyZWRfZXhwZXJ0LldfdXAud2VpZ2h0ID0gbm4uUGFyYW1ldGVyKHdlaWdodHNbJ3NoYXJlZF9leHBlcnRzLjEud2VpZ2h0J10udCgpLnRvKGR0eXBlPXRvcmNoLmZsb2F0MTYpKQogICAgbW9lX21vZHVsZS5zaGFyZWRfZXhwZXJ0LldfZG93bi53ZWlnaHQgPSBubi5QYXJhbWV0ZXIod2VpZ2h0c1snc2hhcmVkX2V4cGVydHMuMi53ZWlnaHQnXS50KCkudG8oZHR5cGU9dG9yY2guZmxvYXQxNikpCiAgICAKICAgIG1vZV9tb2R1bGUgPSBtb2VfbW9kdWxlLnRvKGRldmljZT0nY3VkYScsIGR0eXBlPXRvcmNoLmZsb2F0MTYpCiAgICAKICAgIG91dHB1dF90ZW5zb3IsIF8gPSBtb2VfbW9kdWxlKGlucHV0X3RlbnNvcikgCiAgICAKICAgIHJldHVybiBvdXRwdXRfdGVuc29y

Source code from GPU Mode and the KernelBot dataset · June 9 Researcher Reciprocity License v1.0

Best evidence level for this revision: reported

JSON