AMD DeepSeek-style MoE layer
DeepSeek-style mixture-of-experts layer on a single MI300X: softmax router, top-k routing to routed plus shared experts, fp16 activations. Expert/router weights and configuration accompany the input tensor as described upstream.
Reported evidence · last observed 2025-06-02. Reported by source; not independently reproduced. License unknown.
Current records
Not measured on H100, B200 for this workload. Challenges →
Estimated floor 5.54 µs · record 741.77× above itestimate, not evidence ›
1amd-mixture-of-experts · submission 30702KernelBot user 3024.11ms1.00×Reported · license unknown · source2025-06-02stale
Measured exactly what you asked. Reported by source; not independently reproduced.
2amd-mixture-of-experts · submission 30063KernelBot user 3024.15ms1.01×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
3amd-mixture-of-experts · submission 29858KernelBot user 3024.18ms1.02×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
4amd-mixture-of-experts · submission 30960KernelBot user 444.23ms1.03×Reported · license unknown · source2025-06-03stale
Measured exactly what you asked. Reported by source; not independently reproduced.
5amd-mixture-of-experts · submission 30957KernelBot user 444.30ms1.05×Reported · license unknown · source2025-06-03stale
Measured exactly what you asked. Reported by source; not independently reproduced.
6amd-mixture-of-experts · submission 31042KernelBot user 74.47ms1.09×Reported · license unknown · source2025-06-03stale
Measured exactly what you asked. Reported by source; not independently reproduced.
7amd-mixture-of-experts · submission 31032KernelBot user 74.47ms1.09×Reported · license unknown · source2025-06-03stale
Measured exactly what you asked. Reported by source; not independently reproduced.
8amd-mixture-of-experts · submission 31029KernelBot user 4154.48ms1.09×Reported · license unknown · source2025-06-03stale
Measured exactly what you asked. Reported by source; not independently reproduced.
9amd-mixture-of-experts · submission 30943KernelBot user 444.49ms1.09×Reported · license unknown · source2025-06-03stale
Measured exactly what you asked. Reported by source; not independently reproduced.
10amd-mixture-of-experts · submission 31080KernelBot user 3764.55ms1.11×Reported · license unknown · source2025-06-03stale
Measured exactly what you asked. Reported by source; not independently reproduced.
11amd-mixture-of-experts · submission 30084KernelBot user 3764.60ms1.12×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
12amd-mixture-of-experts · submission 30341KernelBot user 74.60ms1.12×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
13amd-mixture-of-experts · submission 29857KernelBot user 3764.60ms1.12×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
14amd-mixture-of-experts · submission 30338KernelBot user 4154.62ms1.12×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
15amd-mixture-of-experts · submission 30167KernelBot user 74.62ms1.12×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
16amd-mixture-of-experts · submission 30161KernelBot user 74.64ms1.13×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
17amd-mixture-of-experts · submission 30429KernelBot user 444.67ms1.14×Reported · license unknown · source2025-06-02stale
Measured exactly what you asked. Reported by source; not independently reproduced.
18amd-mixture-of-experts · submission 30424KernelBot user 444.72ms1.15×Reported · license unknown · source2025-06-02stale
Measured exactly what you asked. Reported by source; not independently reproduced.
19amd-mixture-of-experts · submission 30076KernelBot user 444.80ms1.17×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
20amd-mixture-of-experts · submission 29947KernelBot user 444.93ms1.20×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
21amd-mixture-of-experts · submission 26179KernelBot user 3024.93ms1.20×Reported · license unknown · source2025-05-22stale
Measured exactly what you asked. Reported by source; not independently reproduced.
22amd-mixture-of-experts · submission 30027KernelBot user 444.94ms1.20×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
23amd-mixture-of-experts · submission 25943KernelBot user 3764.95ms1.20×Reported · license unknown · source2025-05-21stale
Measured exactly what you asked. Reported by source; not independently reproduced.
24amd-mixture-of-experts · submission 29937KernelBot user 445.16ms1.26×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
25amd-mixture-of-experts · submission 23854KernelBot user 3765.24ms1.27×Reported · license unknown · source2025-05-17stale
Measured exactly what you asked. Reported by source; not independently reproduced.
26amd-mixture-of-experts · submission 29919KernelBot user 445.31ms1.29×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
27amd-mixture-of-experts · submission 29927KernelBot user 445.31ms1.29×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
28amd-mixture-of-experts · submission 29917KernelBot user 445.32ms1.29×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
29amd-mixture-of-experts · submission 26164KernelBot user 3025.32ms1.30×Reported · license unknown · source2025-05-22stale
Measured exactly what you asked. Reported by source; not independently reproduced.
30amd-mixture-of-experts · submission 29643KernelBot user 75.37ms1.31×Reported · license unknown · source2025-05-31stale
Measured exactly what you asked. Reported by source; not independently reproduced.
31amd-mixture-of-experts · submission 29756KernelBot user 1265.42ms1.32×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
32amd-mixture-of-experts · submission 29642KernelBot user 4155.46ms1.33×Reported · license unknown · source2025-05-31stale
Measured exactly what you asked. Reported by source; not independently reproduced.
33amd-mixture-of-experts · submission 29457KernelBot user 1265.52ms1.34×Reported · license unknown · source2025-05-31stale
Measured exactly what you asked. Reported by source; not independently reproduced.
34amd-mixture-of-experts · submission 24936KernelBot user 3025.53ms1.34×Reported · license unknown · source2025-05-19stale
Measured exactly what you asked. Reported by source; not independently reproduced.
35amd-mixture-of-experts · submission 24933KernelBot user 3025.56ms1.35×Reported · license unknown · source2025-05-19stale
Measured exactly what you asked. Reported by source; not independently reproduced.
36amd-mixture-of-experts · submission 24934KernelBot user 3025.65ms1.37×Reported · license unknown · source2025-05-19stale
Measured exactly what you asked. Reported by source; not independently reproduced.
37amd-mixture-of-experts · submission 29047KernelBot user 1265.65ms1.37×Reported · license unknown · source2025-05-29stale
Measured exactly what you asked. Reported by source; not independently reproduced.
38amd-mixture-of-experts · submission 29220KernelBot user 1265.65ms1.38×Reported · license unknown · source2025-05-30stale
Measured exactly what you asked. Reported by source; not independently reproduced.
39amd-mixture-of-experts · submission 26159KernelBot user 1265.78ms1.41×Reported · license unknown · source2025-05-22stale
Measured exactly what you asked. Reported by source; not independently reproduced.
40amd-mixture-of-experts · submission 26152KernelBot user 1265.82ms1.42×Reported · license unknown · source2025-05-22stale
Measured exactly what you asked. Reported by source; not independently reproduced.
41amd-mixture-of-experts · submission 29599KernelBot user 75.87ms1.43×Reported · license unknown · source2025-05-31stale
Measured exactly what you asked. Reported by source; not independently reproduced.
42amd-mixture-of-experts · submission 29075KernelBot user 1605.87ms1.43×Reported · license unknown · source2025-05-29stale
Measured exactly what you asked. Reported by source; not independently reproduced.
43amd-mixture-of-experts · submission 31459KernelBot user 2525.90ms1.44×Reported · license unknown · source2025-06-05stale
Measured exactly what you asked. Reported by source; not independently reproduced.
44amd-mixture-of-experts · submission 27659KernelBot user 1606.00ms1.46×Reported · license unknown · source2025-05-26stale
Measured exactly what you asked. Reported by source; not independently reproduced.
45amd-mixture-of-experts · submission 27658KernelBot user 1606.06ms1.47×Reported · license unknown · source2025-05-26stale
Measured exactly what you asked. Reported by source; not independently reproduced.
46amd-mixture-of-experts · submission 27552KernelBot user 1606.32ms1.54×Reported · license unknown · source2025-05-26stale
Measured exactly what you asked. Reported by source; not independently reproduced.
47amd-mixture-of-experts · submission 25595KernelBot user 1606.42ms1.56×Reported · license unknown · source2025-05-20stale
Measured exactly what you asked. Reported by source; not independently reproduced.
48amd-mixture-of-experts · submission 25584KernelBot user 1606.46ms1.57×Reported · license unknown · source2025-05-20stale
Measured exactly what you asked. Reported by source; not independently reproduced.
49amd-mixture-of-experts · submission 15625KernelBot user 2126.85ms1.67×Reported · license unknown · source2025-05-04stale
Measured exactly what you asked. Reported by source; not independently reproduced.
50amd-mixture-of-experts · submission 27114KernelBot user 1627.00ms1.70×Reported · license unknown · source2025-05-25stale
Measured exactly what you asked. Reported by source; not independently reproduced.
51amd-mixture-of-experts · submission 24971KernelBot user 1607.59ms1.85×Reported · license unknown · source2025-05-19stale
Measured exactly what you asked. Reported by source; not independently reproduced.
52amd-mixture-of-experts · submission 29838KernelBot user 878.64ms2.10×Reported · license unknown · source2025-06-01stale
Measured exactly what you asked. Reported by source; not independently reproduced.
53amd-mixture-of-experts · submission 24451KernelBot user 3029.17ms2.23×Reported · license unknown · source2025-05-18stale
Measured exactly what you asked. Reported by source; not independently reproduced.
54amd-mixture-of-experts · submission 28629KernelBot user 79.88ms2.40×Reported · license unknown · source2025-05-28stale
Measured exactly what you asked. Reported by source; not independently reproduced.
55amd-mixture-of-experts · submission 28624KernelBot user 79.99ms2.43×Reported · license unknown · source2025-05-28stale
Measured exactly what you asked. Reported by source; not independently reproduced.
56amd-mixture-of-experts · submission 31229KernelBot user 26611.3ms2.76×Reported · license unknown · source2025-06-03stale
Measured exactly what you asked. Reported by source; not independently reproduced.
57amd-mixture-of-experts · submission 28576KernelBot user 711.6ms2.82×Reported · license unknown · source2025-05-28stale
Measured exactly what you asked. Reported by source; not independently reproduced.
58amd-mixture-of-experts · submission 28488KernelBot user 41511.9ms2.89×Reported · license unknown · source2025-05-28stale
Measured exactly what you asked. Reported by source; not independently reproduced.
59amd-mixture-of-experts · submission 30990KernelBot user 20311.9ms2.91×Reported · license unknown · source2025-06-03stale
Measured exactly what you asked. Reported by source; not independently reproduced.
60amd-mixture-of-experts · submission 15074KernelBot user 24713.5ms3.28×Reported · license unknown · source2025-05-03stale
Measured exactly what you asked. Reported by source; not independently reproduced.
58 more rows in this comparison group. Open all in search →