Run 01a006cd · KernelIndex

Primary measurement

4.18msmean of 20

Rank 3 in its comparison group · source-native comparison · observed 2025-06-01

Compare with #1 →

best ns 4057360 · mean ns 4175913.45 · leaderboard score s 0.0073761345439469495

Identity

implementationamd-mixture-of-experts · submission 29858

projectKernelBot user 302

revisionsubmission-29858

workloadbs = 1 · seed = 9371 · seqlen = 2048 · dexpert = 2048 · dhidden = 7168 · nroutedexperts = 32 · nsharedexperts = 1 · nexpertspertoken = 4 · fp16

comparison keysha256:a11fec553fc287b0…

sourceGPU MODE KernelBot

external idsubmission/29858/benchmark/0

sha256:039bd61d3cb43b7c6b778e4…

Correctness

Marked passed by the source; the correctness policy was not published.

Workload

bs1

seed9371

seqlen2048

dexpert2048

dhidden7168

nroutedexperts32

nsharedexperts1

nexpertspertoken4

inputfp16 [1, 2048, 7168]

definition comparatorkernelbot_eval

Measurements

latency · max4.29 ms · n=20

latency · mean4.18 ms · n=20

latency · min4.06 ms · n=20

latency · std59.6 µs · n=20

Protocol

harnessreference-kernels eval.py

timerwall_clock

primaryStatisticmean

correctnessReferenceproblem reference implementation

comparabilityFamilygpumode_kernelbot

Environment

gpuAMD Instinct MI300X (gfx942)

Artifacts

No artifacts published with this run.

Replications and notes

No attestations yet.

Community attestations. They never change the evidence level; only a KernelIndex-controlled rerun does.

Add a reproduction or note

Canonical manifest

Show manifest

{
  "run": {
    "kind": "BenchmarkRun",
    "spec": {
      "status": "passed",
      "timing": {
        "samples": 20,
        "latencyNs": {
          "mean": 4175913,
          "maximum": 4287644,
          "minimum": 4057360
        },
        "primaryStatistic": "mean"
      },
      "observedAt": "2025-06-01T09:11:14.635Z",
      "measurements": [
        {
          "unit": "ns",
          "value": 59575.79732838796,
          "metric": "latency",
          "statistic": "std",
          "sampleCount": 20
        }
      ],
      "sourceNative": {
        "source": "gpumode-kernelbot",
        "metrics": {
          "best_ns": 4057360,
          "mean_ns": 4175913.45,
          "leaderboard_score_s": 0.0073761345439469495
        },
        "benchmark": "amd-mixture-of-experts/0",
        "externalId": "submission/29858"
      },
      "protocolDigest": "sha256:7c66da4b5866502eb10444a7ba013d0f6bdf1620c55847945008cad2fbf98aec",
      "workloadDigest": "sha256:83ec2927d923cdd5616c8c43cb3970963f0fdec0c720c7a921b72f9ae73a4973",
      "environmentDigest": "sha256:f722892449ed976f3e21b12df8b92b34573fc232883fec6a2f3da399a00abdd5",
      "implementationDigest": "sha256:63840fc0535039bd35cfe7486bfd765d7aa2d63387b740d0ea958d1eea587b98"
    },
    "metadata": {
      "name": "kernelbot-29858-bs1-dexpert2048-dhidden7168-nexpertspertoken4-nroutedexperts32-nsharedexperts1-seed9",
      "title": "amd-mixture-of-experts · submission 29858 · case 0",
      "labels": {
        "torch": "2.8.0.dev20250530+rocm6.3",
        "platform": "Linux-5.15.0-136-generic-x86_64-with-glibc2.35"
      }
    },
    "apiVersion": "kernelindex.dev/v1alpha1"
  },
  "protocol": {
    "kind": "BenchmarkProtocol",
    "spec": {
      "harness": {
        "name": "reference-kernels eval.py",
        "repository": "https://github.com/gpu-mode/reference-kernels"
      },
      "correctness": {
        "reference": "problem reference implementation",
        "comparator": "kernelbot_eval"
      },
      "measurement": {
        "timer": "wall_clock",
        "primaryStatistic": "mean"
      },
      "comparability": {
        "notes": "Per-case wall-clock statistics as published in the KernelBot dataset. Comparable only within one leaderboard problem and GPU type; runner software versions ride each run's labels.",
        "family": "gpumode_kernelbot"
      }
    },
    "metadata": {
      "name": "gpumode-kernelbot-eval",
      "title": "GPU MODE KernelBot evaluation harness"
    },
    "apiVersion": "kernelindex.dev/v1alpha1"
  },
  "environment": {
    "kind": "ExecutionEnvironment",
    "spec": {
      "hardware": {
        "vendor": "amd",
        "product": "AMD Instinct MI300X",
        "architecture": "gfx942"
      },
      "software": {}
    },
    "metadata": {
      "name": "gpumode-kernelbot-amd-instinct-mi300x",
      "title": "KernelBot runner · AMD Instinct MI300X"
    },
    "apiVersion": "kernelindex.dev/v1alpha1"
  }
}

Cite this record (permalink, digest, access date)

Report an issue with this run

Published 2026-08-15 · GPU MODE KernelBot · June 9 Researcher Reciprocity License v1.0All results for AMD DeepSeek-style MoE layer →JSON