Run 01a00738 · KernelIndex

Primary measurement

8.68msgeomean

Rank 303 in its comparison group · source-native comparison · observed 2026-02-04

Compare with #1 →

leaderboard score s 0.008675987932524712

Identity

implementationsubmission 456302

projectNick Nuon

revisionsubmission-456302

workloadsuite of 4 cases · geomean score

comparison keysha256:132311547c1b5499…

sourceGPU MODE KernelBot

external idsubmission/456302/leaderboard

sha256:e5a33381b8b0c71cfa39912…

Correctness

Marked passed by the source; the correctness policy was not published.

Workload

definition comparatorkernelbot_eval

Measurements

score · geomean8.68 ms

Protocol

harnessreference-kernels eval.py

timerwall_clock

primaryStatisticgeomean

correctnessReferenceproblem reference implementation

comparabilityFamilygpumode_kernelbot

Environment

gpuNVIDIA B200 (sm_100)

Artifacts

No artifacts published with this run.

Replications and notes

No attestations yet.

Community attestations. They never change the evidence level; only a KernelIndex-controlled rerun does.

Add a reproduction or note

Canonical manifest

Show manifest

{
  "run": {
    "kind": "BenchmarkRun",
    "spec": {
      "status": "passed",
      "observedAt": "2026-02-04T20:26:23.657Z",
      "measurements": [
        {
          "unit": "s",
          "value": 0.008675987932524712,
          "metric": "score",
          "statistic": "geomean"
        }
      ],
      "sourceNative": {
        "source": "gpumode-kernelbot",
        "metrics": {
          "leaderboard_score_s": 0.008675987932524712
        },
        "benchmark": "nvfp4_group_gemm",
        "externalId": "submission/456302"
      },
      "protocolDigest": "sha256:07f73e59fb4c7fac9bf84af1e107001e008035039bb08edcf6948cea84a7027f",
      "workloadDigest": "sha256:de7127d5efc78c4805d68e0c96cb081fab2001a6431b1b6632eabd7efe26514f",
      "environmentDigest": "sha256:df2eb9d2f5f0b054d1e01d7d7f4996a5b1cb67e1e2f208a913519f196b3839ad",
      "implementationDigest": "sha256:512c74ff13bdef093ae1ecbd25f47bd726f57b04d3849bce0951caf06d74de32"
    },
    "metadata": {
      "name": "kernelbot-456302-leaderboard",
      "title": "nvfp4_group_gemm · submission 456302 · leaderboard score"
    },
    "apiVersion": "kernelindex.dev/v1alpha1"
  },
  "protocol": {
    "kind": "BenchmarkProtocol",
    "spec": {
      "harness": {
        "name": "reference-kernels eval.py",
        "repository": "https://github.com/gpu-mode/reference-kernels"
      },
      "correctness": {
        "reference": "problem reference implementation",
        "comparator": "kernelbot_eval"
      },
      "measurement": {
        "timer": "wall_clock",
        "primaryStatistic": "geomean"
      },
      "comparability": {
        "notes": "Aggregate leaderboard score in seconds over the problem's published benchmark suite, as computed by the upstream ranked run. Comparable only within one leaderboard problem and runner type.",
        "family": "gpumode_kernelbot"
      }
    },
    "metadata": {
      "name": "gpumode-kernelbot-leaderboard-geomean",
      "title": "GPU MODE KernelBot ranked leaderboard run"
    },
    "apiVersion": "kernelindex.dev/v1alpha1"
  },
  "environment": {
    "kind": "ExecutionEnvironment",
    "spec": {
      "hardware": {
        "vendor": "nvidia",
        "product": "NVIDIA B200",
        "formFactor": "runner:B200",
        "architecture": "sm_100"
      },
      "software": {}
    },
    "metadata": {
      "name": "gpumode-kernelbot-b200",
      "title": "KernelBot runner · NVIDIA B200"
    },
    "apiVersion": "kernelindex.dev/v1alpha1"
  }
}

Cite this record (permalink, digest, access date)

Report an issue with this run

Published 2026-08-15 · GPU MODE KernelBot · June 9 Researcher Reciprocity License v1.0All results for NVFP4 group GEMM →JSON