Run 01a03f55 · KernelIndex

Primary measurement

523.4µsgeomean

Rank 598 in its comparison group · source-native comparison · observed 2025-11-15

Compare with #1 →

leaderboard score s 0.0005234353241001734

Identity

implementationsubmission 78913

projectEmilio

revisionsubmission-78913

workloadsuite of 3 cases · geomean score

comparison keysha256:eecd15b54b30f820…

sourceGPU MODE KernelBot

external idsubmission/78913/leaderboard

sha256:989250b1cab9236bb8be3ca…

Correctness

Marked passed by the source; the correctness policy was not published.

Workload

definition comparatorkernelbot_eval

Measurements

score · geomean523.4 µs

Protocol

harnessreference-kernels eval.py

timerwall_clock

primaryStatisticgeomean

correctnessReferenceproblem reference implementation

comparabilityFamilygpumode_kernelbot

Environment

gpuNVIDIA B200 (sm_100)

Artifacts

No artifacts published with this run.

Replications and notes

No attestations yet.

Community attestations. They never change the evidence level; only a KernelIndex-controlled rerun does.

Add a reproduction or note

Canonical manifest

Show manifest

{
  "run": {
    "kind": "BenchmarkRun",
    "spec": {
      "status": "passed",
      "observedAt": "2025-11-15T21:30:58.089Z",
      "measurements": [
        {
          "unit": "s",
          "value": 0.0005234353241001734,
          "metric": "score",
          "statistic": "geomean"
        }
      ],
      "sourceNative": {
        "source": "gpumode-kernelbot",
        "metrics": {
          "leaderboard_score_s": 0.0005234353241001734
        },
        "benchmark": "nvfp4_gemv",
        "externalId": "submission/78913"
      },
      "protocolDigest": "sha256:07f73e59fb4c7fac9bf84af1e107001e008035039bb08edcf6948cea84a7027f",
      "workloadDigest": "sha256:ed52443d502f5c6620ad12ffc775563301aa8f8e4041cc8e7e6a9b6e927d2985",
      "environmentDigest": "sha256:a54821669b0ddb1a088350f1271758c045576775ddd51d53fa6b199fa69f25d8",
      "implementationDigest": "sha256:8bbf72133098fc15d72a644831c960a0e00509508a264efd015bddd346ca0dc8"
    },
    "metadata": {
      "name": "kernelbot-78913-leaderboard",
      "title": "nvfp4_gemv · submission 78913 · leaderboard score"
    },
    "apiVersion": "kernelindex.dev/v1alpha1"
  },
  "protocol": {
    "kind": "BenchmarkProtocol",
    "spec": {
      "harness": {
        "name": "reference-kernels eval.py",
        "repository": "https://github.com/gpu-mode/reference-kernels"
      },
      "correctness": {
        "reference": "problem reference implementation",
        "comparator": "kernelbot_eval"
      },
      "measurement": {
        "timer": "wall_clock",
        "primaryStatistic": "geomean"
      },
      "comparability": {
        "notes": "Aggregate leaderboard score in seconds over the problem's published benchmark suite, as computed by the upstream ranked run. Comparable only within one leaderboard problem and runner type.",
        "family": "gpumode_kernelbot"
      }
    },
    "metadata": {
      "name": "gpumode-kernelbot-leaderboard-geomean",
      "title": "GPU MODE KernelBot ranked leaderboard run"
    },
    "apiVersion": "kernelindex.dev/v1alpha1"
  },
  "environment": {
    "kind": "ExecutionEnvironment",
    "spec": {
      "hardware": {
        "vendor": "nvidia",
        "product": "NVIDIA B200",
        "formFactor": "runner:NVIDIA",
        "architecture": "sm_100"
      },
      "software": {}
    },
    "metadata": {
      "name": "gpumode-kernelbot-nvidia",
      "title": "KernelBot runner · NVIDIA B200"
    },
    "apiVersion": "kernelindex.dev/v1alpha1"
  }
}

Cite this record (permalink, digest, access date)

Report an issue with this run

Published 2026-08-26 · GPU MODE KernelBot · June 9 Researcher Reciprocity License v1.0All results for NVFP4 GEMV →JSON