Skip to content
KernelIndex
Search⌘K

GEMM n28672 k4096

392 eligible runs
gemm

General matrix multiply (GEMM) C = A @ B.T. Captured from Llama 3.1 8B mlp.gate_up_proj.

Fastest reported
60.6µsmean · 60% of SOL
Amir M. Mir | SF TensorLicense unknown · unknown

Reported evidence · last observed 2026-08-07. Reported by source; not independently reproduced. No public source. License unknown.

No public sourceRun detail →

Current records

Not measured on H100 for this workload. Challenges →

Source-native comparison · GPU NVIDIA B200 · Workload suite of 43 cases · mean latency · Protocol SOL-ExecBench evaluation stack v1.1 · mean · 33 results · last observed 2026-08-21Record history →
#
Implementation
Latency
vs #1
Trust
Observed
1
60.6µs60% SOL
1.00×
Reported · license unknown · no source
2026-08-07

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
2
60.7µs60% SOL
1.00×
Reported · license unknown · no source
2026-08-19

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
3
62.7µs57% SOL
1.04×
Reported · license unknown · no source
2026-08-04

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
4
62.9µs57% SOL
1.04×
Reported · license unknown · no source
2026-07-28

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
5
63.0µs57% SOL
1.04×
Reported · license unknown · no source
2026-08-03

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
6
63.0µs57% SOL
1.04×
Reported · license unknown · no source
2026-08-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
7
63.1µs57% SOL
1.04×
Reported · license unknown · no source
2026-08-05

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
8
63.2µs57% SOL
1.04×
Reported · license unknown · no source
2026-08-05

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
9
63.2µs57% SOL
1.04×
Reported · license unknown · no source
2026-07-24

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
10
63.3µs57% SOL
1.04×
Reported · license unknown · no source
2026-07-25

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
11
63.4µs57% SOL
1.05×
Reported · license unknown · no source
2026-07-24

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
12
63.6µs57% SOL
1.05×
Reported · license unknown · no source
2026-08-03

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
13
63.6µs57% SOL
1.05×
Reported · license unknown · no source
2026-08-05

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
14
63.6µs57% SOL
1.05×
Reported · license unknown · no source
2026-07-31

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
15
63.7µs57% SOL
1.05×
Reported · license unknown · no source
2026-07-27

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
16
63.7µs57% SOL
1.05×
Reported · license unknown · no source
2026-08-05

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
17
63.9µs56% SOL
1.05×
Reported · license unknown · no source
2026-07-17

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
18
64.1µs56% SOL
1.06×
Reported · license unknown · no source
2026-08-02

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
19
64.1µs56% SOL
1.06×
Reported · license unknown · no source
2026-08-21

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
20
64.6µs56% SOL
1.07×
Reported · license unknown · no source
2026-08-02

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
21
64.6µs56% SOL
1.07×
Reported · license unknown · no source
2026-07-27

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
22
64.6µs56% SOL
1.07×
Reported · license unknown · no source
2026-07-29

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
23
64.8µs56% SOL
1.07×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
24
65.6µs54% SOL
1.08×
Reported · license unknown · no source
2026-07-15

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
25
65.8µs54% SOL
1.09×
Reported · license unknown · no source
2026-07-16

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
26
65.9µs54% SOL
1.09×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
27
66.1µs54% SOL
1.09×
Reported · license unknown · no source
2026-07-23

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
28
66.7µs53% SOL
1.10×
Reported · license unknown · no source
2026-07-18

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
29
67.7µs52% SOL
1.12×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
30
69.1µs51% SOL
1.14×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
31
70.5µs50% SOL
1.16×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
32
71.1µs50% SOL
1.17×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
33
71.4µs49% SOL
1.18×
Reported · license unknown · no source
2026-07-29

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →

Implementations

Implementation
Runtime
Best latency
Evidence
Availability
unknown
64.6µs
1.16×
Reported
license unknown · no source
unknown
64.6µs
1.17×
Reported
license unknown · no source
unknown
60.6µs
1.09×
Reported
license unknown · no source
unknown
62.9µs
1.13×
Reported
license unknown · no source
unknown
62.7µs
1.13×
Reported
license unknown · no source
unknown
60.7µs
1.10×
Reported
license unknown · no source
unknown
63.6µs
1.15×
Reported
license unknown · no source
unknown
63.2µs
1.14×
Reported
license unknown · no source
Show all 57 implementations ›
unknown
64.7µs
1.17×
Reported
license unknown · no source
unknown
65.1µs
1.17×
Reported
license unknown · no source
unknown
65.6µs
1.18×
Reported
license unknown · no source
unknown
66.8µs
1.20×
Reported
license unknown · no source
unknown
66.7µs
1.20×
Reported
license unknown · no source
unknown
68.0µs
1.23×
Reported
license unknown · no source
unknown
70.0µs
1.26×
Reported
license unknown · no source
unknown
70.5µs
1.27×
Reported
license unknown · no source
unknown
71.4µs
1.29×
Reported
license unknown · no source
unknown
74.8µs
1.35×
Reported
license unknown · no source
unknown
63.0µs
1.14×
Reported
license unknown · no source
unknown
63.2µs
1.14×
Reported
license unknown · no source
unknown
63.4µs
1.14×
Reported
license unknown · no source
unknown
63.0µs
1.14×
Reported
license unknown · no source
unknown
63.1µs
1.14×
Reported
license unknown · no source
unknown
63.2µs
1.14×
Reported
license unknown · no source
unknown
63.3µs
1.14×
Reported
license unknown · no source
unknown
63.6µs
1.15×
Reported
license unknown · no source
unknown
63.6µs
1.15×
Reported
license unknown · no source
unknown
63.7µs
1.15×
Reported
license unknown · no source
unknown
63.7µs
1.15×
Reported
license unknown · no source
unknown
63.9µs
1.15×
Reported
license unknown · no source
unknown
64.1µs
1.16×
Reported
license unknown · no source
unknown
64.1µs
1.16×
Reported
license unknown · no source
unknown
64.8µs
1.17×
Reported
license unknown · no source
unknown
64.6µs
1.17×
Reported
license unknown · no source
unknown
64.4µs
1.16×
Reported
license unknown · no source
unknown
66.1µs
1.19×
Reported
license unknown · no source
unknown
65.8µs
1.19×
Reported
license unknown · no source
unknown
65.9µs
1.19×
Reported
license unknown · no source
unknown
68.0µs
1.23×
Reported
license unknown · no source
unknown
68.1µs
1.23×
Reported
license unknown · no source
unknown
67.7µs
1.22×
Reported
license unknown · no source
unknown
69.1µs
1.25×
Reported
license unknown · no source
unknown
71.1µs
1.28×
Reported
license unknown · no source
unknown
72.1µs
1.30×
Reported
license unknown · no source
unknown
72.0µs
1.30×
Reported
license unknown · no source
unknown
74.3µs
1.34×
Reported
license unknown · no source
unknown
76.0µs
1.37×
Reported
license unknown · no source
unknown
80.8µs
1.46×
Reported
license unknown · no source
claude-opus-4-1 / cuda53eadfclaude-opus-4-1-20250805
cuda
—
—
Apache-2.0 · source
claude-opus-4-1 / triton79b898claude-opus-4-1-20250805
triton
66.7µs
1.20×
Reported
Apache-2.0 · source
cuda
409.5µs
7.39×
Reproduction-ready
Apache-2.0 · source
triton
68.1µs
1.23×
Reported
Apache-2.0 · source
gpt-5 / cuda8ba217gpt-5-2025-08-07
cuda
67.8µs
1.22×
Reproduction-ready
Apache-2.0 · source
gpt-5 / triton998d17gpt-5-2025-08-07
triton
235.9µs
4.26×
Reported
Apache-2.0 · source
cuda
59.6µs
1.08×
Reproduction-ready
Apache-2.0 · source
triton
85.3µs
1.54×
Reported
Apache-2.0 · source
torch_matmul_655587FlashInfer-Bench baselines
python
55.4µs
1.00×
Reported
Apache-2.0 · source

Semantics

Inputs and outputs
afp16 [m, k]
bfp16 [n, k]
cfp16 [m, n]
Axes and behavior
kconstant = 4096
mvariable
nconstant = 28672
determinismunspecified
constraintsNo mutation or aliasing
Identity
alias011_gemm_n28672_k4096sha25689b0186b9b21…

Also indexed as gemm-n28672-k4096 · reviewed as the same computation; every definition's cohorts are shown here, ranked separately.

Sources: FlashInfer-Bench (2025-10-16) · Apache-2.0 · NVIDIA SOL-ExecBench (2026-08-21)last observed 2026-08-21How records are decidedJSON