Matmul with irregular shapes
4 eligible runs
gemm
KernelBench level1 problem 8: Matmul with irregular shapes. The computation is the reference PyTorch module's forward pass; the output shape follows the module (mirrored as each implementation's source).
Source baseline · unbeaten
6.38ms±0.00 · mean of 100
PyTorch eagerPyTorch · MIT · python
Reported evidence · last observed 2026-03-05. The source's designated baseline implementation. Reported by source; not independently reproduced.
Current records
HardwareBest knownImplementationRuns
NVIDIA H100 · env 16.38 msPyTorch eager2NVIDIA H100 · env 27.69 msPyTorch eager2Not measured on B200 for this workload. Challenges →
Source-native comparison · GPU NVIDIA H100 · Workload k = 2949 · m = 8205 · n = 5921 · fp32 · Protocol KernelBench timing scripts · mean · 2 results · last observed 2026-03-05Record history →
Estimated floor 578.9 µs · record 11.02× above itestimate, not evidence ›
DRAM 49.7 µs · compute 578.9 µs · compute-bound on H100 SXM
every declared tensor crosses HBM exactly once (3,350 GB/s, H100 SXM datasheet)
2·M·N·K with M=8205, N=5921, K=2949 at the dense tf32 peak (495 TFLOP/s)
headroom-v1: a lower bound from declared tensors and datasheet peaks. A kernel can sit well above it for good reasons.
#
Implementation
Latency
vs #1
Trust
Observed
16.38ms±0.001.00×Reported · MIT · source2026-03-05stale
Measured exactly what you asked. The source's designated baseline implementation. Reported by source; not independently reproduced.
source mirroredMITno install recipeView source →Run detail →
2torch.compile (inductor)PyTorch6.43ms±0.011.01×Reported · MIT · source2026-03-05stale
1.01× slower than the baseline. Measured exactly what you asked. Reported by source; not independently reproduced.
source mirroredMITno install recipeView source →Run detail →
Implementations
Implementation
Runtime
Best latency
Evidence
Availability
Semantics
Inputs and outputs
afp32 [m, k]
bfp32 [k, n]
outfloat [out]
Axes and behavior
kvariable
mvariable
nvariable
outvariable
determinismunspecified
constraintsNo mutation or aliasing
Identity
sha256da649d6d463f…
Sources: KernelBench baseline timings (2026-03-05) · MITlast observed 2026-03-05How records are decidedJSON