torch.compile (inductor)
BMM InstanceNorm Sum ResidualAdd Multiply · batch_size = 1024 · in_features = 8192 · out_features = 8192 · fp32 · run 01a03f0e-f84c…
●passedReported evidence
Not re-observed recently.
Primary measurement
4.86ms±0.01 · mean of 100
Rank 1 in its comparison group · source-native comparison · observed 2026-03-05
max ms 4.95 · min ms 4.75 · std ms 0.0529 · mean ms 4.86
Identity
implementationtorch.compile (inductor)
projectPyTorch
revisionunknown
workloadbatch_size = 1024 · in_features = 8192 · out_features = 8192 · fp32
comparison keysha256:1e240f57b301d6f1…
sourceKernelBench baseline timings
external idH100_PCIe_LambdaLabs/torch-compile-inductor/level2/28_BMM_InstanceNorm_Sum_ResidualAdd_Multiply.py
sha256:e2f56243a704046e5433a4c…
Correctness
Marked passed by the source; the correctness policy was not published.
Workload
batch_size1024
in_features8192
out_features8192
input_1fp32 [1024, 8192]
input_2fp32 [1024, 8192]
definition comparatornot_asserted
Measurements
latency · max4.95 ms · n=100
latency · mean4.86 ms · n=100
latency · min4.75 ms · n=100
latency · std52.9 µs
Protocol
harnessKernelBench timing scripts
timercuda_events
primaryStatisticmean
comparabilityFamilykernelbench_baseline_timing
Environment
gpuNVIDIA H100 (sm_90)
Artifacts
No artifacts published with this run.
Replications and notes
No attestations yet.
Community attestations. They never change the evidence level; only a KernelIndex-controlled rerun does.
Add a reproduction or note
Canonical manifest
Show manifestHide manifest
{
"run": {
"kind": "BenchmarkRun",
"spec": {
"status": "passed",
"timing": {
"samples": 100,
"latencyNs": {
"mean": 4860000,
"maximum": 4950000,
"minimum": 4750000,
"confidence95": [
4849632,
4870368
]
},
"primaryStatistic": "mean"
},
"observedAt": "2026-03-05T08:38:15.000Z",
"measurements": [
{
"unit": "ns",
"value": 52900,
"metric": "latency",
"statistic": "std"
}
],
"sourceNative": {
"source": "kernelbench",
"metrics": {
"max_ms": 4.95,
"min_ms": 4.75,
"std_ms": 0.0529,
"mean_ms": 4.86
},
"benchmark": "H100_PCIe_LambdaLabs/baseline_time_torch_compile_inductor_default.json",
"externalId": "H100_PCIe_LambdaLabs/torch-compile-inductor/level2/28_BMM_InstanceNorm_Sum_ResidualAdd_Multiply.py"
},
"protocolDigest": "sha256:547725b033a9911eae0c5ac362344a85aed824894ed4ab476af945b9bb491ea6",
"workloadDigest": "sha256:90e7997b3bc3ee0225cfd448a3acfda3a279d269cea8e91ee4c549a8ccac5bf6",
"environmentDigest": "sha256:89f9b28b06758f22a1df331fea58bfde2c9cc0f3627d1829509743ea538f0011",
"implementationDigest": "sha256:f3e178f4884d84b59a3cb4f8b54b6f9e04196feeb68cf5aeff62166f6c25147c"
},
"metadata": {
"name": "kernelbench-h100-pcie-lambdalabs-torch-compile-inductor-l2-28-bmm-instancenorm-sum-residualadd-multi",
"title": "BMM InstanceNorm Sum ResidualAdd Multiply · torch.compile (inductor) · Lambda Labs"
},
"apiVersion": "kernelindex.dev/v1alpha1"
},
"protocol": {
"kind": "BenchmarkProtocol",
"spec": {
"harness": {
"name": "KernelBench timing scripts",
"repository": "https://github.com/ScalingIntelligence/KernelBench"
},
"measurement": {
"timer": "cuda_events",
"primaryStatistic": "mean"
},
"comparability": {
"notes": "Mean of 100 timed forward passes (CUDA events, warm-up excluded) of the reference module on fixed inputs; the 95% interval is the mean's, from the reported standard deviation. The upstream JSON records no torch or CUDA version. Comparable only within one problem and one timing host.",
"family": "kernelbench_baseline_timing"
}
},
"metadata": {
"name": "kernelbench-timing-v1",
"title": "KernelBench baseline timing"
},
"apiVersion": "kernelindex.dev/v1alpha1"
},
"environment": {
"kind": "ExecutionEnvironment",
"spec": {
"hardware": {
"vendor": "nvidia",
"product": "NVIDIA H100",
"formFactor": "PCIe",
"architecture": "sm_90"
},
"software": {}
},
"metadata": {
"name": "kernelbench-h100-pcie-lambdalabs",
"title": "KernelBench host · H100 PCIe (Lambda Labs)"
},
"apiVersion": "kernelindex.dev/v1alpha1"
}
}Cite this record (permalink, digest, access date)
Report an issue with this run
Published 2026-08-26 · KernelBench baseline timings · MITAll results for BMM InstanceNorm Sum ResidualAdd Multiply →JSON