Skip to content
KernelIndex
Search⌘K

torch / matmul0d13df

torch_matmul_0d13df · FlashInfer-Bench baselines · python · Apache-2.0

Use it

Vendorable · source mirrored · Apache-2.0View source →

No package. Vendor the mirrored source: 6 lines, Apache-2.0, pinned at da91508.

main.py
curl "https://kernelindex.com/api/v1/implementations/flashinfer-torch-matmul-0d13df?include=source"
interfacepython
revisionda915083d4c7
symbolrun
pathmain.py
Compatibility
measured onNVIDIA B200
declared hardwareCPU, NVIDIA A100, NVIDIA H100
architecturessm_90, unknown
dtypesfp16

Benchmark evidence

43 measurements across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
GEMM n4096 k4096fp16 · [15, 4096]
NVIDIA B200
15.6µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [32, 4096]
NVIDIA B200
15.7µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [24, 4096]
NVIDIA B200
15.8µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [40, 4096]
NVIDIA B200
15.8µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [56, 4096]
NVIDIA B200
15.8µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [48, 4096]
NVIDIA B200
15.8µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [64, 4096]
NVIDIA B200
15.9µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [72, 4096]
NVIDIA B200
15.9µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [120, 4096]
NVIDIA B200
16.1µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [35, 4096]
NVIDIA B200
16.1µs
#2 of 8
2025-10-16
Show all 43 measurements ›
GEMM n4096 k4096fp16 · [128, 4096]
NVIDIA B200
16.1µs
#1 of 9
2025-10-16
GEMM n4096 k4096fp16 · [88, 4096]
NVIDIA B200
16.1µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [16, 4096]
NVIDIA B200
16.2µs
#2 of 8
2025-10-16
GEMM n4096 k4096fp16 · [80, 4096]
NVIDIA B200
16.2µs
#2 of 8
2025-10-16
GEMM n4096 k4096fp16 · [160, 4096]
NVIDIA B200
16.3µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [152, 4096]
NVIDIA B200
16.3µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [144, 4096]
NVIDIA B200
16.3µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [104, 4096]
NVIDIA B200
16.3µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [136, 4096]
NVIDIA B200
16.3µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [112, 4096]
NVIDIA B200
16.4µs
#2 of 8
2025-10-16
GEMM n4096 k4096fp16 · [96, 4096]
NVIDIA B200
16.4µs
#2 of 8
2025-10-16
GEMM n4096 k4096fp16 · [184, 4096]
NVIDIA B200
16.6µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [176, 4096]
NVIDIA B200
16.6µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [192, 4096]
NVIDIA B200
16.6µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [168, 4096]
NVIDIA B200
16.6µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [70, 4096]
NVIDIA B200
16.6µs
#2 of 7
2025-10-16
GEMM n4096 k4096fp16 · [216, 4096]
NVIDIA B200
17.0µs
#2 of 7
2025-10-16
GEMM n4096 k4096fp16 · [224, 4096]
NVIDIA B200
17.0µs
#2 of 8
2025-10-16
GEMM n4096 k4096fp16 · [208, 4096]
NVIDIA B200
17.1µs
#3 of 9
2025-10-16
GEMM n4096 k4096fp16 · [2, 4096]
NVIDIA B200
17.2µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [8, 4096]
NVIDIA B200
17.4µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [4, 4096]
NVIDIA B200
17.6µs
#2 of 8
2025-10-16
GEMM n4096 k4096fp16 · [7, 4096]
NVIDIA B200
17.9µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [232, 4096]
NVIDIA B200
18.0µs
#2 of 8
2025-10-16
GEMM n4096 k4096fp16 · [240, 4096]
NVIDIA B200
18.0µs
#2 of 8
2025-10-16
GEMM n4096 k4096fp16 · [248, 4096]
NVIDIA B200
18.1µs
#2 of 7
2025-10-16
GEMM n4096 k4096fp16 · [256, 4096]
NVIDIA B200
18.1µs
#2 of 9
2025-10-16
GEMM n4096 k4096fp16 · [1, 4096]
NVIDIA B200
18.3µs
#1 of 8
2025-10-16
GEMM n4096 k4096fp16 · [200, 4096]
NVIDIA B200
19.5µs
#2 of 7
2025-10-16
GEMM n4096 k4096fp16 · [972, 4096]
NVIDIA B200
31.9µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [2053, 4096]
NVIDIA B200
49.1µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [2379, 4096]
NVIDIA B200
62.6µs
#1 of 7
2025-10-16
GEMM n4096 k4096fp16 · [8192, 4096]
NVIDIA B200
196.1µs
#2 of 8
2025-10-16

Reported · How evidence levels are derived →

Source and license

sourcehttps://huggingface.co/datasets/flashinfer-ai/flashinfer-trace
commitda915083d4c7c5e61aa3005e3d17ae488e0fc71c
revision digestsha256:0c425ca0b03a64c147175e84075d3bdf26b50778cb62b0e8e0fe49296b8598bc
license declaredApache-2.0
license concludedApache-2.0
authorsbaseline
imported2026-08-16

Kernel source

main.py6 lines
import torch
import torch.nn.functional as F

def run(A: torch.Tensor, B: torch.Tensor):
    return F.linear(A, B)

Source code from FlashInfer-Bench (flashinfer-ai/flashinfer-trace) · Apache-2.0

Best evidence level for this revision: reported

JSON