Skip to content
KernelIndex
Search⌘K

flashinfer / wrapper4c2606

flashinfer_wrapper_4c2606 · FlashInfer-Bench baselines · python · Apache-2.0

Use it

Vendorable · source mirrored · Apache-2.0View source →

No package. Vendor the mirrored source: 7 lines, Apache-2.0, pinned at da91508.

main.py
curl "https://kernelindex.com/api/v1/implementations/flashinfer-flashinfer-wrapper-4c2606?include=source"
interfacepython
revisionda915083d4c7
symbolrun
pathmain.py
Compatibility
measured onNVIDIA B200
declared hardwareNVIDIA A100, NVIDIA B200, NVIDIA H100, NVIDIA H20, NVIDIA H200
architecturesunknown
dtypesfp16

Benchmark evidence

86 measurements across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
GEMM n7168 k5120fp16 · [7, 5120]
NVIDIA B200
18.1µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [8, 5120]
NVIDIA B200
18.4µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [7, 5120]
NVIDIA B200
18.4µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [4, 5120]
NVIDIA B200
18.4µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [24, 5120]
NVIDIA B200
18.5µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [24, 5120]
NVIDIA B200
18.5µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [4, 5120]
NVIDIA B200
18.7µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [8, 5120]
NVIDIA B200
19.1µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [1, 5120]
NVIDIA B200
19.1µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [15, 5120]
NVIDIA B200
19.2µs
#1 of 2
2026-03-24
Show all 86 measurements ›
GEMM n7168 k5120fp16 · [2, 5120]
NVIDIA B200
19.2µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [1, 5120]
NVIDIA B200
19.3µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [16, 5120]
NVIDIA B200
19.4µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [16, 5120]
NVIDIA B200
19.4µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [2, 5120]
NVIDIA B200
19.5µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [15, 5120]
NVIDIA B200
19.5µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [112, 5120]
NVIDIA B200
19.6µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [128, 5120]
NVIDIA B200
19.6µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [120, 5120]
NVIDIA B200
19.6µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [128, 5120]
NVIDIA B200
19.6µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [104, 5120]
NVIDIA B200
19.7µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [120, 5120]
NVIDIA B200
19.9µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [112, 5120]
NVIDIA B200
20.0µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [32, 5120]
NVIDIA B200
20.0µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [32, 5120]
NVIDIA B200
20.0µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [104, 5120]
NVIDIA B200
20.1µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [35, 5120]
NVIDIA B200
20.2µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [40, 5120]
NVIDIA B200
20.2µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [56, 5120]
NVIDIA B200
20.2µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [96, 5120]
NVIDIA B200
20.3µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [64, 5120]
NVIDIA B200
20.3µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [35, 5120]
NVIDIA B200
20.3µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [96, 5120]
NVIDIA B200
20.3µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [48, 5120]
NVIDIA B200
20.4µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [40, 5120]
NVIDIA B200
20.4µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [88, 5120]
NVIDIA B200
20.4µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [56, 5120]
NVIDIA B200
20.5µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [64, 5120]
NVIDIA B200
20.5µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [48, 5120]
NVIDIA B200
20.5µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [88, 5120]
NVIDIA B200
20.7µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [80, 5120]
NVIDIA B200
20.8µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [72, 5120]
NVIDIA B200
21.0µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [72, 5120]
NVIDIA B200
21.0µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [70, 5120]
NVIDIA B200
21.1µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [80, 5120]
NVIDIA B200
21.1µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [70, 5120]
NVIDIA B200
21.2µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [160, 5120]
NVIDIA B200
21.4µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [152, 5120]
NVIDIA B200
21.5µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [160, 5120]
NVIDIA B200
21.6µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [152, 5120]
NVIDIA B200
21.7µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [192, 5120]
NVIDIA B200
22.6µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [184, 5120]
NVIDIA B200
22.7µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [184, 5120]
NVIDIA B200
22.8µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [192, 5120]
NVIDIA B200
22.8µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [224, 5120]
NVIDIA B200
23.1µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [248, 5120]
NVIDIA B200
23.2µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [256, 5120]
NVIDIA B200
23.3µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [240, 5120]
NVIDIA B200
23.3µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [216, 5120]
NVIDIA B200
23.4µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [232, 5120]
NVIDIA B200
23.4µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [232, 5120]
NVIDIA B200
23.4µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [216, 5120]
NVIDIA B200
23.4µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [224, 5120]
NVIDIA B200
23.5µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [136, 5120]
NVIDIA B200
23.6µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [240, 5120]
NVIDIA B200
23.6µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [256, 5120]
NVIDIA B200
23.7µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [144, 5120]
NVIDIA B200
23.7µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [144, 5120]
NVIDIA B200
24.0µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [248, 5120]
NVIDIA B200
24.0µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [136, 5120]
NVIDIA B200
24.1µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [176, 5120]
NVIDIA B200
25.8µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [176, 5120]
NVIDIA B200
25.8µs
#2 of 2
2026-03-23
GEMM n7168 k5120fp16 · [168, 5120]
NVIDIA B200
25.9µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [200, 5120]
NVIDIA B200
26.1µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [208, 5120]
NVIDIA B200
26.2µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [208, 5120]
NVIDIA B200
26.2µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [168, 5120]
NVIDIA B200
26.2µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [200, 5120]
NVIDIA B200
26.6µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [972, 5120]
NVIDIA B200
50.4µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [972, 5120]
NVIDIA B200
53.0µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [2053, 5120]
NVIDIA B200
97.2µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [2053, 5120]
NVIDIA B200
103.8µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [2379, 5120]
NVIDIA B200
110.4µs
#1 of 2
2026-03-23
GEMM n7168 k5120fp16 · [2379, 5120]
NVIDIA B200
119.4µs
#2 of 2
2026-03-24
GEMM n7168 k5120fp16 · [8192, 5120]
NVIDIA B200
405.8µs
#1 of 2
2026-03-24
GEMM n7168 k5120fp16 · [8192, 5120]
NVIDIA B200
406.0µs
#2 of 2
2026-03-23

Reported · How evidence levels are derived →

Source and license

sourcehttps://huggingface.co/datasets/flashinfer-ai/flashinfer-trace
commitda915083d4c7c5e61aa3005e3d17ae488e0fc71c
revision digestsha256:cc3812f098c0dcb52b753724f414f95bea3d8cdb0dcebeda83e4740a63d2ef3a
license declaredApache-2.0
license concludedApache-2.0
authorsbaseline
imported2026-08-16

Kernel source

main.py7 lines
import torch
import torch.nn.functional as F


def run(A: torch.Tensor, B: torch.Tensor):
    return F.linear(A, B)

Source code from FlashInfer-Bench (flashinfer-ai/flashinfer-trace) · Apache-2.0

Best evidence level for this revision: reported

JSON