FlashInfer-Bench baselines
Library · flashinfer-ai/flashinfer-trace · Apache-2.0
Records held
1,288as of 2026-10-01 23:33 UTC
Kernels
90
Runs
1,851
Is this you? Claim this project ›
A claim grants attribution and metadata maintenance, never the right to edit evidence. Evidence claims are reviewed by a maintainer.
Current records
Operation · workload
History
Record
Implementation
Hardware
Since
Show all 40 records ›Showing all 40 records ⌄
MLA ragged prefill causal h16 qk192 vo128bf16 · [130, 16, 192]
10.2µs
0.9% faster · was 10.3 µs
B200
2026-04-06
MLA ragged prefill causal h16 qk192 vo128bf16 · [12947, 16, 192]
51.5µs
0.6% faster · was 51.8 µs
B200
2026-04-06
MLA ragged prefill causal h16 qk192 vo128bf16 · [19013, 16, 192]
73.8µs
1.5% faster · was 74.9 µs
B200
2026-04-06
MLA ragged prefill causal h16 qk192 vo128bf16 · [3157, 16, 192]
34.8µs
1.8% faster · was 35.5 µs
B200
2026-04-06
MLA ragged prefill causal h16 qk192 vo128bf16 · [18074, 16, 192]
53.3µs
0.0% faster · was 53.3 µs
B200
2026-04-06
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [10870, 16, 64]
3.75ms
95.2% faster · was 78.5 ms
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [8, 16, 64]
16.5µs
69.3% faster · was 53.7 µs
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [138, 16, 64]
28.5µs
81.8% faster · was 156.6 µs
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [15092, 16, 64]
1.83ms
94.9% faster · was 35.9 ms
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [15883, 16, 64]
2.54ms
94.9% faster · was 50.3 ms
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [3842, 16, 64]
237.5µs
94.3% faster · was 4.13 ms
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [4, 16, 64]
18.4µs
79.1% faster · was 87.9 µs
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [123, 16, 64]
20.8µs
87.6% faster · was 168.0 µs
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [58, 16, 64]
26.8µs
73.5% faster · was 101.1 µs
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [805, 16, 64]
81.3µs
92.9% faster · was 1.15 ms
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [6, 16, 64]
18.4µs
79.8% faster · was 91.0 µs
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [43, 16, 64]
26.6µs
68.5% faster · was 84.6 µs
B200
2025-10-21
MLA paged prefill causal h16 ckv512 kpe64 ps1bf16 · [16384, 16, 64]
16.5ms
95.2% faster · was 347.0 ms
B200
2025-10-21
1248 more records · Open in the records ledger →
Measured kernels
Implementation
Operation
Runtime
Best latency
Evidence
Availability
Show all 40 kernels ›Showing all 40 kernels ⌄
flashinfer / wrapper78fd04FlashInfer-Bench baselines
python
8.19µs
Reproduction-ready
Apache-2.0 · source
flashinfer / wrapperd90b98FlashInfer-Bench baselines
python
10.2µs
Reproduction-ready
Apache-2.0 · source
flashinfer / wrapper463e16FlashInfer-Bench baselines
python
10.2µs
Reproduction-ready
Apache-2.0 · source
flashinfer / wrapper33cb6fFlashInfer-Bench baselines
python
10.2µs
Reproduction-ready
Apache-2.0 · source
deepgemm_fp8_fp4_gemm_nt_n2048_k2048FlashInfer-Bench baselines
python
13.5µs
Reported
Apache-2.0 · source
flashinfer / wrapper5222a7FlashInfer-Bench baselines
python
16.7µs
Reproduction-ready
Apache-2.0 · source
flashinfer / wrappera3c91fFlashInfer-Bench baselines
python
16.7µs
Reproduction-ready
Apache-2.0 · source
flashinfer / wrapper69a524FlashInfer-Bench baselines
python
16.8µs
Reproduction-ready
Apache-2.0 · source
deepgemm_fp8_fp4_gemm_nt_n4096_k4096FlashInfer-Bench baselines
python
17.7µs
Reported
Apache-2.0 · source
Showing 40 of 90; the full list is in the API dossier below.
Record activity
Nov
Dec
Jan
Feb
465Mar
458Apr
May
64Jun
Jul
Aug
Sep
Oct
Sources: FlashInfer-Bench (2026-06-06) · Apache-2.0last observed 2026-06-06JSON