gpt-5-2025-08-07
Competition author · flashinfer-ai/flashinfer-trace · Apache-2.0
Records held
72as of 2026-10-01 23:30 UTC
Entries
47
Runs
1,183
Is this you? Claim this project ›
A claim grants attribution and metadata maintenance, never the right to edit evidence. Evidence claims are reviewed by a maintainer.
Current records
Operation · workload
History
Record
Implementation
Hardware
Since
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 14
4.58ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 14107
40.3ms
B200
2025-10-16
Show all 40 records ›Showing all 40 records ⌄
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 11948
31.2ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 62
7.24ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 59
7.27ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 58
10.7ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 57
9.72ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 56
10.4ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 55
9.50ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 54
8.80ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 53
9.29ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 52
6.40ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 7
3.09ms
72.1% faster · was 11.1 ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 1
1.51ms
85.8% faster · was 10.6 ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 32
8.27ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 80
12.0ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 901
16.2ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 16
4.99ms
B200
2025-10-16
MoE FP8 block scale ds routing topk8 ng8 kg4 e32 h7168 i2048bf16/fp32/fp8_e4m3 · [256] · seq len 15
2.36ms
B200
2025-10-16
GQA paged prefill causal h32 kv8 d128 ps1bf16 · [1, 32, 128]
100.7µs
42.4% faster · was 174.8 µs
B200
2025-10-21
GQA paged prefill causal h32 kv4 d128 ps1bf16 · [2, 32, 128]
90.7µs
47.8% faster · was 173.8 µs
B200
2025-10-21
GQA paged decode h32 kv8 d128 ps1bf16 · [1, 32, 128] · num pages 18 · num kv indices 2
8.19µs
20.7% faster · was 10.3 µs
B200
2025-10-16
GQA paged decode h32 kv4 d128 ps1bf16 · [16, 32, 128] · num pages 5422 · num kv indices 5372
101.9µs
B200
2026-03-28
GQA paged decode h32 kv4 d128 ps1bf16 · [16, 32, 128] · num pages 29084 · num kv indices 19815
216.6µs
B200
2026-03-28
GQA paged decode h32 kv4 d128 ps1bf16 · [16, 32, 128] · num pages 6510 · num kv indices 6460
109.7µs
B200
2026-03-28
GQA paged decode h32 kv4 d128 ps1bf16 · [16, 32, 128] · num pages 30172 · num kv indices 20903
221.3µs
B200
2026-03-28
GQA paged decode h32 kv4 d128 ps1bf16 · [16, 32, 128] · num pages 7598 · num kv indices 7548
117.3µs
B200
2026-03-28
GQA paged decode h32 kv4 d128 ps1bf16 · [16, 32, 128] · num pages 31260 · num kv indices 21991
227.4µs
B200
2026-03-28
GQA paged decode h32 kv4 d128 ps1bf16 · [16, 32, 128] · num pages 8686 · num kv indices 8636
122.7µs
B200
2026-03-28
GQA paged decode h32 kv4 d128 ps1bf16 · [16, 32, 128] · num pages 32348 · num kv indices 23079
230.1µs
B200
2026-03-28
GQA paged decode h32 kv4 d128 ps1bf16 · [64, 32, 128] · num pages 55007 · num kv indices 54991
329.9µs
B200
2026-03-28
GQA paged decode h32 kv4 d128 ps1bf16 · [64, 32, 128] · num pages 57183 · num kv indices 57167
336.6µs
B200
2026-03-28
32 more records · Open in the records ledger →
Measured entries
Implementation
Operation
Runtime
Best latency
Evidence
Availability
Show all 40 entries ›Showing all 40 entries ⌄
Showing 40 of 47; the full list is in the API dossier below.
Record activity
Nov
Dec
Jan
Feb
54Mar
Apr
May
Jun
Jul
Aug
Sep
Oct
Sources: FlashInfer-Bench (2026-03-28) · Apache-2.0last observed 2026-03-28JSON