NVFP4 GEMV
Batched NVFP4 block-scaled matrix-vector multiply for B200: A (m×k×l) and vector b (1×k×l) in nvfp4 e2m1 with fp8 scale factors per 16 elements of k, output c (m×1×l) in fp16. All operands are K-major; m is divisible by the kernel's mma tile and k by 64.
Reported evidence · last observed 2025-11-30. Reported by source; not independently reproduced. License unknown.
Current records
Not measured on H100 for this workload. Challenges →
1submission 116482gau.nernst18.5µs1.00×Reported · license unknown · source2025-11-30stale
Measured exactly what you asked. Reported by source; not independently reproduced.
2submission 114427s.am._18.5µs1.00×Reported · license unknown · source2025-11-29stale
Measured exactly what you asked. Reported by source; not independently reproduced.
3submission 112198s.am._18.5µs1.00×Reported · license unknown · source2025-11-29stale
Measured exactly what you asked. Reported by source; not independently reproduced.
4submission 115115shellsmile1579518.7µs1.01×Reported · license unknown · source2025-11-30stale
Measured exactly what you asked. Reported by source; not independently reproduced.
5submission 100978s.am._18.7µs1.01×Reported · license unknown · source2025-11-24stale
Measured exactly what you asked. Reported by source; not independently reproduced.
6submission 95654s.am._18.7µs1.01×Reported · license unknown · source2025-11-22stale
Measured exactly what you asked. Reported by source; not independently reproduced.
7submission 113650shellsmile1579518.8µs1.01×Reported · license unknown · source2025-11-29stale
Measured exactly what you asked. Reported by source; not independently reproduced.
8submission 95600s.am._18.8µs1.01×Reported · license unknown · source2025-11-22stale
Measured exactly what you asked. Reported by source; not independently reproduced.
9submission 95586s.am._19.1µs1.03×Reported · license unknown · source2025-11-22stale
Measured exactly what you asked. Reported by source; not independently reproduced.
10submission 104933gau.nernst19.3µs1.04×Reported · license unknown · no source2025-11-26stale
Measured exactly what you asked. Reported by source; not independently reproduced.
11submission 104905gau.nernst19.3µs1.04×Reported · license unknown · source2025-11-26stale
Measured exactly what you asked. Reported by source; not independently reproduced.
12submission 102725gau.nernst19.4µs1.05×Reported · license unknown · source2025-11-25stale
Measured exactly what you asked. Reported by source; not independently reproduced.
13submission 102203gau.nernst19.4µs1.05×Reported · license unknown · source2025-11-25stale
Measured exactly what you asked. Reported by source; not independently reproduced.
14submission 100430gau.nernst19.5µs1.05×Reported · license unknown · source2025-11-24stale
Measured exactly what you asked. Reported by source; not independently reproduced.
15submission 111461_spatters19.6µs1.06×Reported · license unknown · source2025-11-29stale
Measured exactly what you asked. Reported by source; not independently reproduced.
16submission 98340gau.nernst19.7µs1.06×Reported · license unknown · source2025-11-23stale
Measured exactly what you asked. Reported by source; not independently reproduced.
17submission 114034netvope19.7µs1.06×Reported · license unknown · source2025-11-29stale
Measured exactly what you asked. Reported by source; not independently reproduced.
18submission 98333gau.nernst19.7µs1.07×Reported · license unknown · source2025-11-23stale
Measured exactly what you asked. Reported by source; not independently reproduced.
19submission 95567s.am._20.1µs1.09×Reported · license unknown · source2025-11-22stale
Measured exactly what you asked. Reported by source; not independently reproduced.
20submission 102007mdouglas20.2µs1.09×Reported · license unknown · source2025-11-24stale
Measured exactly what you asked. Reported by source; not independently reproduced.
21submission 111378_spatters20.3µs1.10×Reported · license unknown · source2025-11-28stale
Measured exactly what you asked. Reported by source; not independently reproduced.
22submission 109105_spatters20.4µs1.10×Reported · license unknown · source2025-11-27stale
Measured exactly what you asked. Reported by source; not independently reproduced.
23submission 93784mdouglas20.5µs1.11×Reported · license unknown · source2025-11-20stale
Measured exactly what you asked. Reported by source; not independently reproduced.
24submission 98092gau.nernst20.7µs1.12×Reported · license unknown · source2025-11-23stale
Measured exactly what you asked. Reported by source; not independently reproduced.
25submission 95047lambda21.6µs1.17×Reported · license unknown · source2025-11-21stale
Measured exactly what you asked. Reported by source; not independently reproduced.
26submission 94991lambda21.6µs1.17×Reported · license unknown · source2025-11-21stale
Measured exactly what you asked. Reported by source; not independently reproduced.
27submission 94986lambda21.6µs1.17×Reported · license unknown · source2025-11-21stale
Measured exactly what you asked. Reported by source; not independently reproduced.
28submission 82411gau.nernst21.7µs1.17×Reported · license unknown · source2025-11-18stale
Measured exactly what you asked. Reported by source; not independently reproduced.
29submission 78371gau.nernst21.7µs1.17×Reported · license unknown · source2025-11-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
3021.8µs1.18×Reported · license unknown · source2025-11-30stale
Measured exactly what you asked. Reported by source; not independently reproduced.
31submission 107318Venkat Raman21.8µs1.18×Reported · license unknown · source2025-11-27stale
Measured exactly what you asked. Reported by source; not independently reproduced.
32submission 93703lambda21.8µs1.18×Reported · license unknown · source2025-11-20stale
Measured exactly what you asked. Reported by source; not independently reproduced.
33submission 94121s.am._21.9µs1.18×Reported · license unknown · source2025-11-21stale
Measured exactly what you asked. Reported by source; not independently reproduced.
3421.9µs1.18×Reported · license unknown · source2025-11-30stale
Measured exactly what you asked. Reported by source; not independently reproduced.
35submission 111830aikitoria22.1µs1.19×Reported · license unknown · source2025-11-29stale
Measured exactly what you asked. Reported by source; not independently reproduced.
36submission 85852s.am._22.1µs1.19×Reported · license unknown · source2025-11-19stale
Measured exactly what you asked. Reported by source; not independently reproduced.
37submission 93630lambda22.2µs1.20×Reported · license unknown · source2025-11-20stale
Measured exactly what you asked. Reported by source; not independently reproduced.
38submission 93619lambda22.2µs1.20×Reported · license unknown · source2025-11-20stale
Measured exactly what you asked. Reported by source; not independently reproduced.
39submission 114858tomaszki22.3µs1.21×Reported · license unknown · source2025-11-29stale
Measured exactly what you asked. Reported by source; not independently reproduced.
4022.4µs1.21×Reported · license unknown · source2025-11-28stale
Measured exactly what you asked. Reported by source; not independently reproduced.
41submission 115034JB Gage22.4µs1.21×Reported · license unknown · source2025-11-29stale
Measured exactly what you asked. Reported by source; not independently reproduced.
42submission 107543_spatters22.5µs1.21×Reported · license unknown · source2025-11-27stale
Measured exactly what you asked. Reported by source; not independently reproduced.
43submission 115379snowclipsed22.5µs1.22×Reported · license unknown · source2025-11-30stale
Measured exactly what you asked. Reported by source; not independently reproduced.
44submission 84634lambda22.5µs1.22×Reported · license unknown · source2025-11-18stale
Measured exactly what you asked. Reported by source; not independently reproduced.
45submission 81471lambda22.5µs1.22×Reported · license unknown · source2025-11-17stale
Measured exactly what you asked. Reported by source; not independently reproduced.
4622.5µs1.22×Reported · license unknown · source2025-11-28stale
Measured exactly what you asked. Reported by source; not independently reproduced.
47submission 91318txacvalh22.7µs1.23×Reported · license unknown · source2025-11-20stale
Measured exactly what you asked. Reported by source; not independently reproduced.
48submission 85416txacvalh22.7µs1.23×Reported · license unknown · source2025-11-19stale
Measured exactly what you asked. Reported by source; not independently reproduced.
49submission 82428txacvalh22.7µs1.23×Reported · license unknown · source2025-11-18stale
Measured exactly what you asked. Reported by source; not independently reproduced.
5022.7µs1.23×Reported · license unknown · source2025-11-26stale
Measured exactly what you asked. Reported by source; not independently reproduced.
51submission 93553mdouglas22.8µs1.23×Reported · license unknown · source2025-11-20stale
Measured exactly what you asked. Reported by source; not independently reproduced.
52submission 82422txacvalh22.8µs1.23×Reported · license unknown · source2025-11-18stale
Measured exactly what you asked. Reported by source; not independently reproduced.
5322.8µs1.23×Reported · license unknown · source2025-11-28stale
Measured exactly what you asked. Reported by source; not independently reproduced.
5422.8µs1.23×Reported · license unknown · source2025-11-26stale
Measured exactly what you asked. Reported by source; not independently reproduced.
55submission 97026v0i022.9µs1.24×Reported · license unknown · source2025-11-22stale
Measured exactly what you asked. Reported by source; not independently reproduced.
56submission 115531Naturalseeker22.9µs1.24×Reported · license unknown · source2025-11-30stale
Measured exactly what you asked. Reported by source; not independently reproduced.
57submission 109232aikitoria23.0µs1.24×Reported · license unknown · source2025-11-27stale
Measured exactly what you asked. Reported by source; not independently reproduced.
58submission 115057Nareg23.0µs1.24×Reported · license unknown · source2025-11-30stale
Measured exactly what you asked. Reported by source; not independently reproduced.
59submission 85147shellsmile1579523.1µs1.25×Reported · license unknown · source2025-11-19stale
Measured exactly what you asked. Reported by source; not independently reproduced.
60submission 107236Venkat Raman23.2µs1.25×Reported · license unknown · source2025-11-26stale
Measured exactly what you asked. Reported by source; not independently reproduced.
540 more rows in this comparison group. Open all in search →