Gated DeltaNet chunk_fwd_o
The chunk_fwd_o output computation of Gated DeltaNet (arXiv:2412.06464): per 64-timestep chunk, combine the inter-chunk contribution q @ h * exp(g) with the causally masked intra-chunk attention over v_new, scaled by k^(-0.5). All tensors are fp32; t must be a multiple of 64.
Reported evidence · last observed 2026-03-15. Reported by source; not independently reproduced. License unknown.
Current records
Not measured on H100 for this workload. Challenges →
1submission 555616fluudgate5.86µs1.00×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
2submission 554996ramizzik18.0µs3.07×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
3submission 552589yhinai18.8µs3.20×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
4submission 553793ramizzik18.8µs3.21×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
5submission 555152sissi116519.0µs3.24×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
6submission 555463pradeep0307120.1µs3.44×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
7submission 553929bloomberg938320.3µs3.47×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
8submission 553224the.defenestrator21.4µs3.65×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
9submission 551972yf22521.8µs3.73×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
10submission 552535dpang21.9µs3.74×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
11submission 552582bloomberg938321.9µs3.74×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
12submission 555438happy_sloth_22.7µs3.88×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
13submission 555526Mistobaan23.2µs3.96×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
14submission 555436suvasis_2904750.4µs8.60×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
15submission 553198brandonin60.7µs10.35×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.