Gated DeltaNet recompute_w_u
The recompute_w_u forward kernel of Gated DeltaNet (arXiv:2412.06464): per 64-timestep chunk, compute the WY-transformed values u = A @ (v * beta) and keys w = A @ (k * beta * exp(g)) from the per-chunk WY matrix A. All tensors are fp32; t must be a multiple of 64.
Reported evidence · last observed 2026-03-15. Reported by source; not independently reproduced. License unknown.
Current records
Not measured on H100 for this workload. Challenges →
1submission 555563kitrak_rev.6.54µs1.00×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
2submission 555471pradeep030716.79µs1.04×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
3submission 555437suvasis_290477.40µs1.13×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
4submission 552588yhinai8.20µs1.25×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
5submission 554997ramizzik8.37µs1.28×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
6submission 553897bloomberg93838.39µs1.28×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
7submission 555567sissi11658.49µs1.30×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
8submission 555527Mistobaan8.55µs1.31×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
9submission 554533ramizzik8.99µs1.38×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
10submission 554344lacalculatrice9.07µs1.39×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
11submission 553794ramizzik10.2µs1.57×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
12submission 555027Ayush1010.6µs1.62×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
13submission 553946svdrecbd14.9µs2.27×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
14submission 555625alazarr.m49.1µs7.51×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
15submission 552566dpang51.6µs7.89×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
16submission 552479lacalculatrice70.5µs10.78×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
17submission 554405kitrak_rev.103.8µs15.88×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
18submission 555442happy_sloth_141.0µs21.57×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
19submission 553231Ayush10153.6µs23.50×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
20submission 551774yf225155.7µs23.82×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
21submission 551101Seraphim156.1µs23.88×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
22submission 555132ronitmathur_37198156.1µs23.88×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.
23submission 553133Ayush10156.2µs23.89×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
24submission 552583bloomberg9383156.3µs23.90×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
25submission 554403ronitmathur_37198156.6µs23.95×Reported · license unknown · no source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
26submission 553122ramizzik169.2µs25.88×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
27submission 553202brandonin191.7µs29.32×Reported · license unknown · source2026-03-14stale
Measured exactly what you asked. Reported by source; not independently reproduced.
28submission 555587tr00ths3rum195.6µs29.93×Reported · license unknown · source2026-03-15stale
Measured exactly what you asked. Reported by source; not independently reproduced.