Altup predict correction cycle backward
Backward pass for AltUp predict-correct cycle. Computes gradients for prediction coefficients, correction coefficients, router weights, and norm weights through the combined predict and correct operations.
Reported evidence · last observed 2026-08-19. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 16 cases · mean latencyhidden_size = 2304 · altup_num_inputs = 3 · altup_num_inputs_sq = 916 cases
Not measured on H100 for this workload. Challenges →
156.4µs97% SOL1.00×Reported · license unknown · no source2026-08-19
Measured exactly what you asked. Reported by source; not independently reproduced.
271.3µs95% SOL1.26×Reported · license unknown · no source2026-07-17
Measured exactly what you asked. Reported by source; not independently reproduced.
378.9µs94% SOL1.40×Reported · license unknown · no source2026-07-12
Measured exactly what you asked. Reported by source; not independently reproduced.
486.8µs93% SOL1.54×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
591.3µs92% SOL1.62×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
692.8µs92% SOL1.65×Reported · license unknown · no source2026-08-04
Measured exactly what you asked. Reported by source; not independently reproduced.
7100.5µs91% SOL1.78×Reported · license unknown · no source2026-07-20
Measured exactly what you asked. Reported by source; not independently reproduced.
8109.6µs90% SOL1.94×Reported · license unknown · no source2026-08-23
Measured exactly what you asked. Reported by source; not independently reproduced.
9111.7µs90% SOL1.98×Reported · license unknown · no source2026-08-22
Measured exactly what you asked. Reported by source; not independently reproduced.
10118.1µs89% SOL2.09×Reported · license unknown · no source2026-08-21
Measured exactly what you asked. Reported by source; not independently reproduced.
11122.1µs89% SOL2.16×Reported · license unknown · no source2026-08-10
Measured exactly what you asked. Reported by source; not independently reproduced.
12130.0µs88% SOL2.30×Reported · license unknown · no source2026-08-24
Measured exactly what you asked. Reported by source; not independently reproduced.
13135.9µs87% SOL2.41×Reported · license unknown · no source2026-07-14
Measured exactly what you asked. Reported by source; not independently reproduced.
14164.4µs84% SOL2.91×Reported · license unknown · no source2026-08-10
Measured exactly what you asked. Reported by source; not independently reproduced.
15184.4µs82% SOL3.27×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
16254.2µs76% SOL4.50×Reported · license unknown · no source2026-07-26
Measured exactly what you asked. Reported by source; not independently reproduced.
17290.4µs73% SOL5.15×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
18528.4µs58% SOL9.36×Reported · license unknown · no source2026-08-08
Measured exactly what you asked. Reported by source; not independently reproduced.
19815.8µs47% SOL14.46×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
203.63ms17% SOL64.31×Reported · license unknown · no source2026-08-21
Measured exactly what you asked. Reported by source; not independently reproduced.