RMSNorm h1536
Root Mean Square Normalization with hidden_size=1536. Captured from DeepSeek-V3/R1. Epsilon is fixed at 1e-6.
Reported evidence · last observed 2026-07-23. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 8 cases · mean latency16 cases
Not measured on H100 for this workload. Challenges →
13.33µs88% SOL1.00×Reported · license unknown · no source2026-07-23
Measured exactly what you asked. Reported by source; not independently reproduced.
23.41µs88% SOL1.02×Reported · license unknown · no source2026-07-22
Measured exactly what you asked. Reported by source; not independently reproduced.
33.57µs87% SOL1.07×Reported · license unknown · no source2026-08-01
Measured exactly what you asked. Reported by source; not independently reproduced.
43.58µs87% SOL1.07×Reported · license unknown · no source2026-08-13
Measured exactly what you asked. Reported by source; not independently reproduced.
53.58µs87% SOL1.07×Reported · license unknown · no source2026-07-29
Measured exactly what you asked. Reported by source; not independently reproduced.
63.62µs87% SOL1.09×Reported · license unknown · no source2026-08-02
Measured exactly what you asked. Reported by source; not independently reproduced.
73.64µs87% SOL1.09×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
83.65µs86% SOL1.09×Reported · license unknown · no source2026-08-02
Measured exactly what you asked. Reported by source; not independently reproduced.
93.69µs87% SOL1.11×Reported · license unknown · no source2026-08-21
Measured exactly what you asked. Reported by source; not independently reproduced.
103.71µs86% SOL1.11×Reported · license unknown · no source2026-07-30
Measured exactly what you asked. Reported by source; not independently reproduced.
113.76µs86% SOL1.13×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
123.78µs86% SOL1.13×Reported · license unknown · no source2026-08-03
Measured exactly what you asked. Reported by source; not independently reproduced.
133.81µs86% SOL1.14×Reported · license unknown · no source2026-07-30
Measured exactly what you asked. Reported by source; not independently reproduced.
144.03µs85% SOL1.21×Reported · license unknown · no source2026-07-27
Measured exactly what you asked. Reported by source; not independently reproduced.
154.10µs84% SOL1.23×Reported · license unknown · no source2026-08-01
Measured exactly what you asked. Reported by source; not independently reproduced.
164.19µs84% SOL1.26×Reported · license unknown · no source2026-07-16
Measured exactly what you asked. Reported by source; not independently reproduced.
174.19µs84% SOL1.26×Reported · license unknown · no source2026-07-29
Measured exactly what you asked. Reported by source; not independently reproduced.
184.33µs83% SOL1.30×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
194.42µs83% SOL1.33×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
204.46µs83% SOL1.34×Reported · license unknown · no source2026-07-18
Measured exactly what you asked. Reported by source; not independently reproduced.
214.64µs82% SOL1.39×Reported · license unknown · no source2026-08-03
Measured exactly what you asked. Reported by source; not independently reproduced.
224.75µs81% SOL1.43×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
234.76µs81% SOL1.43×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
245.50µs78% SOL1.65×Reported · license unknown · no source2026-07-28
Measured exactly what you asked. Reported by source; not independently reproduced.
258.30µs68% SOL2.49×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
Implementations
Show all 44 implementations ›Showing all 44 implementations ⌄
Semantics
Also indexed as rmsnorm-h1536 · reviewed as the same computation; every definition's cohorts are shown here, ranked separately.