RMSNorm h512
Root Mean Square Normalization with hidden_size=512. Captured from DeepSeek-V3/R1. Epsilon is fixed at 1e-6.
Reported evidence · last observed 2026-08-18. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 8 cases · mean latency16 cases
Not measured on H100 for this workload. Challenges →
12.73µs73% SOL1.00×Reported · license unknown · no source2026-08-18
Measured exactly what you asked. Reported by source; not independently reproduced.
1=2.73µs73% SOL1.00×Reported · license unknown · no source2026-07-23
Measured exactly what you asked; tied ranks share a number. Reported by source; not independently reproduced.
22.79µs72% SOL1.02×Reported · license unknown · no source2026-08-21
Measured exactly what you asked. Reported by source; not independently reproduced.
32.80µs72% SOL1.03×Reported · license unknown · no source2026-08-21
Measured exactly what you asked. Reported by source; not independently reproduced.
42.80µs72% SOL1.03×Reported · license unknown · no source2026-07-30
Measured exactly what you asked. Reported by source; not independently reproduced.
52.81µs72% SOL1.03×Reported · license unknown · no source2026-07-22
Measured exactly what you asked. Reported by source; not independently reproduced.
62.83µs72% SOL1.04×Reported · license unknown · no source2026-07-30
Measured exactly what you asked. Reported by source; not independently reproduced.
6=2.83µs72% SOL1.04×Reported · license unknown · no source2026-07-30
Measured exactly what you asked; tied ranks share a number. Reported by source; not independently reproduced.
72.91µs71% SOL1.07×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
82.95µs71% SOL1.08×Reported · license unknown · no source2026-08-18
Measured exactly what you asked. Reported by source; not independently reproduced.
92.96µs71% SOL1.09×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
103.08µs69% SOL1.13×Reported · license unknown · no source2026-08-08
Measured exactly what you asked. Reported by source; not independently reproduced.
113.13µs69% SOL1.15×Reported · license unknown · no source2026-08-02
Measured exactly what you asked. Reported by source; not independently reproduced.
123.17µs69% SOL1.16×Reported · license unknown · no source2026-07-27
Measured exactly what you asked. Reported by source; not independently reproduced.
133.20µs68% SOL1.18×Reported · license unknown · no source2026-07-29
Measured exactly what you asked. Reported by source; not independently reproduced.
143.29µs68% SOL1.21×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
153.33µs67% SOL1.22×Reported · license unknown · no source2026-07-28
Measured exactly what you asked. Reported by source; not independently reproduced.
163.41µs67% SOL1.25×Reported · license unknown · no source2026-07-26
Measured exactly what you asked. Reported by source; not independently reproduced.
173.43µs66% SOL1.26×Reported · license unknown · no source2026-07-23
Measured exactly what you asked. Reported by source; not independently reproduced.
183.46µs66% SOL1.27×Reported · license unknown · no source2026-07-18
Measured exactly what you asked. Reported by source; not independently reproduced.
193.50µs66% SOL1.29×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
203.73µs64% SOL1.37×Reported · license unknown · no source2026-07-14
Measured exactly what you asked. Reported by source; not independently reproduced.
213.78µs64% SOL1.39×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
224.16µs61% SOL1.53×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
234.31µs60% SOL1.58×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
244.40µs59% SOL1.62×Reported · license unknown · no source2026-07-30
Measured exactly what you asked. Reported by source; not independently reproduced.
Implementations
Show all 46 implementations ›Showing all 46 implementations ⌄
Semantics
Also indexed as 022-rmsnorm-h512 · reviewed as the same computation; every definition's cohorts are shown here, ranked separately.