Skip to content
KernelIndex
Search⌘K

RMSNorm h5120

0 eligible runs
rmsnorm

Root Mean Square Normalization with hidden_size=5120. Captured from Qwen3 14B. Epsilon is fixed at 1e-6.

Current records

No published measurement for the selected workload.

Implementations

Implementation
Runtime
Best latency
Evidence
Availability
flashinfer / wrappere1f464FlashInfer-Bench baselines
python
—
—
Apache-2.0 · source

Semantics

Inputs and outputs
hidden_statesbf16 [batch_size, hidden_size]
weightbf16 [hidden_size]
outputbf16 [batch_size, hidden_size]
Axes and behavior
batch_sizevariable
hidden_sizeconstant = 5120
determinismunspecified
constraintsNo mutation or aliasing
Identity
aliasrmsnorm_h5120modelqwen3-14bsha2566f99e345e8d0…
No source imports for this operation yet.How records are decidedJSON