Rotary position embedding
RoPE (Rotary Position Embedding) computation with llama3 scaling that computes cos/sin embeddings from inverse frequencies and position IDs. Uses frequency-based scaling with high_freq_factor=4.0, low_freq_factor=1.0, factor=8.0 for extended context support up to 131072 positions. Returns concatenated cos and sin embeddings.
Reported evidence · last observed 2026-06-07. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 16 cases · mean latencyhead_dim = 128 · half_head_dim = 6416 cases
Not measured on H100 for this workload. Challenges →
11.86µs77% SOL1.00×Reported · license unknown · no source2026-06-07
Measured exactly what you asked. Reported by source; not independently reproduced.
21.89µs77% SOL1.01×Reported · license unknown · no source2026-06-26
Measured exactly what you asked. Reported by source; not independently reproduced.
31.99µs77% SOL1.07×Reported · license unknown · no source2026-07-01
Measured exactly what you asked. Reported by source; not independently reproduced.
42.07µs76% SOL1.11×Reported · license unknown · no source2026-06-28
Measured exactly what you asked. Reported by source; not independently reproduced.
52.37µs71% SOL1.27×Reported · license unknown · no source2026-07-08
Measured exactly what you asked. Reported by source; not independently reproduced.
62.51µs71% SOL1.35×Reported · license unknown · no source2026-07-02
Measured exactly what you asked. Reported by source; not independently reproduced.
72.85µs68% SOL1.53×Reported · license unknown · no source2026-07-05
Measured exactly what you asked. Reported by source; not independently reproduced.
7=2.85µs68% SOL1.53×Reported · license unknown · no source2026-06-30
Measured exactly what you asked; tied ranks share a number. Reported by source; not independently reproduced.
82.88µs67% SOL1.54×Reported · license unknown · no source2026-05-31
Measured exactly what you asked. Reported by source; not independently reproduced.
92.88µs67% SOL1.55×Reported · license unknown · no source2026-05-31
Measured exactly what you asked. Reported by source; not independently reproduced.
102.89µs67% SOL1.55×Reported · license unknown · no source2026-04-21
Measured exactly what you asked. Reported by source; not independently reproduced.
112.89µs67% SOL1.55×Reported · license unknown · no source2026-05-31
Measured exactly what you asked. Reported by source; not independently reproduced.
122.89µs67% SOL1.55×Reported · license unknown · no source2026-05-31
Measured exactly what you asked. Reported by source; not independently reproduced.
132.92µs67% SOL1.57×Reported · license unknown · no source2026-05-19
Measured exactly what you asked. Reported by source; not independently reproduced.
142.97µs67% SOL1.59×Reported · license unknown · no source2026-05-19
Measured exactly what you asked. Reported by source; not independently reproduced.
153.40µs63% SOL1.82×Reported · license unknown · no source2026-05-28
Measured exactly what you asked. Reported by source; not independently reproduced.
163.48µs63% SOL1.86×Reported · license unknown · no source2026-04-27
Measured exactly what you asked. Reported by source; not independently reproduced.
173.67µs62% SOL1.97×Reported · license unknown · no source2026-04-15
Measured exactly what you asked. Reported by source; not independently reproduced.
183.73µs61% SOL2.00×Reported · license unknown · no source2026-04-14
Measured exactly what you asked. Reported by source; not independently reproduced.
194.19µs58% SOL2.25×Reported · license unknown · no source2026-07-07
Measured exactly what you asked. Reported by source; not independently reproduced.
204.70µs55% SOL2.52×Reported · license unknown · no source2026-05-06
Measured exactly what you asked. Reported by source; not independently reproduced.
214.83µs54% SOL2.59×Reported · license unknown · no source2026-04-15
Measured exactly what you asked. Reported by source; not independently reproduced.
224.84µs54% SOL2.60×Reported · license unknown · no source2026-06-25
Measured exactly what you asked. Reported by source; not independently reproduced.
234.87µs54% SOL2.61×Reported · license unknown · no source2026-06-25
Measured exactly what you asked. Reported by source; not independently reproduced.
245.01µs53% SOL2.69×Reported · license unknown · no source2026-06-14
Measured exactly what you asked. Reported by source; not independently reproduced.
255.01µs53% SOL2.69×Reported · license unknown · no source2026-06-09
Measured exactly what you asked. Reported by source; not independently reproduced.
265.67µs49% SOL3.04×Reported · license unknown · no source2026-04-20
Measured exactly what you asked. Reported by source; not independently reproduced.
2724.4µs17% SOL13.07×Reported · license unknown · no source2026-04-15
Measured exactly what you asked. Reported by source; not independently reproduced.
2841.6µs11% SOL22.29×Reported · license unknown · no source2026-05-28
Measured exactly what you asked. Reported by source; not independently reproduced.