Skip to content
KernelIndex
Search⌘K

RoPE inverse frequency computation

49 eligible runs
rope

Computes the inverse frequency tensor for RoPE embeddings. Generates frequencies as: inv_freq = 1.0 / (rope_theta^(arange(0, head_dim, 2) / head_dim)). This is a one-time initialization operation that determines the frequency spectrum for rotary position embeddings.

Fastest reported
896nsmean · 78% of SOL
ac4kLicense unknown · unknown

Reported evidence · last observed 2026-07-10. Reported by source; not independently reproduced. No public source. License unknown.

No public sourceRun detail →

Current records

Source-native comparison · GPU NVIDIA B200 · Workload suite of 16 cases · mean latency · Protocol SOL-ExecBench evaluation stack v1.1 · mean · 31 results · last observed 2026-08-24Record history →
#
Implementation
Latency
vs #1
Trust
Observed
1
896ns78% SOL
1.00×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
2
1.16µs70% SOL
1.30×
Reported · license unknown · no source
2026-07-11

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
3
1.20µs69% SOL
1.34×
Reported · license unknown · no source
2026-08-23

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
4
1.25µs67% SOL
1.40×
Reported · license unknown · no source
2026-08-19

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
5
1.28µs66% SOL
1.43×
Reported · license unknown · no source
2026-08-01

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
5=
1.28µs67% SOL
1.43×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked; tied ranks share a number. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
6
1.34µs65% SOL
1.49×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
7
1.34µs65% SOL
1.49×
Reported · license unknown · no source
2026-08-13

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
7=
1.34µs65% SOL
1.49×
Reported · license unknown · no source
2026-08-11

Measured exactly what you asked; tied ranks share a number. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
8
1.34µs65% SOL
1.50×
Reported · license unknown · no source
2026-08-20

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
9
1.35µs65% SOL
1.51×
Reported · license unknown · no source
2026-08-20

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
10
1.36µs65% SOL
1.52×
Reported · license unknown · no source
2026-08-22

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
11
1.36µs65% SOL
1.52×
Reported · license unknown · no source
2026-08-23

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
12
1.37µs64% SOL
1.53×
Reported · license unknown · no source
2026-08-23

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
13
1.40µs64% SOL
1.56×
Reported · license unknown · no source
2026-08-18

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
14
1.43µs63% SOL
1.60×
Reported · license unknown · no source
2026-08-14

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
15
1.43µs63% SOL
1.60×
Reported · license unknown · no source
2026-08-24

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
16
1.47µs62% SOL
1.64×
Reported · license unknown · no source
2026-08-07

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
17
1.52µs61% SOL
1.70×
Reported · license unknown · no source
2026-08-22

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
18
1.53µs61% SOL
1.71×
Reported · license unknown · no source
2026-08-16

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
19
1.76µs56% SOL
1.96×
Reported · license unknown · no source
2026-08-01

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
20
1.82µs55% SOL
2.03×
Reported · license unknown · no source
2026-08-07

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
21
1.82µs55% SOL
2.04×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
22
1.83µs55% SOL
2.05×
Reported · license unknown · no source
2026-07-27

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
23
1.89µs54% SOL
2.10×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
24
1.89µs54% SOL
2.11×
Reported · license unknown · no source
2026-07-27

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
25
2.01µs52% SOL
2.24×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
26
2.02µs52% SOL
2.26×
Reported · license unknown · no source
2026-08-02

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
27
2.11µs51% SOL
2.35×
Reported · license unknown · no source
2026-07-17

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
28
2.14µs50% SOL
2.39×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
29
2.14µs50% SOL
2.39×
Reported · license unknown · no source
2026-07-28

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →

Implementations

Implementation
Runtime
Best latency
Evidence
Availability
unknown
1.05µs
1.18×
Reported
license unknown · no source
unknown
1.20µs
1.34×
Reported
license unknown · no source
unknown
1.22µs
1.36×
Reported
license unknown · no source
unknown
1.28µs
1.43×
Reported
license unknown · no source
unknown
1.58µs
1.76×
Reported
license unknown · no source
unknown
1.77µs
1.98×
Reported
license unknown · no source
unknown
1.82µs
2.03×
Reported
license unknown · no source
unknown
1.83µs
2.04×
Reported
license unknown · no source
Show all 49 implementations ›
unknown
1.83µs
2.05×
Reported
license unknown · no source
unknown
1.84µs
2.06×
Reported
license unknown · no source
unknown
2.02µs
2.26×
Reported
license unknown · no source
unknown
2.11µs
2.35×
Reported
license unknown · no source
unknown
2.14µs
2.39×
Reported
license unknown · no source
unknown
2.14µs
2.39×
Reported
license unknown · no source
unknown
2.14µs
2.39×
Reported
license unknown · no source
unknown
2.63µs
2.93×
Reported
license unknown · no source
unknown
7.40µs
8.26×
Reported
license unknown · no source
unknown
920ns
1.03×
Reported
license unknown · no source
unknown
1.06µs
1.18×
Reported
license unknown · no source
unknown
1.22µs
1.36×
Reported
license unknown · no source
unknown
1.25µs
1.40×
Reported
license unknown · no source
unknown
1.30µs
1.45×
Reported
license unknown · no source
unknown
1.34µs
1.49×
Reported
license unknown · no source
unknown
1.34µs
1.49×
Reported
license unknown · no source
unknown
1.34µs
1.49×
Reported
license unknown · no source
unknown
1.34µs
1.50×
Reported
license unknown · no source
unknown
1.35µs
1.51×
Reported
license unknown · no source
unknown
1.36µs
1.52×
Reported
license unknown · no source
unknown
1.36µs
1.52×
Reported
license unknown · no source
unknown
1.37µs
1.53×
Reported
license unknown · no source
unknown
1.40µs
1.56×
Reported
license unknown · no source
unknown
1.43µs
1.60×
Reported
license unknown · no source
unknown
1.43µs
1.60×
Reported
license unknown · no source
unknown
1.47µs
1.64×
Reported
license unknown · no source
unknown
1.52µs
1.70×
Reported
license unknown · no source
unknown
1.53µs
1.71×
Reported
license unknown · no source
unknown
1.67µs
1.86×
Reported
license unknown · no source
unknown
1.76µs
1.96×
Reported
license unknown · no source
unknown
1.81µs
2.02×
Reported
license unknown · no source
unknown
1.82µs
2.04×
Reported
license unknown · no source
unknown
1.83µs
2.05×
Reported
license unknown · no source
unknown
1.89µs
2.10×
Reported
license unknown · no source
unknown
1.89µs
2.11×
Reported
license unknown · no source
unknown
2.01µs
2.24×
Reported
license unknown · no source
unknown
2.14µs
2.39×
Reported
license unknown · no source
unknown
2.14µs
2.39×
Reported
license unknown · no source
unknown
896ns
1.00×
Reported
license unknown · no source
unknown
1.16µs
1.30×
Reported
license unknown · no source
unknown
1.28µs
1.43×
Reported
license unknown · no source

Semantics

Inputs and outputs
rope_thetafp32 scalar
inv_freqfp32 [half_head_dim]
Axes and behavior
head_dimconstant = 128
half_head_dimconstant = 64
determinismunspecified
constraintsNo mutation or aliasing
Identity
alias016_rope_inverse_frequency_computationmodelqwen3-8bsha256f6f420dd8688…
Sources: NVIDIA SOL-ExecBench (2026-08-24)last observed 2026-08-24How records are decidedJSON