Skip to content
KernelIndex
Search⌘K

Multimodal RoPE position calculation

25 eligible runs
rope

Complex 3D position ID calculation for multi-modal inputs (text, images, videos) that computes temporal, height, and width position indices for rotary embeddings. Handles variable-length sequences with different grid sizes, performs spatial merging calculations, and creates position deltas for rope indexing.

Fastest reported
2.42µsmean · 98% of SOL
doubleAILicense unknown · unknown

Reported evidence · last observed 2026-06-26. Reported by source; not independently reproduced. No public source. License unknown.

No public sourceRun detail →

Current records

Workloadsuite of 16 cases · mean latencyimage_token_id = 151655 · video_token_id = 151656 · spatial_merge_size = 2 · vision_start_token_id = 15165216 cases

Not measured on H100 for this workload. Challenges →

Source-native comparison · GPU NVIDIA B200 · Workload suite of 16 cases · mean latency · Protocol SOL-ExecBench evaluation stack v1.0 · mean · 15 results · last observed 2026-08-16Record history →
#
Implementation
Latency
vs #1
Trust
Observed
1
2.42µs98% SOL
1.00×
Reported · license unknown · no source
2026-06-26

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
2
2.63µs98% SOL
1.09×
Reported · license unknown · no source
2026-06-06

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
3
2.93µs98% SOL
1.21×
Reported · license unknown · no source
2026-07-08

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
4
3.02µs98% SOL
1.25×
Reported · license unknown · no source
2026-04-14

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
5
3.77µs97% SOL
1.56×
Reported · license unknown · no source
2026-06-08

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
6
5.10µs96% SOL
2.10×
Reported · license unknown · no source
2026-05-20

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
7
5.52µs93% SOL
2.28×
Reported · license unknown · no source
2026-07-07

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
8
22.6µs85% SOL
9.34×
Reported · license unknown · no source
2026-04-15

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
9
24.2µs83% SOL
9.98×
Reported · license unknown · no source
2026-04-14

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
10
42.9µs74% SOL
17.70×
Reported · license unknown · no source
2026-05-25

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
11
260.1µs32% SOL
107.29×
Reported · license unknown · no source
2026-04-15

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
12
269.6µs32% SOL
111.22×
Reported · license unknown · no source
2026-05-20

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
13
582.6µs19% SOL
240.33×
Reported · license unknown · no source
2026-04-21

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
14
584.9µs19% SOL
241.29×
Reported · license unknown · no source
2026-04-21

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
15
1.33ms9% SOL
548.17×
Reported · license unknown · no source
2026-04-23

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →

Implementations

Implementation
Runtime
Best latency
Evidence
Availability
unknown
2.25µs
1.00×
Reported
license unknown · no source
unknown
2.61µs
1.16×
Reported
license unknown · no source
unknown
2.81µs
1.25×
Reported
license unknown · no source
unknown
2.93µs
1.31×
Reported
license unknown · no source
unknown
3.02µs
1.35×
Reported
license unknown · no source
unknown
3.77µs
1.68×
Reported
license unknown · no source
unknown
5.61µs
2.50×
Reported
license unknown · no source
unknown
22.6µs
10.07×
Reported
license unknown · no source
Show all 25 implementations ›
unknown
24.2µs
10.77×
Reported
license unknown · no source
unknown
582.6µs
259.26×
Reported
license unknown · no source
unknown
2.63µs
1.17×
Reported
license unknown · no source
unknown
2.96µs
1.32×
Reported
license unknown · no source
unknown
3.05µs
1.36×
Reported
license unknown · no source
unknown
3.77µs
1.68×
Reported
license unknown · no source
unknown
5.10µs
2.27×
Reported
license unknown · no source
unknown
5.52µs
2.45×
Reported
license unknown · no source
unknown
9.58µs
4.26×
Reported
license unknown · no source
unknown
42.9µs
19.10×
Reported
license unknown · no source
unknown
260.1µs
115.74×
Reported
license unknown · no source
unknown
269.6µs
119.98×
Reported
license unknown · no source
unknown
584.9µs
260.30×
Reported
license unknown · no source
unknown
1.33ms
591.34×
Reported
license unknown · no source
unknown
2.42µs
1.08×
Reported
license unknown · no source
unknown
2.48µs
1.11×
Reported
license unknown · no source
unknown
2.57µs
1.15×
Reported
license unknown · no source

Semantics

Inputs and outputs
input_idsint64 [batch_size, seq_len]
image_grid_thwint64 [total_num_images, 3]
video_grid_thwint64 [total_num_videos, 3]
second_per_grid_tsfp32 [total_num_videos]
attention_maskint64 [batch_size, seq_len]
position_idsint64 [3, batch_size, seq_len]
mrope_position_deltasint64 [batch_size, 1]
Axes and behavior
seq_lenvariable
batch_sizevariable
image_token_idconstant = 151655
video_token_idconstant = 151656
total_num_imagesvariable
total_num_videosvariable
spatial_merge_sizeconstant = 2
vision_start_token_idconstant = 151652
determinismunspecified
constraintsNo mutation or aliasing
Identity
alias006_multimodal_rope_position_calculationmodelqwen2-5-vl-7b-instructsha25685af9f068b83…
Sources: NVIDIA SOL-ExecBench (2026-08-16)last observed 2026-08-16How records are decidedJSON