Rotary position embedding application
Rotary Position Embedding (RoPE) application that rotates query and key vectors in attention mechanisms based on their positions. Splits the feature dimension into pairs, applies rotation matrices derived from position indices and frequency bands. Critical for diffusion transformers as it provides position information without learned parameters.
Reported evidence · last observed 2026-08-19. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 16 cases · mean latencyhead_dim = 128 · half_head_dim = 6416 cases
Not measured on H100 for this workload. Challenges →
123.3µs69% SOL1.00×Reported · license unknown · no source2026-08-19
Measured exactly what you asked. Reported by source; not independently reproduced.
223.3µs69% SOL1.00×Reported · license unknown · no source2026-07-17
Measured exactly what you asked. Reported by source; not independently reproduced.
323.6µs68% SOL1.01×Reported · license unknown · no source2026-08-18
Measured exactly what you asked. Reported by source; not independently reproduced.
424.3µs67% SOL1.04×Reported · license unknown · no source2026-08-24
Measured exactly what you asked. Reported by source; not independently reproduced.
524.5µs67% SOL1.05×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
624.5µs67% SOL1.05×Reported · license unknown · no source2026-08-12
Measured exactly what you asked. Reported by source; not independently reproduced.
724.8µs67% SOL1.06×Reported · license unknown · no source2026-07-28
Measured exactly what you asked. Reported by source; not independently reproduced.
824.8µs67% SOL1.07×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
925.1µs66% SOL1.08×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
1025.2µs66% SOL1.08×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
1125.3µs66% SOL1.09×Reported · license unknown · no source2026-07-18
Measured exactly what you asked. Reported by source; not independently reproduced.
1228.1µs63% SOL1.20×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
1339.7µs51% SOL1.70×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.