Vision rotary position embedding generation backward
Backward pass for vision rotary position embedding generation. Computes gradients through cos/sin operations, concatenation, indexing, and outer product to produce gradient for inverse frequencies.
Reported evidence · last observed 2026-08-21. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 16 cases · mean latencyhead_dim = 72 · head_dim_half = 36 · head_dim_quarter = 1816 cases
Not measured on H100 for this workload. Challenges →
13.44µs95% SOL1.00×Reported · license unknown · no source2026-08-21
Measured exactly what you asked. Reported by source; not independently reproduced.
23.92µs95% SOL1.14×Reported · license unknown · no source2026-07-11
Measured exactly what you asked. Reported by source; not independently reproduced.
35.01µs93% SOL1.46×Reported · license unknown · no source2026-08-06
Measured exactly what you asked. Reported by source; not independently reproduced.
45.05µs93% SOL1.47×Reported · license unknown · no source2026-08-06
Measured exactly what you asked. Reported by source; not independently reproduced.
55.43µs93% SOL1.58×Reported · license unknown · no source2026-07-15
Measured exactly what you asked. Reported by source; not independently reproduced.
65.46µs91% SOL1.59×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
75.55µs92% SOL1.62×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
85.69µs92% SOL1.66×Reported · license unknown · no source2026-08-22
Measured exactly what you asked. Reported by source; not independently reproduced.
96.11µs92% SOL1.78×Reported · license unknown · no source2026-08-04
Measured exactly what you asked. Reported by source; not independently reproduced.
106.52µs91% SOL1.90×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
116.62µs89% SOL1.93×Reported · license unknown · no source2026-07-20
Measured exactly what you asked. Reported by source; not independently reproduced.
127.44µs90% SOL2.17×Reported · license unknown · no source2026-08-17
Measured exactly what you asked. Reported by source; not independently reproduced.
137.44µs90% SOL2.17×Reported · license unknown · no source2026-08-18
Measured exactly what you asked. Reported by source; not independently reproduced.
147.47µs90% SOL2.17×Reported · license unknown · no source2026-08-19
Measured exactly what you asked. Reported by source; not independently reproduced.
157.70µs89% SOL2.24×Reported · license unknown · no source2026-08-15
Measured exactly what you asked. Reported by source; not independently reproduced.
168.45µs88% SOL2.46×Reported · license unknown · no source2026-07-13
Measured exactly what you asked. Reported by source; not independently reproduced.
178.49µs88% SOL2.47×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
188.67µs88% SOL2.52×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
198.97µs88% SOL2.61×Reported · license unknown · no source2026-07-13
Measured exactly what you asked. Reported by source; not independently reproduced.
209.09µs88% SOL2.64×Reported · license unknown · no source2026-07-13
Measured exactly what you asked. Reported by source; not independently reproduced.
219.27µs87% SOL2.70×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
2211.2µs85% SOL3.27×Reported · license unknown · no source2026-08-12
Measured exactly what you asked. Reported by source; not independently reproduced.
2311.5µs85% SOL3.33×Reported · license unknown · no source2026-07-27
Measured exactly what you asked. Reported by source; not independently reproduced.
2412.6µs83% SOL3.68×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
2513.1µs82% SOL3.80×Reported · license unknown · no source2026-08-02
Measured exactly what you asked. Reported by source; not independently reproduced.
2615.1µs81% SOL4.38×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.