Audio relative position attention
Audio attention with relative position embeddings, local causal masking with configurable context windows, attention logit soft-capping, and block-based processing. Processes audio in chunks with overlapping context windows using sinusoidal position encoding.
Reported evidence · last observed 2026-07-10. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 14 cases · mean latencyhead_dim = 64 · num_heads = 8 · chunk_size = 32 · hidden_size = 512 · max_forward = 0 · context_size = 160 · max_backward = 127 · num_timescales = 25614 cases
Not measured on H100 for this workload. Challenges →
182.7µs91% SOL1.00×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
287.6µs90% SOL1.06×Reported · license unknown · no source2026-08-04
Measured exactly what you asked. Reported by source; not independently reproduced.
3102.8µs88% SOL1.24×Reported · license unknown · no source2026-07-19
Measured exactly what you asked. Reported by source; not independently reproduced.
4113.9µs87% SOL1.38×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
5114.6µs87% SOL1.39×Reported · license unknown · no source2026-07-19
Measured exactly what you asked. Reported by source; not independently reproduced.
6119.7µs87% SOL1.45×Reported · license unknown · no source2026-08-12
Measured exactly what you asked. Reported by source; not independently reproduced.
7131.8µs86% SOL1.59×Reported · license unknown · no source2026-07-11
Measured exactly what you asked. Reported by source; not independently reproduced.
8136.1µs84% SOL1.65×Reported · license unknown · no source2026-07-17
Measured exactly what you asked. Reported by source; not independently reproduced.
9156.9µs83% SOL1.90×Reported · license unknown · no source2026-08-17
Measured exactly what you asked. Reported by source; not independently reproduced.
10188.2µs81% SOL2.28×Reported · license unknown · no source2026-07-14
Measured exactly what you asked. Reported by source; not independently reproduced.
11332.1µs69% SOL4.02×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
12541.9µs58% SOL6.56×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.