VAE attention block with GroupNorm
VAE self-attention block with group normalization. Applies group norm, flattens spatial dimensions (B,C,H,W) to (B,H*W,C), computes single-head self-attention over spatial positions, reshapes back, and adds residual. Critical for capturing long-range spatial dependencies in VAE encoder/decoder.
Reported evidence · last observed 2026-06-07. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 16 cases · mean latencyseq_len = 4096 · channels = 512 · num_groups = 32 · spatial_size = 6416 cases
Not measured on H100 for this workload. Challenges →
1634.5µs74% SOL1.00×Reported · license unknown · no source2026-06-07
Measured exactly what you asked. Reported by source; not independently reproduced.
2642.2µs73% SOL1.01×Reported · license unknown · no source2026-06-29
Measured exactly what you asked. Reported by source; not independently reproduced.
3646.8µs73% SOL1.02×Reported · license unknown · no source2026-07-09
Measured exactly what you asked. Reported by source; not independently reproduced.
4649.0µs73% SOL1.02×Reported · license unknown · no source2026-06-26
Measured exactly what you asked. Reported by source; not independently reproduced.
5651.5µs73% SOL1.03×Reported · license unknown · no source2026-06-29
Measured exactly what you asked. Reported by source; not independently reproduced.
6664.5µs72% SOL1.05×Reported · license unknown · no source2026-07-05
Measured exactly what you asked. Reported by source; not independently reproduced.
7696.3µs70% SOL1.10×Reported · license unknown · no source2026-05-20
Measured exactly what you asked. Reported by source; not independently reproduced.
8990.0µs58% SOL1.56×Reported · license unknown · no source2026-06-11
Measured exactly what you asked. Reported by source; not independently reproduced.
91.31ms49% SOL2.07×Reported · license unknown · no source2026-06-01
Measured exactly what you asked. Reported by source; not independently reproduced.
101.42ms47% SOL2.24×Reported · license unknown · no source2026-04-25
Measured exactly what you asked. Reported by source; not independently reproduced.
111.74ms41% SOL2.74×Reported · license unknown · no source2026-07-01
Measured exactly what you asked. Reported by source; not independently reproduced.
122.08ms36% SOL3.27×Reported · license unknown · no source2026-04-14
Measured exactly what you asked. Reported by source; not independently reproduced.
1310.9ms9% SOL17.25×Reported · license unknown · no source2026-04-23
Measured exactly what you asked. Reported by source; not independently reproduced.