Mamba2 selective scan
Mamba2 selective state space model core computation including convolution, selective scan with chunking, state space discretization, and gated normalization. This is the dominant computation in the hybrid architecture.
Reported evidence · last observed 2026-08-18. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 16 cases · mean latencyconv_dim = 20480 · head_dim = 64 · n_groups = 8 · num_heads = 256 · chunk_size = 128 · hidden_size = 8192 · ssm_state_size = 256 · projection_size = 37120 · conv_kernel_size = 4 · intermediate_size = 16384 · groups_time_state_size = 204816 cases
Not measured on H100 for this workload. Challenges →
11.80ms79% SOL1.00×Reported · license unknown · no source2026-08-18
Measured exactly what you asked. Reported by source; not independently reproduced.
21.85ms78% SOL1.03×Reported · license unknown · no source2026-07-12
Measured exactly what you asked. Reported by source; not independently reproduced.
31.91ms76% SOL1.06×Reported · license unknown · no source2026-08-22
Measured exactly what you asked. Reported by source; not independently reproduced.
41.96ms75% SOL1.09×Reported · license unknown · no source2026-08-04
Measured exactly what you asked. Reported by source; not independently reproduced.
52.06ms73% SOL1.15×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
62.19ms70% SOL1.22×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
72.42ms66% SOL1.34×Reported · license unknown · no source2026-08-09
Measured exactly what you asked. Reported by source; not independently reproduced.
82.58ms66% SOL1.43×Reported · license unknown · no source2026-07-17
Measured exactly what you asked. Reported by source; not independently reproduced.
93.73ms49% SOL2.07×Reported · license unknown · no source2026-08-09
Measured exactly what you asked. Reported by source; not independently reproduced.
103.85ms49% SOL2.14×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
114.51ms43% SOL2.50×Reported · license unknown · no source2026-07-26
Measured exactly what you asked. Reported by source; not independently reproduced.
125.99ms35% SOL3.32×Reported · license unknown · no source2026-07-25
Measured exactly what you asked. Reported by source; not independently reproduced.
136.07ms34% SOL3.37×Reported · license unknown · no source2026-07-23
Measured exactly what you asked. Reported by source; not independently reproduced.