Seqlen-finetuned-reconstructed Hyena gating and output projection
Hyena gating mechanism and output projection that combines multiple orders of filtered outputs through cascaded gating with FFT convolution, followed by transpose and linear projection. For order=2: v = dropout(v * x[1]), v = fftconv(v, k[0], bias[0]), y = v * x[0], y = transpose(y), y = out_proj(y).
Reported evidence · last observed 2026-08-20. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 16 cases · mean latencyd_model = 256 · hyena_order = 2 · order_minus_1 = 116 cases
Not measured on H100 for this workload. Challenges →
144.5µs82% SOL1.00×Reported · license unknown · no source2026-08-20
Measured exactly what you asked. Reported by source; not independently reproduced.
245.5µs81% SOL1.02×Reported · license unknown · no source2026-07-15
Measured exactly what you asked. Reported by source; not independently reproduced.
346.6µs81% SOL1.05×Reported · license unknown · no source2026-07-25
Measured exactly what you asked. Reported by source; not independently reproduced.
460.7µs76% SOL1.36×Reported · license unknown · no source2026-08-05
Measured exactly what you asked. Reported by source; not independently reproduced.
561.6µs76% SOL1.38×Reported · license unknown · no source2026-08-14
Measured exactly what you asked. Reported by source; not independently reproduced.
661.9µs76% SOL1.39×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
766.0µs75% SOL1.48×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
873.6µs72% SOL1.66×Reported · license unknown · no source2026-08-22
Measured exactly what you asked. Reported by source; not independently reproduced.
975.0µs72% SOL1.69×Reported · license unknown · no source2026-08-16
Measured exactly what you asked. Reported by source; not independently reproduced.
1075.2µs72% SOL1.69×Reported · license unknown · no source2026-07-14
Measured exactly what you asked. Reported by source; not independently reproduced.
1178.0µs71% SOL1.75×Reported · license unknown · no source2026-08-12
Measured exactly what you asked. Reported by source; not independently reproduced.
1290.9µs68% SOL2.04×Reported · license unknown · no source2026-08-06
Measured exactly what you asked. Reported by source; not independently reproduced.
1395.9µs67% SOL2.16×Reported · license unknown · no source2026-07-11
Measured exactly what you asked. Reported by source; not independently reproduced.
14117.4µs62% SOL2.64×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
15166.7µs54% SOL3.75×Reported · license unknown · no source2026-07-26
Measured exactly what you asked. Reported by source; not independently reproduced.
16242.5µs44% SOL5.45×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.