Flux timestep guidance projection embedding
FLUX's combined timestep and text projection embeddings that process timestep through sinusoidal embeddings, then concatenate with pooled text projections and project to inner dimension. This generates the conditioning signal (temb) that modulates all transformer blocks through adaptive layer normalization. The operation involves: (1) timestep scaling by 1000, (2) sinusoidal position embedding generation with frequencies, (3) MLP projection of timestep embeddings, (4) linear projection of pooled text embeddings, (5) addition to produce final conditioning vector.
Reported evidence · last observed 2026-08-19. Reported by source; not independently reproduced. No public source. License unknown.
Current records
Workloadsuite of 16 cases · mean latencyinner_dim = 3072 · time_embed_dim = 768 · half_time_embed_dim = 384 · pooled_projection_dim = 76816 cases
Not measured on H100 for this workload. Challenges →
127.1µs86% SOL1.00×Reported · license unknown · no source2026-08-19
Measured exactly what you asked. Reported by source; not independently reproduced.
228.2µs85% SOL1.04×Reported · license unknown · no source2026-08-24
Measured exactly what you asked. Reported by source; not independently reproduced.
332.5µs83% SOL1.20×Reported · license unknown · no source2026-07-30
Measured exactly what you asked. Reported by source; not independently reproduced.
432.8µs83% SOL1.21×Reported · license unknown · no source2026-08-05
Measured exactly what you asked. Reported by source; not independently reproduced.
535.9µs82% SOL1.32×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
636.6µs81% SOL1.35×Reported · license unknown · no source2026-07-11
Measured exactly what you asked. Reported by source; not independently reproduced.
736.8µs82% SOL1.36×Reported · license unknown · no source2026-07-17
Measured exactly what you asked. Reported by source; not independently reproduced.
836.9µs81% SOL1.36×Reported · license unknown · no source2026-08-16
Measured exactly what you asked. Reported by source; not independently reproduced.
942.2µs79% SOL1.56×Reported · license unknown · no source2026-07-19
Measured exactly what you asked. Reported by source; not independently reproduced.
1048.9µs77% SOL1.80×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
1152.8µs75% SOL1.95×Reported · license unknown · no source2026-07-10
Measured exactly what you asked. Reported by source; not independently reproduced.
1262.6µs72% SOL2.31×Reported · license unknown · no source2026-08-08
Measured exactly what you asked. Reported by source; not independently reproduced.
1374.5µs68% SOL2.75×Reported · license unknown · no source2026-08-12
Measured exactly what you asked. Reported by source; not independently reproduced.