Skip to content
KernelIndex
Search⌘K

Fused linear GELU GRN linear

36 eligible runs
mlp

Fused MLP pathway for ConvNextV2: expansion linear (dim -> 4*dim), GELU activation, Global Response Normalization (GRN) with L2 norm and channel-wise normalization, and projection linear (4*dim -> dim). Input/output in NHWC format.

Fastest reported
45.5µsmean · 74% of SOL
ac4kLicense unknown · unknown

Reported evidence · last observed 2026-07-10. Reported by source; not independently reproduced. No public source. License unknown.

No public sourceRun detail →

Current records

Workloadsuite of 14 cases · mean latencydim = 128 · hidden_dim = 51214 cases

Not measured on H100 for this workload. Challenges →

Source-native comparison · GPU NVIDIA B200 · Workload suite of 14 cases · mean latency · Protocol SOL-ExecBench evaluation stack v1.1 · mean · 21 results · last observed 2026-08-23Record history →
#
Implementation
Latency
vs #1
Trust
Observed
1
45.5µs74% SOL
1.00×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
2
46.5µs74% SOL
1.02×
Reported · license unknown · no source
2026-07-16

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
3
46.6µs74% SOL
1.02×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
4
47.6µs73% SOL
1.05×
Reported · license unknown · no source
2026-08-15

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
5
47.9µs73% SOL
1.05×
Reported · license unknown · no source
2026-08-14

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
6
49.0µs73% SOL
1.08×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
7
49.3µs72% SOL
1.08×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
8
54.8µs70% SOL
1.20×
Reported · license unknown · no source
2026-07-27

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
9
55.0µs70% SOL
1.21×
Reported · license unknown · no source
2026-08-14

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
10
55.3µs70% SOL
1.21×
Reported · license unknown · no source
2026-07-20

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
11
57.9µs69% SOL
1.27×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
12
61.1µs67% SOL
1.34×
Reported · license unknown · no source
2026-08-23

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
13
61.7µs67% SOL
1.35×
Reported · license unknown · no source
2026-08-12

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
14
61.8µs67% SOL
1.36×
Reported · license unknown · no source
2026-08-11

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
15
64.0µs66% SOL
1.41×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
16
70.2µs64% SOL
1.54×
Reported · license unknown · no source
2026-08-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
17
86.1µs59% SOL
1.89×
Reported · license unknown · no source
2026-08-09

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
18
86.5µs58% SOL
1.90×
Reported · license unknown · no source
2026-08-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
19
89.8µs57% SOL
1.97×
Reported · license unknown · no source
2026-08-07

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
20
108.1µs53% SOL
2.38×
Reported · license unknown · no source
2026-07-24

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
21
219.1µs35% SOL
4.81×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →

Implementations

Implementation
Runtime
Best latency
Evidence
Availability
unknown
44.6µs
1.00×
Reported
license unknown · no source
unknown
45.4µs
1.02×
Reported
license unknown · no source
unknown
47.4µs
1.06×
Reported
license unknown · no source
unknown
47.5µs
1.06×
Reported
license unknown · no source
unknown
47.6µs
1.07×
Reported
license unknown · no source
unknown
54.8µs
1.23×
Reported
license unknown · no source
unknown
55.3µs
1.24×
Reported
license unknown · no source
unknown
57.0µs
1.28×
Reported
license unknown · no source
Show all 36 implementations ›
unknown
61.1µs
1.37×
Reported
license unknown · no source
unknown
107.9µs
2.42×
Reported
license unknown · no source
unknown
183.9µs
4.12×
Reported
license unknown · no source
unknown
214.2µs
4.80×
Reported
license unknown · no source
unknown
356.9µs
8.00×
Reported
license unknown · no source
unknown
47.9µs
1.07×
Reported
license unknown · no source
unknown
49.0µs
1.10×
Reported
license unknown · no source
unknown
49.3µs
1.10×
Reported
license unknown · no source
unknown
55.0µs
1.23×
Reported
license unknown · no source
unknown
57.9µs
1.30×
Reported
license unknown · no source
unknown
61.3µs
1.37×
Reported
license unknown · no source
unknown
61.7µs
1.38×
Reported
license unknown · no source
unknown
61.8µs
1.38×
Reported
license unknown · no source
unknown
64.0µs
1.43×
Reported
license unknown · no source
unknown
70.2µs
1.57×
Reported
license unknown · no source
unknown
86.1µs
1.93×
Reported
license unknown · no source
unknown
86.5µs
1.94×
Reported
license unknown · no source
unknown
89.8µs
2.01×
Reported
license unknown · no source
unknown
90.7µs
2.03×
Reported
license unknown · no source
unknown
92.7µs
2.08×
Reported
license unknown · no source
unknown
108.1µs
2.42×
Reported
license unknown · no source
unknown
139.7µs
3.13×
Reported
license unknown · no source
unknown
159.1µs
3.56×
Reported
license unknown · no source
unknown
198.4µs
4.44×
Reported
license unknown · no source
unknown
219.1µs
4.91×
Reported
license unknown · no source
unknown
46.6µs
1.04×
Reported
license unknown · no source
unknown
45.5µs
1.02×
Reported
license unknown · no source
unknown
46.5µs
1.04×
Reported
license unknown · no source

Semantics

Inputs and outputs
hidden_statesfp32 [batch_size, height, width, dim]
pwconv1_weightfp32 [hidden_dim, dim]
pwconv1_biasfp32 [hidden_dim]
grn_weightfp32 [1, 1, 1, hidden_dim]
grn_biasfp32 [1, 1, 1, hidden_dim]
pwconv2_weightfp32 [dim, hidden_dim]
pwconv2_biasfp32 [dim]
epsfp32 scalar
outputfp32 [batch_size, height, width, dim]
Axes and behavior
dimconstant = 128
widthvariable
heightvariable
batch_sizevariable
hidden_dimconstant = 512
determinismunspecified
constraintsNo mutation or aliasing
Identity
alias045_fused_linear_gelu_grn_linearmodelconvnextv2-base-22k-224sha25619420b720731…
Sources: NVIDIA SOL-ExecBench (2026-08-23)last observed 2026-08-23How records are decidedJSON