Skip to content
KernelIndex
Search⌘K

ConvNeXtV2 layer with NHWC persistence backward

32 eligible runs
other

Backward pass for ConvNextV2 layer with NHWC persistence. Computes gradients through: residual addition, drop path, permutations, linear projections, GRN (Global Response Normalization), GELU activation, LayerNorm, and depthwise 7x7 convolution.

Fastest reported
174.4µsmean · 75% of SOL
Amir M. Mir | SF TensorLicense unknown · unknown

Reported evidence · last observed 2026-07-24. Reported by source; not independently reproduced. No public source. License unknown.

No public sourceRun detail →

Current records

Workloadsuite of 14 cases · mean latencyc = 128 · c4 = 51214 cases

Not measured on H100 for this workload. Challenges →

Source-native comparison · GPU NVIDIA B200 · Workload suite of 14 cases · mean latency · Protocol SOL-ExecBench evaluation stack v1.1 · mean · 25 results · last observed 2026-08-15Record history →
#
Implementation
Latency
vs #1
Trust
Observed
1
174.4µs75% SOL
1.00×
Reported · license unknown · no source
2026-07-24

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
2
183.2µs74% SOL
1.05×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
3
214.6µs71% SOL
1.23×
Reported · license unknown · no source
2026-07-16

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
4
218.4µs70% SOL
1.25×
Reported · license unknown · no source
2026-08-15

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
5
219.2µs70% SOL
1.26×
Reported · license unknown · no source
2026-08-15

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
6
219.5µs71% SOL
1.26×
Reported · license unknown · no source
2026-07-17

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
7
223.5µs70% SOL
1.28×
Reported · license unknown · no source
2026-08-15

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
8
237.3µs69% SOL
1.36×
Reported · license unknown · no source
2026-08-14

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
9
258.3µs67% SOL
1.48×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
10
266.7µs66% SOL
1.53×
Reported · license unknown · no source
2026-07-20

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
11
275.8µs66% SOL
1.58×
Reported · license unknown · no source
2026-07-11

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
12
294.6µs64% SOL
1.69×
Reported · license unknown · no source
2026-08-14

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
13
338.3µs61% SOL
1.94×
Reported · license unknown · no source
2026-07-12

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
14
342.0µs61% SOL
1.96×
Reported · license unknown · no source
2026-08-13

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
15
420.9µs55% SOL
2.41×
Reported · license unknown · no source
2026-08-12

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
16
493.5µs52% SOL
2.83×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
17
534.0µs49% SOL
3.06×
Reported · license unknown · no source
2026-08-11

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
18
561.9µs48% SOL
3.22×
Reported · license unknown · no source
2026-08-08

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
19
664.7µs44% SOL
3.81×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
20
804.5µs40% SOL
4.61×
Reported · license unknown · no source
2026-08-07

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
21
888.2µs38% SOL
5.09×
Reported · license unknown · no source
2026-07-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
22
923.7µs37% SOL
5.30×
Reported · license unknown · no source
2026-08-11

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
23
1.26ms30% SOL
7.25×
Reported · license unknown · no source
2026-08-12

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
24
1.81ms25% SOL
10.38×
Reported · license unknown · no source
2026-08-09

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →
25
2.14ms20% SOL
12.27×
Reported · license unknown · no source
2026-08-10

Measured exactly what you asked. Reported by source; not independently reproduced.

no sourcelicense unknownno install recipeRun detail →

Implementations

Implementation
Runtime
Best latency
Evidence
Availability
unknown
181.2µs
1.04×
Reported
license unknown · no source
unknown
214.6µs
1.23×
Reported
license unknown · no source
unknown
218.4µs
1.25×
Reported
license unknown · no source
unknown
219.2µs
1.26×
Reported
license unknown · no source
unknown
223.5µs
1.28×
Reported
license unknown · no source
unknown
237.3µs
1.36×
Reported
license unknown · no source
unknown
255.1µs
1.46×
Reported
license unknown · no source
unknown
275.8µs
1.58×
Reported
license unknown · no source
Show all 32 implementations ›
unknown
431.8µs
2.48×
Reported
license unknown · no source
unknown
852.1µs
4.89×
Reported
license unknown · no source
unknown
855.6µs
4.91×
Reported
license unknown · no source
unknown
258.3µs
1.48×
Reported
license unknown · no source
unknown
266.7µs
1.53×
Reported
license unknown · no source
unknown
294.6µs
1.69×
Reported
license unknown · no source
unknown
338.3µs
1.94×
Reported
license unknown · no source
unknown
342.0µs
1.96×
Reported
license unknown · no source
unknown
351.0µs
2.01×
Reported
license unknown · no source
unknown
420.9µs
2.41×
Reported
license unknown · no source
unknown
493.5µs
2.83×
Reported
license unknown · no source
unknown
534.0µs
3.06×
Reported
license unknown · no source
unknown
557.2µs
3.20×
Reported
license unknown · no source
unknown
561.9µs
3.22×
Reported
license unknown · no source
unknown
664.7µs
3.81×
Reported
license unknown · no source
unknown
804.5µs
4.61×
Reported
license unknown · no source
unknown
888.2µs
5.09×
Reported
license unknown · no source
unknown
923.7µs
5.30×
Reported
license unknown · no source
unknown
1.26ms
7.25×
Reported
license unknown · no source
unknown
1.81ms
10.38×
Reported
license unknown · no source
unknown
2.14ms
12.27×
Reported
license unknown · no source
unknown
174.4µs
1.00×
Reported
license unknown · no source
unknown
183.2µs
1.05×
Reported
license unknown · no source
unknown
219.5µs
1.26×
Reported
license unknown · no source

Semantics

Inputs and outputs
grad_outputfp32 [b, c, h, w]
residualfp32 [b, c, h, w]
x_dwconvfp32 [b, c, h, w]
x_nhwcfp32 [b, h, w, c]
meanfp32 [b, h, w, 1]
varfp32 [b, h, w, 1]
x_normalizedfp32 [b, h, w, c]
x_lnfp32 [b, h, w, c]
x_expandedfp32 [b, h, w, c4]
x_gelufp32 [b, h, w, c4]
global_featuresfp32 [b, 1, 1, c4]
gf_meanfp32 [b, 1, 1, 1]
norm_featuresfp32 [b, 1, 1, c4]
x_grn_scaledfp32 [b, h, w, c4]
x_grnfp32 [b, h, w, c4]
dwconv_weightfp32 [c, 1, 7, 7]
layernorm_weightfp32 [c]
pwconv1_weightfp32 [c4, c]
grn_weightfp32 [1, 1, 1, c4]
pwconv2_weightfp32 [c, c4]
drop_maskfp32 [b, 1, 1, 1]
drop_path_probfp32 scalar
epsfp32 scalar
grad_xfp32 [b, c, h, w]
grad_dwconv_weightfp32 [c, 1, 7, 7]
grad_dwconv_biasfp32 [c]
grad_layernorm_weightfp32 [c]
grad_layernorm_biasfp32 [c]
grad_pwconv1_weightfp32 [c4, c]
grad_pwconv1_biasfp32 [c4]
grad_grn_weightfp32 [1, 1, 1, c4]
grad_grn_biasfp32 [1, 1, 1, c4]
grad_pwconv2_weightfp32 [c, c4]
grad_pwconv2_biasfp32 [c]
Axes and behavior
bvariable
cconstant = 128
hvariable
wvariable
c4c4 = c * 4
determinismunspecified
constraintsNo mutation or aliasing
Identity
alias036_convnextv2_layer_with_nhwc_persistence_backwardmodelconvnextv2-base-22k-224sha25650d3f56e16ef…
Sources: NVIDIA SOL-ExecBench (2026-08-15)last observed 2026-08-15How records are decidedJSON