Skip to content
KernelIndex
Search⌘K

Transformers

Hugging Face Transformers · python · Apache-2.0
holds 7 records

Use it

Source available upstream · Apache-2.0View source →

No install recipe recorded for this revision.

interfacepython
Compatibility
measured onNVIDIA H100, NVIDIA A100
declared hardwaredeclared only
architectures—
dtypes

Benchmark evidence

25 measurements across 2 GPUs, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
LayerNormfp32 · [4096, 1024]
NVIDIA H100
23.6µs
#2 of 2
2025-07-17
LayerNormfp32 · [4096, 1024]
NVIDIA A100
34.1µs
#2 of 2
2024-09-03
LayerNormfp32 · [4096, 2048]
NVIDIA H100
37.3µs
#2 of 2
2025-07-17
LayerNormfp32 · [4096, 2048]
NVIDIA A100
57.3µs
#2 of 2
2024-09-03
LayerNormfp32 · [4096, 1024]
NVIDIA H100
60.5µs
#1 of 2
2025-07-17
LayerNormfp32 · [4096, 4096]
NVIDIA H100
66.2µs
#2 of 2
2025-07-17
LayerNormfp32 · [4096, 1024]
NVIDIA H100
80.3µs
#1 of 2
2025-07-17
LayerNormfp32 · [4096, 2048]
NVIDIA H100
99.7µs
#1 of 2
2025-07-17
LayerNormfp32 · [4096, 1024]
NVIDIA A100
118.8µs
#1 of 2
2024-09-03
LayerNormfp32 · [4096, 4096]
NVIDIA A100
121.8µs
#2 of 2
2024-09-03
Show all 25 measurements ›
LayerNormfp32 · [4096, 2048]
NVIDIA H100
133.2µs
#1 of 2
2025-07-17
LayerNormfp32 · [4096, 8192]
NVIDIA H100
152.7µs
#2 of 2
2025-07-17
LayerNormfp32 · [4096, 4096]
NVIDIA H100
178.8µs
#2 of 2
2025-07-17
LayerNormfp32 · [4096, 2048]
NVIDIA A100
196.6µs
#1 of 2
2024-09-03
LayerNormfp32 · [4096, 4096]
NVIDIA H100
241.8µs
#1 of 2
2025-07-17
LayerNormfp32 · [4096, 8192]
NVIDIA A100
257.6µs
#2 of 2
2024-09-03
LayerNormfp32 · [4096, 16384]
NVIDIA H100
306.8µs
#2 of 2
2025-07-17
LayerNormfp32 · [4096, 8192]
NVIDIA H100
333.7µs
#2 of 2
2025-07-17
LayerNormfp32 · [4096, 4096]
NVIDIA A100
431.4µs
#2 of 2
2024-09-03
LayerNormfp32 · [4096, 8192]
NVIDIA H100
483.3µs
#2 of 2
2025-07-17
LayerNormfp32 · [4096, 16384]
NVIDIA A100
506.7µs
#2 of 2
2024-09-03
LayerNormfp32 · [4096, 16384]
NVIDIA H100
642.4µs
#2 of 2
2025-07-17
LayerNormfp32 · [4096, 8192]
NVIDIA A100
829.6µs
#2 of 2
2024-09-03
LayerNormfp32 · [4096, 16384]
NVIDIA H100
950.6µs
#2 of 2
2025-07-17
LayerNormfp32 · [4096, 16384]
NVIDIA A100
1.62ms
#2 of 2
2024-09-03

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:e9a9711948a0ff290958da13a2a6cc8d9951007fb5a0487fa893439b47d9db98
license declaredApache-2.0
license concludedApache-2.0
imported2026-08-18

Best evidence level for this revision: reported

JSON