Skip to content
KernelIndex
Search⌘K
Sign in

torch.compile

PyTorch · python · BSD-3-Clause
holds 19 records

Use it

Source available upstream · BSD-3-ClauseView source →

No install recipe recorded for this revision.

interfacepython
Compatibility
measured onNVIDIA A100
declared hardwaredeclared only
architectures—
dtypes

Benchmark evidence

32 measurements across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
Embedding lookupfp32 · [1024, 768]
NVIDIA A100
39.7µs
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [2048, 768]
NVIDIA A100
46.5µs
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [4096, 768]
NVIDIA A100
54.6µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [8192, 768]
NVIDIA A100
60.2µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [16384, 768]
NVIDIA A100
64.1µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [32768, 768]
NVIDIA A100
66.9µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [65536, 768]
NVIDIA A100
69.0µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [131072, 768]
NVIDIA A100
69.2µs
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [1024, 4096]
NVIDIA A100
257.2µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [2048, 4096]
NVIDIA A100
281.8µs
#2 of 3
2024-09-03
Run →
Show all 32 measurements ›
Embedding lookupfp32 · [8192, 768]
NVIDIA A100
296.1µs
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [2048, 768]
NVIDIA A100
297.8µs
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [4096, 768]
NVIDIA A100
299.2µs
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [1024, 768]
NVIDIA A100
300.1µs
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [4096, 4096]
NVIDIA A100
301.8µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [8192, 4096]
NVIDIA A100
312.6µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [16384, 4096]
NVIDIA A100
319.0µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [65536, 4096]
NVIDIA A100
323.8µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [32768, 4096]
NVIDIA A100
324.2µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [131072, 4096]
NVIDIA A100
325.7µs
#2 of 3
2024-09-03
Run →
Embedding lookupfp32 · [16384, 768]
NVIDIA A100
346.6µs
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [32768, 768]
NVIDIA A100
465.9µs
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [65536, 768]
NVIDIA A100
692.4µs
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [1024, 4096]
NVIDIA A100
1.09ms
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [131072, 768]
NVIDIA A100
1.14ms
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [2048, 4096]
NVIDIA A100
1.19ms
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [4096, 4096]
NVIDIA A100
1.31ms
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [8192, 4096]
NVIDIA A100
1.48ms
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [16384, 4096]
NVIDIA A100
1.79ms
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [32768, 4096]
NVIDIA A100
2.38ms
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [65536, 4096]
NVIDIA A100
3.74ms
#1 of 3
2024-09-03
Run →
Embedding lookupfp32 · [131072, 4096]
NVIDIA A100
5.94ms
#1 of 3
2024-09-03
Run →

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:bb27cb1e7393e31ba48236de3b7335ea2dfbb2a21bac4c24a1da240b9d25c342
license declaredBSD-3-Clause
license concludedBSD-3-Clause
imported2026-08-18

Best evidence level for this revision: reported

JSON