Skip to content
KernelIndex
Search⌘K
Sign in

Transformers

Hugging Face Transformers · python · Apache-2.0

Use it

Source available upstream · Apache-2.0View source →

No install recipe recorded for this revision.

interfacepython
Compatibility
measured onNVIDIA A100
declared hardwaredeclared only
architectures—
dtypes

Benchmark evidence

24 measurements across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
Rotary position embeddingbf16 · [1, 8, 2048, 16]
NVIDIA A100
79.7µs
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 64]
NVIDIA A100
157.1µs
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 64]
NVIDIA A100
253.6µs
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 16]
NVIDIA A100
264.8µs
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 1024, 256]
NVIDIA A100
280.8µs
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 1024, 256]
NVIDIA A100
330.4µs
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 16]
NVIDIA A100
516.1µs
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 256]
NVIDIA A100
516.1µs
#3 of 4
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 256]
NVIDIA A100
516.8µs
#4 of 4
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 64]
NVIDIA A100
528.9µs
#2 of 2
2024-09-03
Run →
Show all 24 measurements ›
Rotary position embeddingbf16 · [1, 8, 1024, 256]
NVIDIA A100
605.9µs
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 256]
NVIDIA A100
621.4µs
#3 of 4
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 256]
NVIDIA A100
621.5µs
#4 of 4
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 4096, 256]
NVIDIA A100
994.8µs
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 256]
NVIDIA A100
1.13ms
#3 of 4
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 2048, 256]
NVIDIA A100
1.13ms
#4 of 4
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 4096, 256]
NVIDIA A100
1.19ms
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 8192, 256]
NVIDIA A100
1.93ms
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 4096, 256]
NVIDIA A100
2.18ms
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 8192, 256]
NVIDIA A100
2.32ms
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 16384, 256]
NVIDIA A100
3.82ms
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 8192, 256]
NVIDIA A100
4.25ms
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 16384, 256]
NVIDIA A100
4.56ms
#2 of 2
2024-09-03
Run →
Rotary position embeddingbf16 · [1, 8, 16384, 256]
NVIDIA A100
8.37ms
#2 of 2
2024-09-03
Run →

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:459baf6556e5536285c26b26d11eda4980b44d362142461d8e7e5b4f3900ce23
license declaredApache-2.0
license concludedApache-2.0
imported2026-08-18

Best evidence level for this revision: reported

JSON