Skip to content
KernelIndex
Search⌘K

Liger

Liger-Kernel · triton · BSD-2-Clause
holds 23 records

Use it

Installable · pip · pinned to the measured build · BSD-2-ClauseView source →

pip install "liger-kernel==0.5.8"

Pinned: this command installs the newest release the evidence below measured.

interfacetriton
Compatibility
measured onNVIDIA GeForce RTX 3090
declared hardwaredeclared only
architectures—
dtypes

Benchmark evidence

36 measurements across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
Multi-token attentionbf16 · [4] · seq=32
NVIDIA GeForce RTX 3090
17.4µs
#1 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=64
NVIDIA GeForce RTX 3090
18.4µs
#1 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=128
NVIDIA GeForce RTX 3090
23.6µs
#1 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=256
NVIDIA GeForce RTX 3090
43.0µs
#1 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=512
NVIDIA GeForce RTX 3090
126.0µs
#1 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=64
NVIDIA GeForce RTX 3090
237.6µs
#2 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=256
NVIDIA GeForce RTX 3090
259.1µs
#2 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=128
NVIDIA GeForce RTX 3090
297.9µs
#2 of 2
2025-04-28
Multi-token attentionfp32 · [4] · seq=128
NVIDIA GeForce RTX 3090
309.3µs
#2 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=256
NVIDIA GeForce RTX 3090
313.3µs
#2 of 2
2025-04-30
Show all 36 measurements ›
Multi-token attentionfp32 · [4] · seq=32
NVIDIA GeForce RTX 3090
314.4µs
#1 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=64
NVIDIA GeForce RTX 3090
329.0µs
#2 of 2
2025-04-30
Multi-token attentionbf16 · [4] · seq=32
NVIDIA GeForce RTX 3090
334.9µs
#2 of 2
2025-04-28
Multi-token attentionfp32 · [4] · seq=128
NVIDIA GeForce RTX 3090
350.2µs
#1 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=32
NVIDIA GeForce RTX 3090
354.5µs
#2 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=64
NVIDIA GeForce RTX 3090
377.9µs
#1 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=512
NVIDIA GeForce RTX 3090
447.5µs
#1 of 2
2025-04-30
Multi-token attentionbf16 · [4] · seq=512
NVIDIA GeForce RTX 3090
517.1µs
#1 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=1024
NVIDIA GeForce RTX 3090
528.4µs
#1 of 2
2025-04-28
Multi-token attentionfp32 · [4] · seq=256
NVIDIA GeForce RTX 3090
529.4µs
#1 of 2
2025-04-30
Multi-token attentionbf16 · [4] · seq=128
NVIDIA GeForce RTX 3090
540.7µs
#1 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=256
NVIDIA GeForce RTX 3090
563.2µs
#1 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=64
NVIDIA GeForce RTX 3090
621.6µs
#1 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=512
NVIDIA GeForce RTX 3090
643.1µs
#1 of 2
2025-04-28
Multi-token attentionbf16 · [4] · seq=32
NVIDIA GeForce RTX 3090
934.9µs
#2 of 2
2025-04-28
Multi-token attentionfp32 · [4] · seq=512
NVIDIA GeForce RTX 3090
1.73ms
#1 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=1024
NVIDIA GeForce RTX 3090
1.86ms
#1 of 2
2025-04-30
Multi-token attentionbf16 · [4] · seq=1024
NVIDIA GeForce RTX 3090
1.96ms
#1 of 2
2025-04-28
Multi-token attentionfp32 · [4] · seq=128
NVIDIA GeForce RTX 3090
2.09ms
#2 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=32
NVIDIA GeForce RTX 3090
2.11ms
#2 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=256
NVIDIA GeForce RTX 3090
2.14ms
#2 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=64
NVIDIA GeForce RTX 3090
2.17ms
#2 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=512
NVIDIA GeForce RTX 3090
2.28ms
#1 of 2
2025-04-30
Multi-token attentionbf16 · [4] · seq=1024
NVIDIA GeForce RTX 3090
2.48ms
#1 of 2
2025-04-28
Multi-token attentionfp32 · [4] · seq=1024
NVIDIA GeForce RTX 3090
6.47ms
#1 of 2
2025-04-30
Multi-token attentionfp32 · [4] · seq=1024
NVIDIA GeForce RTX 3090
8.31ms
#1 of 2
2025-04-30

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:e1ceb494ae4e51bbeb1012eaf8c69999502f3336c84232c2a9077090ae8afa05
license declaredBSD-2-Clause
license concludedBSD-2-Clause
imported2026-08-20

Best evidence level for this revision: reported

JSON