Reported evidence · last observed 2024-11-22. Reported by source; not independently reproduced.
pip install "liger-kernel==0.4.2"Faster under a different protocol, not comparable here: 56.0 ms View →
The query left these dimensions open; this is the most-measured of 2 cohorts. The hardware chips above switch it.
Close matches. Each row lists what differs.
Differs from the request. tokens: requested 4096, observed 8192. Reported by source; not independently reproduced.
Differs from the request. tokens: requested 4096, observed 8192. Reported by source; not independently reproduced.
Differs from the request. tokens: requested 4096, observed 16384. Reported by source; not independently reproduced.
Differs from the request. tokens: requested 4096, observed 16384. Reported by source; not independently reproduced.
Differs from the request. tokens: requested 4096, observed 32768. Reported by source; not independently reproduced.
Differs from the request. tokens: requested 4096, observed 32768. Reported by source; not independently reproduced.
Missing a kernel here? Evidence submissions open with the contribution beta.
Liger-Kernel benchmarks · last observed 2024-11-22