Reported evidence · last observed 2024-10-09. Reported by source; not independently reproduced.
pip install "liger-kernel==0.3.1"Faster under a different protocol, not comparable here: 26.0 ms View →
The query left these dimensions open; this is the most-measured of 2 cohorts. The hardware chips above switch it.
Close matches. Each row lists what differs.
Differs from the request. tokens: requested 1024, observed 2048. Reported by source; not independently reproduced.
Differs from the request. tokens: requested 1024, observed 2048. Reported by source; not independently reproduced.
Differs from the request. tokens: requested 1024, observed 4096. Reported by source; not independently reproduced.
Differs from the request. tokens: requested 1024, observed 4096. Reported by source; not independently reproduced.
Differs from the request. tokens: requested 1024, observed 8192. Reported by source; not independently reproduced.
Differs from the request. tokens: requested 1024, observed 8192. Reported by source; not independently reproduced.
Missing a kernel here? Evidence submissions open with the contribution beta.
Liger-Kernel benchmarks · last observed 2024-10-09