flashinfer / wrapper5bddf1
flashinfer_wrapper_5bddf1 · FlashInfer-Bench baselines · python · Apache-2.0
Kernel source · 17 lines ↓holds 4 records
Use it
Vendorable · source mirrored · Apache-2.0View source →
No package. Vendor the mirrored source: 17 lines, Apache-2.0, pinned at da91508.
main.py
curl "https://kernelindex.com/api/v1/implementations/flashinfer-flashinfer-wrapper-5bddf1?include=source"interfacepython
revisionda915083d4c7
symbolrun
pathmain.py
Compatibility
measured onNVIDIA B200
declared hardwareNVIDIA A100, NVIDIA B200, NVIDIA GeForce RTX 4090, NVIDIA H100, NVIDIA H20, NVIDIA H200
architecturesunknown
dtypesbf16
Benchmark evidence
8 measurements across 1 GPU, fastest first.
Operation / workload
Hardware
Latency
Rank
Observed
Reported · How evidence levels are derived →
Source and license
sourcehttps://huggingface.co/datasets/flashinfer-ai/flashinfer-trace
commitda915083d4c7c5e61aa3005e3d17ae488e0fc71c
revision digestsha256:1cc2ba82bc496469c99ffd5947f775678c8a718e92100f3d0e1152e4ca31e32d
license declaredApache-2.0
license concludedApache-2.0
authorsbaseline
imported2026-08-16
Kernel source
main.py17 lines
import torch
import flashinfer
def run(hidden_states, residual, weight):
batch_size, hidden_size = hidden_states.shape
assert hidden_size == 7168
EPS = 1e-6
# FlashInfer's fused_add_rmsnorm modifies hidden_states in-place
flashinfer.norm.fused_add_rmsnorm(hidden_states, residual, weight, EPS)
# Return the modified hidden_states as output
return hidden_states
Source code from FlashInfer-Bench (flashinfer-ai/flashinfer-trace) · Apache-2.0
Best evidence level for this revision: reported
JSON