Search · KernelIndex

Skip to content

Search Models Records GPUs Docs

More

Records GPUs Docs

Kernels Serving

⏎

Feed Serving Projects Challenges Contribute Sources Methodology Legal GitHub Atom llms.txta46b010

Kernels Serving

⏎

Trygemm B200 bf16 moe B200 bf16or filter withgpu:B200dtype:bf16shape:[2048,4096]model:deepseek-v3Query syntax

Browse the index

44 rows with ranked runs · 25,513 kernel runssorted byMost indexedRecently active A–Z

All families gemm moe rmsnorm gqa-paged-attention other mla-attention rope gemv

Operation

Family

Published runs

Last run

RMSNorm h128rmsnorm1842026-08-19 Fused add RMSNorm h4096rmsnorm1652026-08-21 Fused add RMSNorm h2048rmsnorm1312026-08-24 RMSNorm h4096rmsnorm1312026-08-21 Fused add RMSNorm h7168rmsnorm1122026-08-15 RMSNorm h7168rmsnorm1032026-08-21 RMSNorm h1536rmsnorm992026-08-21 RMSNorm h512rmsnorm932026-08-21 RMSNorm h2048rmsnorm922026-08-21 Attention QKV with QK norm single kernel backwardrmsnorm652026-08-24 Fused add + RMSNormrmsnorm542026-04-07 Embedding with initial LayerNorm backwardrmsnorm532026-08-17 RMS normrmsnorm512026-08-23 Fused RoPE with QK norm and KV cache updatermsnorm502026-08-20 VAE conv3x3 GroupNorm SiLU residual fusedrmsnorm502026-08-24 RMSNorm, Megatron layoutrmsnorm452026-06-10 Grouped query attention with RoPE and QK normrmsnorm422026-08-19 Fused residual RMS norm backwardrmsnorm372026-08-24 Fused final layer upsample with adaptive normrmsnorm362026-08-23 Fused vision multihead attention with norms backwardrmsnorm362026-08-22 RMSNormrmsnorm362024-09-03 Adaptive instance normalization 2d backwardrmsnorm352026-08-24 Fused GQA QKV RoPE QK norm backwardrmsnorm342026-08-23 Fused encoder final norm to decoder cross attention KV projectionrmsnorm332026-08-23 NVFP4 fused decoder layer pre norm attentionrmsnorm332026-08-23 Flux output norm projection chainrmsnorm322026-08-16 Post norm residualrmsnorm312026-08-18 Adaptive LayerNorm continuous with modulationrmsnorm302026-08-23 GQA attention with QK normrmsnorm302026-08-20 Attention with QK norm and RoPErmsnorm292026-08-23 Audio attention QKV projection with normalizationrmsnorm292026-08-24 Flux multi head RMSNorm QKrmsnorm292026-08-23 Group norm fusionrmsnorm292026-08-24 QK norm scaled dot product attentionrmsnorm282026-08-21 QK norm RoPE attention core backwardrmsnorm272026-08-22 Grouped query attention with YaRN RoPE and QK normrmsnorm262026-08-19 VAE attention block with GroupNormrmsnorm252026-08-18 MTP shifted embedding with dual RMS norm fusionrmsnorm242026-08-18 Encoder layer dual residual norm chainrmsnorm232026-08-23 Flux ada layer norm zero modulation extractionrmsnorm232026-08-24 Altup hidden state collapse with magnitude normalizationrmsnorm222026-08-13 Decoder layer pre post norm residualrmsnorm212026-08-21 Fused add RMSNorm h5120rmsnorm102026-03-26 RMSNormrmsnorm42026-03-05 Fused add RMSNorm h3072rmsnormnone yet—Fused add RMSNorm h5376rmsnormnone yet—RMSNorm h3072rmsnormnone yet—RMSNorm h5120rmsnormnone yet—RMSNorm h5376rmsnormnone yet—

9 folded into an equivalent definition · 5 indexed without runs · How counting works

Ranked only against runs that measured the same thing.