Skip to content
KernelIndex
Search⌘K

submission 424644

Sheheryar Ahmad · python · License unknown

Use it

Vendorable · source mirrored · license unknownView source →

No package. Vendor the mirrored source: 35 lines, June 9 Researcher Reciprocity License v1.0.

xyz.py
curl "https://kernelindex.com/api/v1/implementations/kernelbot-nvfp4-group-gemm-424644?include=source"
interfacepython
Compatibility
measured onNVIDIA B200
declared hardwareNVIDIA B200
architecturessm_100
dtypesfp8_e4m3, nvfp4

Benchmark evidence

1 measurement across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
NVFP4 group GEMMsuite of 4 cases
NVIDIA B200
1.86ms
#141 of 145
2026-02-02

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:3ba842272fc1fb34061f692c16d0ce4c36403b92dc783936b6b7d30a434b82ae
license declaredunknown
license concludedunknown
authorsSheheryar Ahmad
imported2026-08-26

Kernel source

xyz.py35 lines
# submission.py - Simple correct version
import torch
from task import input_t, output_t
from reference import to_blocked

def custom_kernel(data: input_t) -> output_t:
    """
    Simple implementation that matches the reference exactly.
    Uses torch._scaled_mm for correctness.
    """
    abc_tensors, sfasfb_tensors, sfasfb_reordered_tensors, problem_sizes = data
    
    result_tensors = []
    for i, ((a, b, c), (sfa_ref, sfb_ref), (m, n, k, l)) in enumerate(
        zip(abc_tensors, sfasfb_tensors, problem_sizes)
    ):
        for l_idx in range(l):
            # Convert scale factors to blocked format
            scale_a = to_blocked(sfa_ref[:, :, l_idx])
            scale_b = to_blocked(sfb_ref[:, :, l_idx])
            
            # Use torch's scaled_mm
            res = torch._scaled_mm(
                a[:, :, l_idx].view(torch.float4_e2m1fn_x2),
                b[:, :, l_idx].transpose(0, 1).view(torch.float4_e2m1fn_x2),
                scale_a.cuda(),
                scale_b.cuda(),
                bias=None,
                out_dtype=torch.float16,
            )
            c[:, :, l_idx] = res
        
        result_tensors.append(c)
    
    return result_tensors
scrolls · 35 lines total

Source code from GPU Mode and the KernelBot dataset · June 9 Researcher Reciprocity License v1.0

Best evidence level for this revision: reported

JSON