Skip to content
KernelIndex
Search⌘K

submission 649356

Vishal · python · License unknown

Use it

Vendorable · source mirrored · license unknownView source →

No package. Vendor the mirrored source: 33 lines, June 9 Researcher Reciprocity License v1.0.

submission.py
curl "https://kernelindex.com/api/v1/implementations/kernelbot-amd-mxfp4-mm-649356?include=source"
interfacepython
Compatibility
measured onAMD Instinct MI355X
declared hardwareAMD Instinct MI355X
architecturesgfx950
dtypesbf16, mxfp4

Benchmark evidence

1 measurement across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
AMD MXFP4 GEMMsuite of 6 cases
AMD Instinct MI355X
24.1µs
#907 of 1143
2026-03-27

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:6ac7ca00ba0653198394b45bfea5f7084422600f7949cd46773998d7f917722e
license declaredunknown
license concludedunknown
authorsVishal
imported2026-08-26

Kernel source

submission.py33 lines
import torch
import aiter
from aiter import dtypes
from aiter.ops.triton.quant import dynamic_mxfp4_quant
from aiter.utility.fp4_utils import e8m0_shuffle

_CACHE = {}

def custom_kernel(data):
    A, B, B_q, B_shuffle, B_scale_sh = data
    m, k = A.shape
    n = B_shuffle.shape[0]

    k_id = (id(A), id(B_shuffle), id(B_scale_sh), m, n, k)

    if k_id in _CACHE:
        return _CACHE[k_id][3]

    Aq_raw, Asc_raw = dynamic_mxfp4_quant(A)
    A_sh_raw = e8m0_shuffle(Asc_raw)

    out = aiter.gemm_a4w4(
        Aq_raw.view(dtypes.fp4x2),
        B_shuffle,
        A_sh_raw.view(dtypes.fp8_e8m0),
        B_scale_sh,
        dtype=dtypes.bf16,
        bpreshuffle=True,
    )

    _CACHE[k_id] = (A, B_shuffle, B_scale_sh, out)
    return out
scrolls · 33 lines total

Source code from GPU Mode and the KernelBot dataset · June 9 Researcher Reciprocity License v1.0

Best evidence level for this revision: reported

JSON