Skip to content
KernelIndex
Search⌘K

submission 555492

sissi1165 · python · License unknown

Use it

Vendorable · source mirrored · license unknownView source →

No package. Vendor the mirrored source: 74 lines, June 9 Researcher Reciprocity License v1.0.

submission.py
curl "https://kernelindex.com/api/v1/implementations/kernelbot-causal-conv1d-555492?include=source"
interfacepython
Compatibility
measured onNVIDIA B200
declared hardwareNVIDIA B200
architecturessm_100
dtypesfp32

Benchmark evidence

1 measurement across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
Causal depthwise conv1dsuite of 3 cases
NVIDIA B200
22.1µs
#9 of 36
2026-03-15

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:19b046806927b67c3150c26a0236f0bf88685d9e63e925c8bb4641a225711fd2
license declaredunknown
license concludedunknown
authorssissi1165
imported2026-08-15

Techniques

Extracted from the mirrored source by pattern, never inferred. Each row cites its line.

num-warps = 4_CFG_W4 = helion.Config(block_sizes=[128, 128], num_stages=6, num_warps=4, indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer'])
stages = 6_CFG_W4 = helion.Config(block_sizes=[128, 128], num_stages=6, num_warps=4, indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer'])

Kernel source

submission.py74 lines
#!POPCORN leaderboard causal_conv1d
#!POPCORN gpu B200_Nebius

from task import input_t, output_t

import torch
import helion
import helion.language as hl

# Per-shape configs — will need re-autotuning after kernel rewrite
# Using reasonable defaults for the new kernel structure
_CFG_W4 = helion.Config(block_sizes=[128, 128], num_stages=6, num_warps=4, indexing=['pointer', 'tensor_descriptor', 'pointer', 'pointer'])
_CFG_W3 = helion.Config(block_sizes=[128, 128], num_stages=4, num_warps=4)
_CFG_W8 = helion.Config(block_sizes=[64, 64], num_stages=4, num_warps=4)

SHAPE_CONFIGS: dict[tuple, helion.Config] = {
    # Test shapes (B, D, S, W)
    (1, 64, 64, 4): _CFG_W4,
    (2, 128, 128, 4): _CFG_W4,
    (1, 256, 256, 3): _CFG_W3,
    (1, 128, 64, 8): _CFG_W8,
    (4, 64, 128, 4): _CFG_W4,
    # Benchmark shapes
    (1, 1536, 2048, 4): _CFG_W4,
    (1, 2560, 2048, 4): _CFG_W4,
    (1, 2560, 4096, 4): _CFG_W4,
}


def _make_kernel(config):
    @helion.kernel(static_shapes=True, config=config)
    def causal_conv1d_kernel(
        x: torch.Tensor,
        w: torch.Tensor,
        b: torch.Tensor,
    ) -> torch.Tensor:
        B = x.size(0)
        D = x.size(1)
        S = x.size(2)
        W = hl.specialize(w.size(1))

        y = torch.empty(B, D, S, dtype=x.dtype, device=x.device)

        for rb, rd, rs in hl.tile([B, D, S], block_size=[1, None, None]):
            bi = rb.begin
            # Initialize accumulator with bias
            acc = b[rd].to(torch.float32)[:, None] + hl.zeros([rd, rs], dtype=torch.float32)
            for j in range(W):
                coeff = w[rd, j].to(torch.float32)
                # Causal index: position (s + j - W + 1) in the original x
                # If index < 0, the value is 0 (causal padding)
                src_idx = rs.index + (j - W + 1)
                # Clamp to valid range, then zero out invalid positions
                safe_idx = torch.where(src_idx >= 0, src_idx, torch.zeros_like(src_idx))
                x_val = hl.load(x, [bi, rd, safe_idx]).to(torch.float32)
                x_val = torch.where(src_idx >= 0, x_val, torch.zeros_like(x_val))
                acc = acc + x_val * coeff[:, None]
            y[rb, rd, rs] = acc[None, :, :].to(y.dtype)

        return y
    return causal_conv1d_kernel


_KERNELS = {shape: _make_kernel(cfg) for shape, cfg in SHAPE_CONFIGS.items()}


def custom_kernel(data: input_t) -> output_t:
    x, weight, bias = data
    B, D, S = x.shape
    W = weight.shape[1]
    # No more external padding! Handled inside the kernel
    kernel = _KERNELS[(B, D, S, W)]
    return kernel(x, weight, bias)
scrolls · 74 lines total

Source code from GPU Mode and the KernelBot dataset · June 9 Researcher Reciprocity License v1.0

Best evidence level for this revision: reported

JSON