Skip to content
KernelIndex
Search⌘K

submission 16190

KernelBot user 7 · python · License unknown

Use it

Vendorable · source mirrored · license unknownView source →

No package. Vendor the mirrored source: 1 lines, June 9 Researcher Reciprocity License v1.0.

amd-fp8-mm-hip-v12.py
curl "https://kernelindex.com/api/v1/implementations/kernelbot-amd-fp8-mm-16190?include=source"
interfacepython
Compatibility
measured onAMD Instinct MI300X
declared hardwareAMD Instinct MI300X
architecturesgfx942
dtypesfp32, fp8_e4m3fnuz

Benchmark evidence

18 measurements across 1 GPU, fastest first.

Operation / workload
Hardware
Latency
Rank
Observed
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [1024, 256]
AMD Instinct MI300X
49.9µs
#59 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [1024, 512]
AMD Instinct MI300X
53.0µs
#61 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [1024, 1536]
AMD Instinct MI300X
82.6µs
#59 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [6144, 256]
AMD Instinct MI300X
112.5µs
#41 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [6144, 512]
AMD Instinct MI300X
121.6µs
#46 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [1024, 7168] · n=576 · seed=12346
AMD Instinct MI300X
135.2µs
#58 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [1024, 7168] · n=512 · seed=6563
AMD Instinct MI300X
136.2µs
#56 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [1024, 2048]
AMD Instinct MI300X
173.4µs
#71 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [1024, 7168] · n=1536 · seed=8135
AMD Instinct MI300X
178.1µs
#58 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [1024, 2304]
AMD Instinct MI300X
196.2µs
#71 of 98
2025-05-05
Show all 18 measurements ›
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [6144, 1536]
AMD Instinct MI300X
226.1µs
#68 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [1024, 7168] · n=4608 · seed=7531
AMD Instinct MI300X
408.0µs
#74 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [6144, 7168] · n=512 · seed=12341
AMD Instinct MI300X
510.5µs
#79 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [6144, 7168] · n=576 · seed=9863
AMD Instinct MI300X
510.6µs
#77 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [6144, 2048]
AMD Instinct MI300X
528.9µs
#54 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [6144, 2304]
AMD Instinct MI300X
634.1µs
#61 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [6144, 7168] · n=1536 · seed=6543
AMD Instinct MI300X
731.8µs
#74 of 98
2025-05-05
AMD FP8 blockwise GEMMfp32/fp8_e4m3fnuz · [6144, 7168] · n=4608 · seed=65436
AMD Instinct MI300X
1.39ms
#65 of 98
2025-05-05

Reported · How evidence levels are derived →

Source and license

sourceavailable
revision digestsha256:40bfe394aa66a192cdc1b122742ce8faf2f1d71983d131a25c59c71f80c8b5c3
license declaredunknown
license concludedunknown
imported2026-08-15

Kernel source

amd-fp8-mm-hip-v12.py1 lines
IyBUaGlzIHNjcmlwdCBwcm92aWRlcyBhIHRlbXBsYXRlIGZvciB1c2luZyBsb2FkX2lubGluZSB0byBydW4gYSBISVAga2VybmVsIGZvcg0KZnJvbSB0b3JjaC51dGlscy5jcHBfZXh0ZW5zaW9uIGltcG9ydCBsb2FkX2lubGluZQ0KZnJvbSB0YXNrIGltcG9ydCBpbnB1dF90LCBvdXRwdXRfdA0KQ1BQX1dSQVBQRVIgPSAiIiINCnZvaWQgZnA4X21tKHRvcmNoOjpUZW5zb3IgYSwgdG9yY2g6OlRlbnNvciBiLCB0b3JjaDo6VGVuc29yIGFzLCB0b3JjaDo6VGVuc29yIGJzLCB0b3JjaDo6VGVuc29yIGMpOw0KIiIiDQoNCkNVREFfU1JDID0gIiIiDQojaW5jbHVkZSA8aGlwL2hpcF9ydW50aW1lLmg+DQojaW5jbHVkZSA8aGlwL2FtZF9kZXRhaWwvYW1kX2hpcF9mcDguaD4NCiNpbmNsdWRlIDxoaXAvYW1kX2RldGFpbC9hbWRfaGlwX2JmMTYuaD4NCg0KY29uc3RleHByIGNvbnN0IGludCBCTE9DSyA9IDEyODsNCg0KX19nbG9iYWxfXyB2b2lkIGN1c3RvbV9rZXJuZWwoY29uc3QgX19oaXBfZnA4X2U0bTNfZm51eiogYSwgY29uc3QgX19oaXBfZnA4X2U0bTNfZm51eiogYiwgY29uc3QgZmxvYXQqIGFzLCBjb25zdCBmbG9hdCogYnMsDQogICAgICAgICAgICAgICAgICAgX19oaXBfYmZsb2F0MTYqIGMsIGludCBtLCBpbnQgbiwgaW50IGspIHsNCg0KICAgIC8vIFlvdXIgaW1wbGVtZW50YXRpb24gaGVyZQ0KICAgIC8vIGludCBjeCA9IHRocmVhZElkeC54ICsgYmxvY2tEaW0ueCAqIGJsb2NrSWR4Lng7DQogICAgLy8gaW50IGN5ID0gdGhyZWFkSWR4LnkgKyBibG9ja0RpbS55ICogYmxvY2tJZHgueTsNCiAgICAvLyBpZihjeCA+PSBtIHx8IGN5ID49IG4pIHJldHVybjsNCg0KICAgIHVzaW5nIGZsb2F0NCA9IGZsb2F0IF9fYXR0cmlidXRlX18oKGV4dF92ZWN0b3JfdHlwZSg0KSkpOw0KDQogICAgX19zaGFyZWRfXyBsb25nIGxkc19hWzY0XVsxN107DQogICAgX19zaGFyZWRfXyBsb25nIGxkc19iWzY0XVsxN107DQoNCiAgICBpbnQgdGhyZWFkX2Jsb2NrX20gPSBibG9ja0lkeC54ICogNjQ7DQogICAgaW50IHRocmVhZF9ibG9ja19uID0gYmxvY2tJZHgueSAqIDY0Ow0KDQogICAgaW50IHdhdmVfbSA9ICh0aHJlYWRJZHgueSAvIDIpICogMTY7DQogICAgaW50IHdhdmVfbiA9ICh0aHJlYWRJZHgueSAlIDIpICogMzI7DQoNCiAgICBpbnQgdGhyZWFkX2NfbSA9ICh0aHJlYWRJZHgueCAvIDE2KSAqIDQ7DQogICAgaW50IHRocmVhZF9jX24gPSAgdGhyZWFkSWR4LnggJSAxNjsgLy8gYnkgZmxvYXQNCg0KICAgIGludCBjcF9zaGFyZWRfbW4gPSB0aHJlYWRJZHgueSAqIDggKyB0aHJlYWRJZHgueCAvIDg7DQogICAgaW50IGNwX3NoYXJlZF9rICA9ICh0aHJlYWRJZHgueCAlIDgpICogMjsgLy8gYnkgbG9uZw0KDQogICAgaW50IGNwX2dsb2JhbF9tID0gdGhyZWFkX2Jsb2NrX20gKyBjcF9zaGFyZWRfbW47DQogICAgaW50IGNwX2dsb2JhbF9uID0gdGhyZWFkX2Jsb2NrX24gKyBjcF9zaGFyZWRfbW47DQogICAgaW50IGNwX2dsb2JhbF9rID0gY3Bfc2hhcmVkX2s7DQoNCiAgICBpbnQgaXNfbGdkX2EgPSBjcF9nbG9iYWxfbSA8IG07DQogICAgaW50IGlzX2xnZF9iID0gY3BfZ2xvYmFsX24gPCBuOw0KDQogICAgaW50IGxkc19tID0gd2F2ZV9tICsgdGhyZWFkSWR4LnggJSAxNjsNCiAgICBpbnQgbGRzX24gPSB3YXZlX24gKyB0aHJlYWRJZHgueCAlIDE2Ow0KICAgIGludCBsZHNfayA9IHRocmVhZElkeC54IC8gMTY7IC8vIGJ5IGxvbmcNCg0KICAgIGludCBjX20gPSB0aHJlYWRfYmxvY2tfbSArIHdhdmVfbSArIHRocmVhZF9jX207DQogICAgaW50IGNfbiA9IHRocmVhZF9ibG9ja19uICsgd2F2ZV9uICsgdGhyZWFkX2NfbjsNCg0KICAgIGZsb2F0NCAqYV9wdHIgPSAmKCgoZmxvYXQ0ICopYSlbY3BfZ2xvYmFsX20gKiBrLzE2ICsgY3BfZ2xvYmFsX2svMl0pOw0KICAgIGZsb2F0NCAqYl9wdHIgPSAmKCgoZmxvYXQ0ICopYilbY3BfZ2xvYmFsX24gKiBrLzE2ICsgY3BfZ2xvYmFsX2svMl0pOw0KDQogICAgZmxvYXQ0IHRpbGVfZFsyXSA9IHswfTsNCg0KICAgIGludCBhc19tID0gIHRocmVhZF9ibG9ja19tICsgd2F2ZV9tICsgdGhyZWFkX2NfbTsNCiAgICBpbnQgYnNfbiA9ICh0aHJlYWRfYmxvY2tfbiArIHdhdmVfbiArIHRocmVhZF9jX24pIC8gQkxPQ0s7DQogICAgZmxvYXQgKmFzX3B0ciA9IChmbG9hdCopJmFzW2FzX21dOw0KICAgIGZsb2F0ICpic19wdHIgPSAoZmxvYXQqKSZic1tic19uXTsNCg0KICAgIGZvciAoaW50IGliID0gMDsgaWIgPCBrL0JMT0NLOyBpYisrKSB7DQogICAgICAgIGZsb2F0NCBsZGdfYSA9IGlzX2xnZF9hID8gYV9wdHJbMF0gOiAwOw0KICAgICAgICBmbG9hdDQgbGRnX2IgPSBpc19sZ2RfYiA/IGJfcHRyWzBdIDogMDsNCiAgICAgICAgYV9wdHIgKz0gODsNCiAgICAgICAgYl9wdHIgKz0gODsNCiAgICAgICAgZmxvYXQ0IHRoaXNfYXMgPSAqKGZsb2F0NCAqKSgmYXNfcHRyWzBdKTsNCiAgICAgICAgZmxvYXQgIHRoaXNfYnMgPSBic19wdHJbMF07DQogICAgICAgIGFzX3B0ciArPSBtOw0KICAgICAgICBic19wdHIgKz0gKG4rQkxPQ0stMSkvQkxPQ0s7DQogICAgICAgICooZmxvYXQ0ICopKCZsZHNfYVtjcF9zaGFyZWRfbW5dW2NwX3NoYXJlZF9rXSkgPSBsZGdfYTsNCiAgICAgICAgKihmbG9hdDQgKikoJmxkc19iW2NwX3NoYXJlZF9tbl1bY3Bfc2hhcmVkX2tdKSA9IGxkZ19iOw0KICAgICAgICBfX3N5bmN0aHJlYWRzKCk7DQogICAgICAgIGZsb2F0NCBibG9ja190aWxlX2RbMl0gPSB7MH07DQogICAgICAgIGJsb2NrX3RpbGVfZFswXSA9IF9fYnVpbHRpbl9hbWRnY25fbWZtYV9mMzJfMTZ4MTZ4MzJfZnA4X2ZwOChsZHNfYVtsZHNfbV1bbGRzX2sgKyAgMF0sIGxkc19iW2xkc19uXVtsZHNfayArICAwXSwgYmxvY2tfdGlsZV9kWzBdLCAwLCAwLCAwKTsNCiAgICAgICAgYmxvY2tfdGlsZV9kWzBdID0gX19idWlsdGluX2FtZGdjbl9tZm1hX2YzMl8xNngxNngzMl9mcDhfZnA4KGxkc19hW2xkc19tXVtsZHNfayArICA0XSwgbGRzX2JbbGRzX25dW2xkc19rICsgIDRdLCBibG9ja190aWxlX2RbMF0sIDAsIDAsIDApOw0KICAgICAgICBibG9ja190aWxlX2RbMF0gPSBfX2J1aWx0aW5fYW1kZ2NuX21mbWFfZjMyXzE2eDE2eDMyX2ZwOF9mcDgobGRzX2FbbGRzX21dW2xkc19rICsgIDhdLCBsZHNfYltsZHNfbl1bbGRzX2sgKyAgOF0sIGJsb2NrX3RpbGVfZFswXSwgMCwgMCwgMCk7DQogICAgICAgIGJsb2NrX3RpbGVfZFswXSA9IF9fYnVpbHRpbl9hbWRnY25fbWZtYV9mMzJfMTZ4MTZ4MzJfZnA4X2ZwOChsZHNfYVtsZHNfbV1bbGRzX2sgKyAxMl0sIGxkc19iW2xkc19uXVtsZHNfayArIDEyXSwgYmxvY2tfdGlsZV9kWzBdLCAwLCAwLCAwKTsNCiAgICAgICAgdGlsZV9kWzBdWzBdICs9IGJsb2NrX3RpbGVfZFswXVswXSAqIHRoaXNfYXNbMF0gKiB0aGlzX2JzOw0KICAgICAgICB0aWxlX2RbMF1bMV0gKz0gYmxvY2tfdGlsZV9kWzBdWzFdICogdGhpc19hc1sxXSAqIHRoaXNfYnM7DQogICAgICAgIHRpbGVfZFswXVsyXSArPSBibG9ja190aWxlX2RbMF1bMl0gKiB0aGlzX2FzWzJdICogdGhpc19iczsNCiAgICAgICAgdGlsZV9kWzBdWzNdICs9IGJsb2NrX3RpbGVfZFswXVszXSAqIHRoaXNfYXNbM10gKiB0aGlzX2JzOw0KICAgICAgICBibG9ja190aWxlX2RbMV0gPSBfX2J1aWx0aW5fYW1kZ2NuX21mbWFfZjMyXzE2eDE2eDMyX2ZwOF9mcDgobGRzX2FbbGRzX21dW2xkc19rICsgIDBdLCBsZHNfYltsZHNfbisxNl1bbGRzX2sgKyAgMF0sIGJsb2NrX3RpbGVfZFsxXSwgMCwgMCwgMCk7DQogICAgICAgIGJsb2NrX3RpbGVfZFsxXSA9IF9fYnVpbHRpbl9hbWRnY25fbWZtYV9mMzJfMTZ4MTZ4MzJfZnA4X2ZwOChsZHNfYVtsZHNfbV1bbGRzX2sgKyAgNF0sIGxkc19iW2xkc19uKzE2XVtsZHNfayArICA0XSwgYmxvY2tfdGlsZV9kWzFdLCAwLCAwLCAwKTsNCiAgICAgICAgYmxvY2tfdGlsZV9kWzFdID0gX19idWlsdGluX2FtZGdjbl9tZm1hX2YzMl8xNngxNngzMl9mcDhfZnA4KGxkc19hW2xkc19tXVtsZHNfayArICA4XSwgbGRzX2JbbGRzX24rMTZdW2xkc19rICsgIDhdLCBibG9ja190aWxlX2RbMV0sIDAsIDAsIDApOw0KICAgICAgICBibG9ja190aWxlX2RbMV0gPSBfX2J1aWx0aW5fYW1kZ2NuX21mbWFfZjMyXzE2eDE2eDMyX2ZwOF9mcDgobGRzX2FbbGRzX21dW2xkc19rICsgMTJdLCBsZHNfYltsZHNfbisxNl1bbGRzX2sgKyAxMl0sIGJsb2NrX3RpbGVfZFsxXSwgMCwgMCwgMCk7DQogICAgICAgIHRpbGVfZFsxXVswXSArPSBibG9ja190aWxlX2RbMV1bMF0gKiB0aGlzX2FzWzBdICogdGhpc19iczsNCiAgICAgICAgdGlsZV9kWzFdWzFdICs9IGJsb2NrX3RpbGVfZFsxXVsxXSAqIHRoaXNfYXNbMV0gKiB0aGlzX2JzOw0KICAgICAgICB0aWxlX2RbMV1bMl0gKz0gYmxvY2tfdGlsZV9kWzFdWzJdICogdGhpc19hc1syXSAqIHRoaXNfYnM7DQogICAgICAgIHRpbGVfZFsxXVszXSArPSBibG9ja190aWxlX2RbMV1bM10gKiB0aGlzX2FzWzNdICogdGhpc19iczsNCiAgICAgICAgX19zeW5jdGhyZWFkcygpOw0KICAgIH0NCg0KICAgIC8vIGZpbmFsbHksIHdyaXRlIHRoZSByZXN1bHQgYXMgYmYxNg0KICAgIGNbKGNfbSArIDApICogbiArIGNfbl0gPSAoX19oaXBfYmZsb2F0MTYpKHRpbGVfZFswXVswXSk7DQogICAgY1soY19tICsgMSkgKiBuICsgY19uXSA9IChfX2hpcF9iZmxvYXQxNikodGlsZV9kWzBdWzFdKTsNCiAgICBjWyhjX20gKyAyKSAqIG4gKyBjX25dID0gKF9faGlwX2JmbG9hdDE2KSh0aWxlX2RbMF1bMl0pOw0KICAgIGNbKGNfbSArIDMpICogbiArIGNfbl0gPSAoX19oaXBfYmZsb2F0MTYpKHRpbGVfZFswXVszXSk7DQogICAgY1soY19tICsgMCkgKiBuICsgY19uICsgMTZdID0gKF9faGlwX2JmbG9hdDE2KSh0aWxlX2RbMV1bMF0pOw0KICAgIGNbKGNfbSArIDEpICogbiArIGNfbiArIDE2XSA9IChfX2hpcF9iZmxvYXQxNikodGlsZV9kWzFdWzFdKTsNCiAgICBjWyhjX20gKyAyKSAqIG4gKyBjX24gKyAxNl0gPSAoX19oaXBfYmZsb2F0MTYpKHRpbGVfZFsxXVsyXSk7DQogICAgY1soY19tICsgMykgKiBuICsgY19uICsgMTZdID0gKF9faGlwX2JmbG9hdDE2KSh0aWxlX2RbMV1bM10pOw0KfQ0KDQp2b2lkIGZwOF9tbSh0b3JjaDo6VGVuc29yIGEsIHRvcmNoOjpUZW5zb3IgYiwgdG9yY2g6OlRlbnNvciBhcywgdG9yY2g6OlRlbnNvciBicywgdG9yY2g6OlRlbnNvciBjKSB7DQogICAgaW50IG0gPSBhLnNpemUoMCk7DQogICAgaW50IG4gPSBiLnNpemUoMCk7DQogICAgaW50IGsgPSBhLnNpemUoMSk7DQogICAgY3VzdG9tX2tlcm5lbDw8PGRpbTMoKG0rNjMpLzY0LCAobis2MykvNjQpLCBkaW0zKDY0LCA4KSwgMCwgMD4+PiAoKF9faGlwX2ZwOF9lNG0zX2ZudXoqKWEuZGF0YV9wdHIoKSwgKF9faGlwX2ZwOF9lNG0zX2ZudXoqKWIuZGF0YV9wdHIoKSwNCiAgICBhcy5kYXRhX3B0cjxmbG9hdD4oKSwgYnMuZGF0YV9wdHI8ZmxvYXQ+KCksIChfX2hpcF9iZmxvYXQxNiopYy5kYXRhX3B0cigpLCBtLCBuLCBrKTsNCiAgICAvL0MxMF9DVURBX0NIRUNLKGN1ZGFHZXRMYXN0RXJyb3IoKSk7DQp9DQoiIiINCg0KaW1wb3J0IG9zDQpvcy5lbnZpcm9uWyJDWFgiXSA9ICJjbGFuZysrIg0KDQptb2R1bGUgPSBsb2FkX2lubGluZSgNCiAgICBuYW1lPSdmcDhfbW0nLA0KICAgIGNwcF9zb3VyY2VzPVtDUFBfV1JBUFBFUl0sDQogICAgY3VkYV9zb3VyY2VzPVtDVURBX1NSQ10sDQogICAgZnVuY3Rpb25zPVsnZnA4X21tJ10sDQogICAgdmVyYm9zZT1UcnVlLA0KICAgIGV4dHJhX2N1ZGFfY2ZsYWdzPVsiLS1vZmZsb2FkLWFyY2g9Z2Z4OTQyIiwgIi1zdGQ9YysrMjAiLCAiLU8zIl0sDQopDQoNCg0KZGVmIGN1c3RvbV9rZXJuZWwoZGF0YTogaW5wdXRfdCkgLT4gb3V0cHV0X3Q6DQogICAgYSwgYiwgYV9zY2FsZSwgYl9zY2FsZSwgYyA9IGRhdGENCiAgICBhID0gYS5jb250aWd1b3VzKCkNCiAgICBiID0gYi5jb250aWd1b3VzKCkNCiAgICBtb2R1bGUuZnA4X21tKGEsIGIsIGFfc2NhbGUsIGJfc2NhbGUsIGMpDQogICAgcmV0dXJuIGMNCg0K

Source code from GPU Mode and the KernelBot dataset · June 9 Researcher Reciprocity License v1.0

Changes from previous submission

Against this author's previous submission submission 16188.

Best evidence level for this revision: reported

JSON