For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_dequant_mxfp8
struct Struct_dequant_mxfp8
Registers the quantization.dequant.mxfp8 graph op with the graph compiler.
Dequantizes MXFP8 weights (float8_e4m3fn, [N, K]) with
float8_e8m0fnu block-32 scales to bfloat16 or float32. scales is either
the rank-2 [N, K // 32] checkpoint layout or the rank-5 SM100
interleaved layout [ceildiv(N, 128), ceildiv(K, 128), 32, 4, 4].
Implemented traitsโ
Methodsโ
executeโ
static def execute(output: T, input: T, scales: T, context: DeviceContext)