IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

Struct_dequant_mxfp8

struct Struct_dequant_mxfp8

Registers the quantization.dequant.mxfp8 graph op with the graph compiler.

Dequantizes MXFP8 weights (float8_e4m3fn, [N, K]) with float8_e8m0fnu block-32 scales to bfloat16 or float32. scales is either the rank-2 [N, K // 32] checkpoint layout or the rank-5 SM100 interleaved layout [ceildiv(N, 128), ceildiv(K, 128), 32, 4, 4].

Implemented traitsโ€‹

AnyType, Deinitable, Movable

Methodsโ€‹

executeโ€‹

static def execute(output: T, input: T, scales: T, context: DeviceContext)

Was this page helpful?