IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

Struct_dequant_mxfp4

struct Struct_dequant_mxfp4

Registers the quantization.dequant.mxfp4 graph op with the graph compiler.

Rank-2 scales with bfloat16 or float8_e4m3fn output on a GPU take the original H100-oriented kernel. Float32 output and the rank-5 SM100 interleaved scale layout ([ceildiv(N, 128), ceildiv(K, 128), 32, 4, 4]) use the shared dequant_mx kernel, which only produces bfloat16 or float32. GPU only.

Implemented traitsโ€‹

AnyType, Deinitable, Movable

Methodsโ€‹

executeโ€‹

static def execute(output: T, input: T, scales: T, context: DeviceContext)

Was this page helpful?