For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_dequant_mxfp4
struct Struct_dequant_mxfp4
Registers the quantization.dequant.mxfp4 graph op with the graph compiler.
Rank-2 scales with bfloat16 or float8_e4m3fn output on a GPU take the
original H100-oriented kernel. Float32 output and the rank-5 SM100
interleaved scale layout ([ceildiv(N, 128), ceildiv(K, 128), 32, 4, 4])
use the shared dequant_mx kernel, which only produces bfloat16 or
float32. GPU only.
Implemented traitsโ
Methodsโ
executeโ
static def execute(output: T, input: T, scales: T, context: DeviceContext)