IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

QuantizeDynamicScaledFloat8GroupedMx

struct QuantizeDynamicScaledFloat8GroupedMx

Registers the quantization.quantize_dynamic_scaled_float8.grouped_mx graph op.

1x128 e8m0 fp8 quantization of group-sorted rows that writes the scales straight into the grouped block-scaled GEMM's 5D MX scale tiles.

Implemented traitsโ€‹

AnyType, Deinitable, Movable

Methodsโ€‹

executeโ€‹

static def execute[amax_floor: Float32 = Float32("0")](output: T, scales: T, input: T, group_starts: T, scale_offsets: T, ctx: DeviceContext)

Was this page helpful?