For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
QuantizeDynamicScaledFloat8GroupedMx
struct QuantizeDynamicScaledFloat8GroupedMx
Registers the quantization.quantize_dynamic_scaled_float8.grouped_mx graph op.
1x128 e8m0 fp8 quantization of group-sorted rows that writes the scales straight into the grouped block-scaled GEMM's 5D MX scale tiles.
Implemented traitsโ
Methodsโ
executeโ
static def execute[amax_floor: Float32 = Float32("0")](output: T, scales: T, input: T, group_starts: T, scale_offsets: T, ctx: DeviceContext)