For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

Struct_matmul_dynamic_block_scaled_mxfp6

struct Struct_matmul_dynamic_block_scaled_mxfp6[FP6_FORMAT: Int = Int(0)]

Registers the mo.matmul.dynamic.block.scaled.mxfp6 graph op.

Separate from the MXFP4/MXFP8 op rather than another lane_bytes value: both FP6 encodings put 24 bytes in a lane, so the byte count cannot choose between them.

Parameters

• ​FP6_FORMAT (Int): 0 selects E2M3, 1 selects E3M2, matching FP6Format.

Implemented traits

AnyType, Deinitable, Movable

Methods

execute

static def execute[c_type: DType, a_type: DType, b_type: DType, //, target: StringSpan[ImmStaticOrigin]](c: ManagedTensorSlice[IOSpec[_, _].Output, static_spec=c.static_spec], a: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=a.static_spec], b: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=b.static_spec], a_scales: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=a_scales.static_spec], b_scales: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=b_scales.static_spec], context: DeviceContext)