IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

Struct_matmul_dynamic_block_scaled

struct Struct_matmul_dynamic_block_scaled

Registers the matmul.dynamic.block.scaled graph op with the graph compiler.

Two execute overloads under one registration: the graph compiler calls the fused one when the output has a fused epilogue and the plain one when it has none, in which case the matmul writes the output directly. The pair is grandfathered on the graph compiler's allow list; new kernels declare one execute with a StoreAccess output.

Implemented traitsโ€‹

AnyType, Deinitable, Movable

Methodsโ€‹

executeโ€‹

static def execute[SF_VECTOR_SIZE: Int](c: T, a: T, b: T, a_scales: T, b_scales: T, tensor_sf: Float32, context: DeviceContext)

static def execute[SF_VECTOR_SIZE: Int](c: T, a: T, b: T, a_scales: T, b_scales: T, tensor_sf: Float32, context: DeviceContext) where not conforms_to(T, Fused).__bool__()

Was this page helpful?