For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_matmul_dynamic_block_scaled
struct Struct_matmul_dynamic_block_scaled
Registers the matmul.dynamic.block.scaled graph op with the graph compiler.
Two execute overloads under one registration: the graph compiler calls
the fused one when the output has a fused epilogue and the plain one when
it has none, in which case the matmul writes the output directly. The pair
is grandfathered on the graph compiler's allow list; new kernels declare
one execute with a StoreAccess output.
Implemented traitsโ
Methodsโ
executeโ
static def execute[SF_VECTOR_SIZE: Int](c: T, a: T, b: T, a_scales: T, b_scales: T, tensor_sf: Float32, context: DeviceContext)
static def execute[SF_VECTOR_SIZE: Int](c: T, a: T, b: T, a_scales: T, b_scales: T, tensor_sf: Float32, context: DeviceContext) where not conforms_to(T, Fused).__bool__()