For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_batched_matmul_dynamic_scaled_fp8
struct Struct_batched_matmul_dynamic_scaled_fp8
Registers the matmul.batched.dynamic.scaled.fp8 graph op with the graph compiler.
Implemented traitsโ
Methodsโ
executeโ
static def execute[input_scale_granularity: StaticString, weight_scale_granularity: StaticString, m_scale_granularity: Int, n_scale_granularity: Int, k_scale_granularity: Int](c: T, a: T, b: T, a_scales: T, b_scales: T, context: DeviceContext)