For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
MatmulDynamicScaledFloat8
struct MatmulDynamicScaledFloat8
Registers the matmul.dynamic_scaled_fp8 graph op with the graph compiler.
Implemented traitsโ
Methodsโ
executeโ
static def execute[input_scale_granularity: StaticString, weight_scale_granularity: StaticString, m_scale_granularity: Int, n_scale_granularity: Int, k_scale_granularity: Int](output: T, a: T, b: T, a_scales: T, b_scales: T, ctx: DeviceContext)