For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_grouped_matmul_dynamic_scaled_fp8
struct Struct_grouped_matmul_dynamic_scaled_fp8
Registers the matmul.grouped.dynamic.scaled.fp8 graph op with the graph compiler.
Implemented traitsโ
Methodsโ
executeโ
static def execute[input_scale_granularity: StaticString, weight_scale_granularity: StaticString, m_scale_granularity: Int, n_scale_granularity: Int, k_scale_granularity: Int, static_grid_z: Bool](c: T, a: T, b: T, a_scales: T, b_scales: T, expert_start_indices: T, expert_ids: T, max_num_tokens_per_expert: UInt32, num_active_experts: UInt32, decode_grid_m_cap: UInt32, estimated_total_m: UInt32, context: DeviceContext)