IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

Struct_grouped_matmul_ragged

struct Struct_grouped_matmul_ragged

Registers the mo.grouped.matmul.ragged graph op with the graph compiler.

The output takes a fused elementwise epilogue, so a consumer such as an activation runs in the matmul's store instead of as its own kernel. A value-to-value consumer is applied before the matmul's own store, which keeps the SM100 kernel's TMA store.

Implemented traitsโ€‹

AnyType, Deinitable, Movable

Methodsโ€‹

executeโ€‹

static def execute[c_type: DType, a_type: DType, b_type: DType, //, has_epilogue_fusion: Bool, target: StringSpan[ImmStaticOrigin]](c: ManagedTensorSlice[IOSpec(), static_spec=c.static_spec], a: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=a.static_spec], b: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=b.static_spec], expert_start_indices: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=expert_start_indices.static_spec], expert_ids: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=expert_ids.static_spec], expert_usage_stats: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=expert_usage_stats.static_spec], context: DeviceContextBase)

Was this page helpful?