IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

grouped_matmul_sm100_persistent

def grouped_matmul_sm100_persistent[EpilogueFnType: ElementwiseEpilogueFn = inflated$def[_no_epilogue_body[_, _, _, _, _]], ComputeFnType: ElementwiseComputeFn = inflated$def[identity_compute_fn[_, _, _, _, _]], //, c_type: DType, a_type: DType, b_type: DType, transpose_b: Bool, *, config: MatmulConfig[a_type, b_type, c_type, transpose_b], cta_group: Int = Int(1), num_pipeline_stages: Optional[Int] = None, a_swizzle: TensorMapSwizzle = TensorMapSwizzle.SWIZZLE_128B, b_swizzle: TensorMapSwizzle = TensorMapSwizzle.SWIZZLE_128B, has_epilogue_fn: Bool = False, has_compute_fn: Bool = False, a_plane_splits: IndexList[Int(2)] = Index[Int, Int](Int(0), Int(0))](c: TileTensor[c_type, Engine=c.Engine, linear_idx_type=c.linear_idx_type], a: TileTensor[a_type, Engine=a.Engine, linear_idx_type=a.linear_idx_type], a_offsets: TileTensor[.uint32, Engine=a_offsets.Engine, linear_idx_type=a_offsets.linear_idx_type], b: TileTensor[b_type, Engine=b.Engine, linear_idx_type=b.linear_idx_type], expert_ids: TileTensor[.int32, Engine=expert_ids.Engine, linear_idx_type=expert_ids.linear_idx_type], expert_usage_stats: TileTensor[.uint32, Engine=expert_usage_stats.Engine, linear_idx_type=expert_usage_stats.linear_idx_type], ctx: DeviceContextBase, epilogue_fn: EpilogueFnType = no_epilogue_fn, compute_fn: ComputeFnType = no_compute_fn)

Launches the persistent grouped GEMM kernel for SM100 from host tensors.

Swaps A and B to match the kernel's transposed-B convention, delegates to _grouped_matmul_sm100_persistent which builds TMA descriptors and shared-memory layouts from the matmul config, selects the pipeline depth from available shared memory, and enqueues the warp-specialized kernel on the device context.

Parameters:

  • ​EpilogueFnType (ElementwiseEpilogueFn): Type of epilogue_fn (inferred).
  • ​ComputeFnType (ElementwiseComputeFn): Type of compute_fn (inferred).
  • ​c_type (DType): Element type of the C output matrix (inferred).
  • ​a_type (DType): Element type of the A operand matrix (inferred).
  • ​b_type (DType): Element type of the B operand matrix (inferred).
  • ​transpose_b (Bool): Whether B is stored transposed in global memory (inferred).
  • ​config (MatmulConfig[a_type, b_type, c_type, transpose_b]): Matmul config carrying the block tile shape, MMA shape, and cluster shape.
  • ​cta_group (Int): Number of CTAs cooperating per MMA along the M dimension (defaults to 1).
  • ​num_pipeline_stages (Optional[Int]): Number of TMA producer and consumer pipeline stages; when None, auto-selected from available shared memory (defaults to None).
  • ​a_swizzle (TensorMapSwizzle): TMA swizzle mode applied to A shared-memory tiles (defaults to SWIZZLE_128B).
  • ​b_swizzle (TensorMapSwizzle): TMA swizzle mode applied to B shared-memory tiles (defaults to SWIZZLE_128B).
  • ​has_epilogue_fn (Bool): Whether epilogue_fn stores C in place of the TMA store (defaults to False).
  • ​has_compute_fn (Bool): Whether compute_fn maps C in registers ahead of the TMA store (defaults to False).
  • ​a_plane_splits (IndexList[Int(2)]): Per-plane split sizes for fused LoRA QKV A-plane row offsetting; (0, 0) disables it (defaults to (0, 0)).

Args:

Was this page helpful?