IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo trait

OutputWriter

Injected output-writer policy for BlackwellMatmulSM100Kernel.

Carries the regime scalars and a static factory-and-write that resolves the concrete writer from the kernel's config-derived parameters. The kernel takes this as the comptime output_writer_type parameter; the default is StandardOutputWriter (local TMA store, no sync, one peer).

Implemented traits​

AnyType

comptime members​

needs_sync​

comptime needs_sync

Whether the produced writer needs cross-GPU barrier/signal sync around the epilogue (reduce-scatter), False for a local TMA store.

num_peers​

comptime num_peers

Number of C TMA descriptors / peer buffers the kernel must supply in c_tma_ops (1 for the standard local store).

Required methods​

write_batched​

static def write_batched[EpilogueFnType: ElementwiseEpilogueFn, ComputeFnType: ElementwiseComputeFn, //, tma_origin: ImmOrigin, c_type: DType, c_tile_shape: Coord[*c_tile_shape.element_types], c_desc_shape: Coord[*c_desc_shape.element_types], a_type: DType, accum_type: DType, block_tile_shape: Tuple[Int, Int, Int], mma_shape: Tuple[Int, Int, Int], opc: OutputPipelineConfig, c_swizzle: TensorMapSwizzle, transpose_c: Bool, c_smem_dim0: Int, c_smem_dim1: Int, num_output_stages: Int, num_output_warps: Int, has_epilogue_fn: Bool, has_compute_fn: Bool, register_based_epilogue: Bool](c_tma_ops: Pointer[Array[TMATensorTile[c_type, c_tile_shape, c_desc_shape], _Self.num_peers], tma_origin], c_tiles: SMemTileArray2DRowMajor[c_type, c_smem_dim0, c_smem_dim1, num_output_stages], stage: OutputStage[opc], tile_coord: Tuple[UInt32, UInt32, UInt32], shape: Tuple[UInt32, UInt32], epilogue_fn: EpilogueFnType, compute_fn: ComputeFnType, alpha: Float32 = 1)

Construct the concrete writer from the c_tma_ops array and write one batched (3D-coord) output tile.

The standard policy stores descriptor [0]; the reduce-scatter policy retains all num_peers descriptors. The c_tiles / stage argument types are the shared SMemTileArray2DRowMajor[...] / OutputStage[opc] both writers consume, so the kernel passes its smem.c_tiles() and pipeline stage directly, with no rebind needed.

Parameters:

  • ​EpilogueFnType (ElementwiseEpilogueFn): Type of the elementwise epilogue closure.
  • ​ComputeFnType (ElementwiseComputeFn): Type of the compute epilogue closure.
  • ​tma_origin (ImmOrigin): Origin of the C TMA descriptor memory.
  • ​c_type (DType): Element DType of the output C tensor.
  • ​c_tile_shape (Coord[*element_types]): Per-dimension tile shape of the C TMA descriptor.
  • ​c_desc_shape (Coord[*element_types]): Per-dimension shape of the C output tensor.
  • ​a_type (DType): Element DType of the A operand.
  • ​accum_type (DType): Element DType of the MMA accumulator.
  • ​block_tile_shape (Tuple[Int, Int, Int]): (BM, BN, BK) block tile shape in elements.
  • ​mma_shape (Tuple[Int, Int, Int]): (MMA_M, MMA_N, MMA_K) shape of one MMA instruction.
  • ​opc (OutputPipelineConfig): Output pipeline config for TMEM accumulator staging.
  • ​c_swizzle (TensorMapSwizzle): Swizzle mode of the C TMA descriptor.
  • ​transpose_c (Bool): Whether the C output is stored transposed (A/B swapped).
  • ​c_smem_dim0 (Int): First dimension of the C SMEM tile array.
  • ​c_smem_dim1 (Int): Second dimension of the C SMEM tile array.
  • ​num_output_stages (Int): Number of stages in the C SMEM tile array.
  • ​num_output_warps (Int): Number of warps participating in the epilogue.
  • ​has_epilogue_fn (Bool): Whether epilogue_fn stores the output tile to global memory instead of the TMA store.
  • ​has_compute_fn (Bool): Whether compute_fn is applied to the accumulator before the store.
  • ​register_based_epilogue (Bool): Whether the epilogue runs from register fragments instead of staging through SMEM.

Args:

Was this page helpful?