For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo function
matmul_dispatch_sm100_fp32
def matmul_dispatch_sm100_fp32[c_type: DType, a_type: DType, b_type: DType, ComputeFnType: ElementwiseComputeFn, //, transpose_b: Bool = True, elementwise_lambda_fn: Optional[def[dtype: DType, width: SIMDLength, *, alignment: Int = Int(1)](IndexList[Int(2)], SIMD[dtype, width]) capturing thin -> None] = None, pdl_level: PDLLevel = PDLLevel(), has_compute_fn: Bool = True](c: TileTensor[c_type, Engine=c.Engine, address_space=c.address_space, linear_idx_type=c.linear_idx_type], a: TileTensor[a_type, Engine=a.Engine, address_space=a.address_space, linear_idx_type=a.linear_idx_type], b: TileTensor[b_type, Engine=b.Engine, address_space=b.address_space, linear_idx_type=b.linear_idx_type], compute_fn: ComputeFnType, ctx: DeviceContext) -> Int
Dispatches a float32 SM100 matmul via the heuristic outlier dispatch.
Delegates directly to sm100_heuristic_and_outliers_dispatch; only float32
input and output are supported.
Parameters:
- c_type (
DType): Output element type (inferred). - a_type (
DType): Element type of the LHS operanda(inferred). - b_type (
DType): Element type of the RHS operandb(inferred). - ComputeFnType (
ElementwiseComputeFn): Type of the compute epilogue closure (inferred). - transpose_b (
Bool): Whetherbis stored transposed (defaults toTrue). - elementwise_lambda_fn (
Optional[def[dtype: DType, width: SIMDLength, *, alignment: Int = Int(1)](IndexList[Int(2)], SIMD[dtype, width]) capturing thin -> None]): Optional epilogue applied to each output element (defaults toNone). - pdl_level (
PDLLevel): Programmatic dependent launch level for the dispatched kernel (defaults toPDLLevel()). - has_compute_fn (
Bool): Whether to applycompute_fn(defaults toTrue).
Returns: