For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo function
lamport_allreduce_rmsnorm_fits
def lamport_allreduce_rmsnorm_fits[dtype: DType, ngpus: Int](rows: Int, cols: Int) -> Bool
Returns whether a [rows, cols] message fits the Lamport fused kernel.
The kernel needs whole 128-bit packs, at most one pack per thread of a row's blocks, and a message within the reserved Lamport workspace.
Parameters:
Args:
- βrows (
Int): Number of rows (tokens). - βcols (
Int): Number of columns (hidden size); RMSNorm runs over it.
Returns:
Bool: True when the kernel accepts the shape.