For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

rowwise_normalization

Row-based normalization kernels (rms_norm, layer_norm and fused variants) built on the algorithm.rowwise scaffolder and the builtin_kernels.monoids monoid library.

Functions

• ​layer_norm:
• ​layer_norm_rope_ragged:
• ​rms_norm:
• ​rms_norm_fused_quantize_dynamic_scaled_fp8:
• ​rms_norm_fused_residual_add:
• ​rms_norm_rope:
• ​row_mean_of_squares:
• ​row_mean_of_squares_qk: