IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

gated_residual_rms_norm

Registers Muse Spark's gated residual boundary as gated_residual_rms_norm.

From SM-count rows up it runs the persistent nn.gated_residual_rms_norm. Below, a CTA per row would leave most SMs idle on a latency-bound row, so nn.gated_residual_rms_norm_split spreads each row over a CTA cluster. Both match the unfused ops bit for bit.

Structs​

Was this page helpful?