For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
LayerNormRopeRagged
struct LayerNormRopeRagged
Registers the mo.composite.layer_norm_rope_ragged graph op with the graph compiler.
Fuses LayerNorm with ragged RoPE applied to the leading freqs_cis-width
columns of the normalized output; the remaining columns pass through
unrotated.
Implemented traitsโ
Methodsโ
executeโ
static def execute[interleaved: Bool](output: T, input: T, gamma: T, beta: T, epsilon: Float32, input_row_offsets: T, start_pos: T, freqs_cis: T, ctx: DeviceContext)