For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo module

fused_qk_rope

Provides fused query/key rotary position embedding (RoPE) kernels with integrated KV-cache writes.

Functions

• ​fused_qk_rope: Applies RoPE to query and key tensors.
• ​fused_qk_rope_ragged: Applies RoPE (Rotary Position Embedding) to query and key tensors.
• ​get_identity_rope_coeff: Returns a SIMD vector representing an identity RoPE coefficient.
• ​get_safetensors_idx: Returns the real and imaginary element indices for a safetensors layout.
• ​rope_k_cache: Applies RoPE to a key cache entry and stores the result back in the cache.
• ​rope_q_proj: Applies RoPE to a query projection tile and stores the result.
• ​rope_value: Applies a rotary position embedding transformation to a SIMD vector.

Was this page helpful?

Thank you! We'll create more content like this.

Thank you for helping us improve!

😔 What went wrong?

Some code doesn’t work

It includes inaccurate information

It's missing information I need

It was difficult to understand

Other

Submit