For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

fused_qk_rope

Provides fused query/key rotary position embedding (RoPE) kernels with integrated KV-cache writes.

Functions

• ​fused_qk_rope: Applies RoPE to query and key tensors.
• ​fused_qk_rope_ragged: Applies RoPE (Rotary Position Embedding) to query and key tensors.
• ​get_identity_rope_coeff: Returns a SIMD vector representing an identity RoPE coefficient.
• ​get_safetensors_idx: Returns the real and imaginary element indices for a safetensors layout.
• ​rope_k_cache: Applies RoPE to a key cache entry and stores the result back in the cache.
• ​rope_q_proj: Applies RoPE to a query projection tile and stores the result.
• ​rope_value: Applies a rotary position embedding transformation to a SIMD vector.