For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo module
chunked_qkv_rope_store
Fuses QKV unpacking or head-major projections, partial NeoX RoPE, and paged cache writes.
Functions
-
chunked_qkv_rope_store_kernel: Rotates Q/K and writes scaled V from contiguous per-chunk projections. -
chunked_qkv_rope_store_paged_ragged: Launches chunked QKV preparation with separate cache accessors. -
k_rope_v_store_kernel: Rotates K and writes scaled V, for a call that ropes no query. -
k_rope_v_store_paged_ragged: Launches the head-major K rotation and K/V store, with no query. -
rope_qkv_store_kernel: Rotates Q/K and writes scaled V from head-major projections. -
rope_qkv_store_paged_ragged: Launches the head-major QKV rotation and store.