IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

Struct_k_rope_v_store_ragged_paged

struct Struct_k_rope_v_store_ragged_paged

Registers head-major K rotation and paged K/V stores, with no query.

The context-writing half of kv_cache.rope_qkv_store.ragged.paged: a call that only fills a cache has no queries to rope, so this op covers a token's key and value heads alone. It returns nothing, the K/V planes being the whole of its work.

Implemented traitsโ€‹

AnyType, Deinitable, Movable

Methodsโ€‹

executeโ€‹

static def execute(k: T, v: T, input_row_offsets: T, freqs_cis: T, kv_blocks: T, page_stride: T, cache_lengths: T, kv_lookup_table: T, max_prompt_length: T, max_cache_length: T, layer_idx: UInt32, value_scale: Float32, ctx: DeviceContext)

Was this page helpful?