IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

Struct_kv_cache_hisparse_gather_group_paged

struct Struct_kv_cache_hisparse_gather_group_paged

Registers the kv_cache.hisparse.gather_group.paged graph op.

Copies the last resolve's misses for consecutive layers that share one indexer selection in one launch: the first layer and the shared layers that reuse its top-k. See kv_cache.hisparse.

Implemented traitsโ€‹

AnyType, Deinitable, Movable

Methodsโ€‹

executeโ€‹

static def execute[hot_pages: Int, num_groups: Int, max_misses: Int, hash_capacity: Int](kv_blocks: T, page_stride: T, hot_table: T, host_mirror: T, first_layer_idx: UInt32, layer_count: UInt32, context: DeviceContext)

Was this page helpful?