IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

paged_store_utils

Slot, RoPE and quantization helpers for paged quantized cache stores.

A cache page holds page_size records: all of their values, then all of their scales. With one slot per page a record is a contiguous row of values followed by its scales.

Functions​

Was this page helpful?