For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo module
paged_store_utils
Slot, RoPE and quantization helpers for paged quantized cache stores.
A cache page holds page_size records: all of their values, then all of their
scales. With one slot per page a record is a contiguous row of values followed
by its scales.
Functions
-
dense_pointer: Returns a generic pointer to a row-major tensor's first element. -
gptj_rotate: Rotates interleaved (even, odd) channel pairs. -
load_frequencies: Loads the cosines and sines of consecutive RoPE pairs. -
mxfp4_quantize: Quantizes a group spread over adjacent lanes to E2M1 with a UE8M0 scale. -
mxfp8_quantize: Quantizes a group spread over adjacent lanes to E4M3 with a UE8M0 scale. -
page_and_offset: Splits a slot into its page and its place in the page. -
paged_record: Locates a slot's values and scales in a paged cache. -
raw_pointer: Returns a generic pointer to a tensor's first element. -
row_stride: Returns the row stride of a matrix whose rows are contiguous.