For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo module
indexer_k_store
Normalize, rotate and store projected index keys in a paged quantized cache.
comptime values
FP8_INDEX_RECORD_BYTES
comptime FP8_INDEX_RECORD_BYTES = 132
Bytes of one stored FP8 key: its values and its scale word.
FP8_INDEX_VALUE_BYTES
comptime FP8_INDEX_VALUE_BYTES = INDEX_KEY_CHANNELS
Bytes of one FP8 key's E4M3 values.
INDEX_KEY_CHANNELS
comptime INDEX_KEY_CHANNELS = 128
Channels of one index key.
INDEX_KEY_SCALE_BYTES
comptime INDEX_KEY_SCALE_BYTES = 4
Bytes of one stored key's scale word: four UE8M0 scales, or one FP32.
MXFP4_INDEX_RECORD_BYTES
comptime MXFP4_INDEX_RECORD_BYTES = 68
Bytes of one stored MXFP4 key: its values and its scale word.
MXFP4_INDEX_VALUE_BYTES
comptime MXFP4_INDEX_VALUE_BYTES = 64
Bytes of one MXFP4 key's E2M1 values.
Functions
-
index_key_layer_pages: Locates one layer's pages in a multi-layer paged index-key leaf. -
indexer_k_norm_rope_store: Store 128-channel index keys after RMSNorm and 64-channel GPT-J RoPE. -
indexer_k_norm_rope_store_layer: Runsindexer_k_norm_rope_storeon one layer of a multi-layer leaf.