IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

indexer_k_store

Normalize, rotate and store projected index keys in a paged quantized cache.

comptime values​

FP8_INDEX_RECORD_BYTES​

comptime FP8_INDEX_RECORD_BYTES = 132

Bytes of one stored FP8 key: its values and its scale word.

FP8_INDEX_VALUE_BYTES​

comptime FP8_INDEX_VALUE_BYTES = INDEX_KEY_CHANNELS

Bytes of one FP8 key's E4M3 values.

INDEX_KEY_CHANNELS​

comptime INDEX_KEY_CHANNELS = 128

Channels of one index key.

INDEX_KEY_SCALE_BYTES​

comptime INDEX_KEY_SCALE_BYTES = 4

Bytes of one stored key's scale word: four UE8M0 scales, or one FP32.

MXFP4_INDEX_RECORD_BYTES​

comptime MXFP4_INDEX_RECORD_BYTES = 68

Bytes of one stored MXFP4 key: its values and its scale word.

MXFP4_INDEX_VALUE_BYTES​

comptime MXFP4_INDEX_VALUE_BYTES = 64

Bytes of one MXFP4 key's E2M1 values.

Functions​

Was this page helpful?