For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo module

kv_cache

Registers KV-cache graph ops backed by the kv_cache and nn.kv_cache kernels.

`comptime` values

`logger`

comptime logger = Logger(stdout, prefix=String(""), source_location=False)

Structs

KVCacheCopyPagesD2H: Registers the mo.kv_cache.copy_pages_d2h graph op with the graph compiler.
Struct_fused_qk_rms_norm_ragged_paged: Registers the mo.fused_qk_rms_norm.ragged.paged graph op with the graph compiler.
Struct_fused_qk_rms_norm_rope_ragged_paged: Registers the mo.fused_qk_rms_norm_rope.ragged.paged graph op with the graph compiler.
Struct_fused_qk_rms_norm_rope_ragged_paged_dual: Registers mo.fused_qk_rms_norm_rope.ragged.paged.dual with the graph compiler.
Struct_k_matmul_ragged_paged: Registers the mo.k_matmul.ragged.paged graph op with the graph compiler.
Struct_k_matmul_ragged_paged_scale: Registers the mo.k_matmul.ragged.paged.scale graph op with the graph compiler.
Struct_kv_cache_ragged_paged_2m_iadd: Registers the mo.kv_cache.ragged.paged.2m_iadd graph op with the graph compiler.
Struct_kv_cache_ragged_paged_radd: Registers the mo.kv_cache.ragged.paged.radd graph op with the graph compiler.
Struct_kv_cache_row_offsets_ragged_paged: Registers the mo.kv_cache.row_offsets.ragged.paged graph op with the graph compiler.
Struct_kv_cache_store_k_scales_paged: Registers the mo.kv_cache.store_k_scales.paged.ragged graph op with the graph compiler.
Struct_kv_cache_store_padded: Registers the mo.kv_cache.store.paged.padded graph op with the graph compiler.
Struct_kv_cache_store_paged: Registers the mo.kv_cache.store.paged.ragged graph op with the graph compiler.
Struct_kv_matmul_ragged_paged: Registers the mo.kv_matmul.ragged.paged graph op with the graph compiler.
Struct_print_kv_cache_paged: Registers the mo.print_kv_cache.paged graph op with the graph compiler.
Struct_rms_norm_kv_cache_ragged_paged: Registers the mo.rms_norm_kv_cache.ragged.paged graph op with the graph compiler.
Struct_rms_norm_value_cache_ragged_paged: Registers the mo.rms_norm_value_cache.ragged.paged graph op with the graph compiler.

comptime values​

logger​

Structs​

`comptime` values

`logger`

Structs