For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python module

max.pipelines.lib.interfaces

Interfaces for MAX pipelines.

Architecture config

ArchConfig	Config for a model architecture.
ArchConfigWithAttentionKVCache	Predefined configuration for architectures that use attention KV cache blocks.
ArchConfigWithBoundedMaxSeqLen	Mixin for configs that store the received max_seq_len.
ArchConfigWithKVCache	Config for a model architecture that uses a KV cache.
ArchConfigWithPermissiveMaxSeqLen	Mixin for configs that honor max_length without bounding.
ArchConfigWithStoredKVParams	Mixin that implements get_kv_params() as the kv_params field.
ArchConfigWithVisionCache	Config for a vision-language architecture with a vision encoder cache.
ArchVLConfigWithTextSubconfig	Mixin for VLMs that embed a language-model arch config.

Batch processing

BatchProcessor	Batches pipeline contexts into model inputs and parses execution outputs.
BatchProcessorRuntime	Runtime dependencies shared by batch processors.
RaggedBatchProcessor	Base for ragged KV text batching.

Functions

arch_has_vision_tower	Whether this architecture encodes images at all.