IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python module

max.pipelines.kv_cache.checkpoint

Decides where to checkpoint a request’s cache.

Checkpointer​

CheckpointContextalias of Context
CheckpointerCollects lifecycle events and runs heuristics.
CheckpointerFactoryBuilds a checkpointer once every query its context needs is provided.

Events and checkpoints​

CheckpointA token position of a request to persist the cache at.
CheckpointEventalias of Event
CheckpointEventKindalias of EventKind

Heuristics​

CheckpointHeuristicalias of Heuristic
checkpoint_at_end_of_promptCheckpoints where a prompt ends and where a replay of it resumes.
checkpoint_at_releaseCheckpoints a request where it releases its cache.