For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Python class
Checkpoint
Checkpointโ
class max.pipelines.kv_cache.checkpoint.Checkpoint(request_id, position)
Bases: object
A token position of a request to persist the cache at.
positionโ
position: int
The exact token index to checkpoint at.
request_idโ
request_id: RequestID