IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python class

Checkpoint

Checkpointโ€‹

class max.pipelines.kv_cache.checkpoint.Checkpoint(request_id, position)

source

Bases: object

A token position of a request to persist the cache at.

Parameters:

positionโ€‹

position: int

source

The exact token index to checkpoint at.

request_idโ€‹

request_id: RequestID

source