IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python function

checkpoint_at_end_of_prompt

checkpoint_at_end_of_prompt()​

max.pipelines.kv_cache.checkpoint.checkpoint_at_end_of_prompt()

source

Checkpoints where a prompt ends and where a replay of it resumes.

A replay of the same prompt recomputes its last token to sample from, so it resumes one token short of the prompt’s end.

Return type:

AtEventHeuristic