For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Python function
checkpoint_at_end_of_prompt
checkpoint_at_end_of_prompt()
max.pipelines.kv_cache.checkpoint.checkpoint_at_end_of_prompt()
Checkpoints where a prompt ends and where a replay of it resumes.
A replay of the same prompt recomputes its last token to sample from, so it resumes one token short of the prompt’s end.
-
Return type:
-
AtEventHeuristic