IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python module

max.pipelines.speculative.spec_width_policy

How many drafts a speculative step produces and verifies.

Width policy​

SpecWidthPolicyHow many drafts a speculative step produces and verifies.

Functions​

declares_skippable_draftWhether a spec-decode graph takes its drafter's row count as an input.