For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Python module
max.pipelines.speculative.spec_width_policy
How many drafts a speculative step produces and verifies.
Width policy
SpecWidthPolicy | How many drafts a speculative step produces and verifies. |
|---|
Functions
declares_skippable_draft | Whether a spec-decode graph takes its drafter's row count as an input. |
|---|