For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python module

max.pipelines.speculative

Speculative decoding pipelines and configuration for MAX.

Submodules

• max.pipelines.speculative.depth_schedule
• max.pipelines.speculative.driver
• max.pipelines.speculative.spec_target

Configuration

RejectionSamplingStrategy	alias of Literal['greedy', 'residual', 'typical-acceptance', 'logit-comparison']
SpeculativeConfig	Configures speculative decoding for a pipeline.
SpeculativeMethod	alias of Literal['eagle', 'mtp', 'dflash', 'dflash2']
VerifyWidthRange	One inclusive decode-batch-size range and the drafts to verify in it.

Token merging

RaggedTokenMerger	Merges prompt and draft token sequences into a single ragged batch.

ragged_token_merger	Builds a graph that merges prompt and draft tokens into a single ragged sequence.