IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.

For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python class

DraftStepInput

`DraftStepInput`

class max.pipelines.speculative.driver.DraftStepInput(tokens, hidden)

source

Loop-carried state between draft steps.

Every draft in the tree threads the previous step’s token and its per-device hidden state.

Parameters:

hidden: list[TensorValue]

source

tokens: TensorValue

source