IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python class

EagleDraftInputs

EagleDraftInputs​

class max.pipelines.speculative.draft_contracts.EagleDraftInputs(*, tokens, input_row_offsets, return_n_logits, hidden_states, kv)

source

Bases: object

An EAGLE call’s tokens, required hidden conditioning, and own cache.

Parameters:

hidden_states​

hidden_states: TensorValue

source

input_row_offsets​

input_row_offsets: TensorValue

source

kv​

kv: KVCacheInputsPerDevice[TensorValue, BufferValue]

source

return_n_logits​

return_n_logits: TensorValue

source

tokens​

tokens: TensorValue

source