For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Python class
EagleDraftInputs
EagleDraftInputs
class max.pipelines.speculative.draft_contracts.EagleDraftInputs(*, tokens, input_row_offsets, return_n_logits, hidden_states, kv)
Bases: object
An EAGLE call’s tokens, required hidden conditioning, and own cache.
-
Parameters:
-
- tokens (TensorValue)
- input_row_offsets (TensorValue)
- return_n_logits (TensorValue)
- hidden_states (TensorValue)
- kv (KVCacheInputsPerDevice[TensorValue, BufferValue])
hidden_states
hidden_states: TensorValue
input_row_offsets
input_row_offsets: TensorValue
kv
return_n_logits
return_n_logits: TensorValue
tokens
tokens: TensorValue