IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python class

CrossAttentionDraft

CrossAttentionDraftโ€‹

class max.pipelines.speculative.cross_attention.CrossAttentionDraft(*args, **kwargs)

source

Bases: Protocol

The draft-side surface CrossAttentionMTPProposer drives.

return_hidden_statesโ€‹

return_hidden_states: ReturnHiddenStates

source

return_logitsโ€‹

return_logits: ReturnLogits

source