For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Python class
Verified
Verifiedβ
class max.pipelines.speculative.spec_target.Verified(logits, hidden)
Bases: Generic[_TargetHiddenT]
What the target contributes: verification logits and hidden states.
Naming the two results is the point. The target output tuple is
[last_logits?][logits, offsets?][hidden per device...], and whether the
leading entry exists depends on emit_last_token_logits β which is why
structurally identical code reads [1] and [3 : 3 + n] in one arch
and [0] and [2 : 2 + n] in another. The adapter owns that layout.
-
Parameters:
-
- logits (TensorValue)
- hidden (_TargetHiddenT)
hiddenβ
hidden: _TargetHiddenT
logitsβ
logits: TensorValue