For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Python class
Logits
Logits
class max.nn.graph_groups.Logits(*args, **kwargs)
Bases: GraphGroup[Literal[‘next_token_logits’, ‘logits’, ‘logit_offsets’], TensorValue]
The decoder’s logits: the next token’s, and any others requested.
Which are present depends on the decoder’s return_logits, and a
caller that set it reads the ones it asked for.
-
Parameters:
-
- next_token_logits (TensorValue | None)
- logits (TensorValue | None)
- logit_offsets (TensorValue | None)
kind
Identifies the feature wherever the group sits in a tree.