For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python class

RequestStateMixin

RequestStateMixin

class max.pipelines.lib.request_state.RequestStateMixin

source

Bases: object

Gives a registered pipeline model its decoder’s state lifecycle.

Serving frees a finished request’s state through release(), and a graph-capture warmup’s through release_warmup_state().

holds_request_state

property holds_request_state: bool

source

Whether a decoder’s state store is bound to this model.

A bound store hands the graph per-request buffers that the step advances in place, so a caller that must not execute a step twice over the same state – launch-trace verification – refuses while this is True.

release()

release(request_id)

source

Frees the state a finished request held.

Parameters:

request_id (RequestID)

Return type:

None

release_warmup_state()

release_warmup_state(request_ids)

source

Frees the state a graph-capture warmup probe claimed.

Parameters:

request_ids (list[RequestID])

Return type:

None