For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python function

build_state_store

build_state_store()

max.pipelines.lib.request_state.build_state_store(decoder_cls, config, *, max_batch_size, devices)

source

Returns the state store a registered decoder declares, if any.

Parameters:

• decoder_cls (type[Any]) – The registered DECODER class.
• config (Any) – The finalized config the decoder is built from.
• max_batch_size (int) – The most requests a step holds.
• devices (Sequence[Device]) – The devices the decoder runs on.

Raises:

• TypeError – If state_store returns something other than a RequestStateStore.
• ValueError – If the store leaves a symbolic dim of a tensor input unbounded.

Return type:

RequestStateStore | None