For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python function

batch_context_length_types

batch_context_length_types()

max.pipelines.lib.registration_runtime.batch_context_length_types(data_parallel_degree, *, devices_per_replica=1, dtype=int32)

source

Returns the batch_context_lengths input types.

There is one per replica, or with devices_per_replica, one for each device of each replica, a replica’s devices in a row.

Parameters:

• data_parallel_degree (int)
• devices_per_replica (int)
• dtype (DType)

Return type:

tuple[TensorType, …]