For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python function

ragged_kv_symbolic_inputs

ragged_kv_symbolic_inputs()

max.pipelines.lib.ragged_kv_symbolic_inputs(*, kv_params, device_refs, include_signal_buffers)

source

Returns symbolic graph inputs for a standard ragged KV text model.

Parameters:

• kv_params (KVCacheParamInterface)
• device_refs (list[DeviceRef])
• include_signal_buffers (bool)

Return type:

list[TensorType | BufferType]