For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Python class
ModuleV3PipelineModel
ModuleV3PipelineModel
class max.pipelines.lib.ModuleV3PipelineModel(pipeline_config, session, devices, kv_cache_config, weights, adapter, return_logits, *, memory_plan, return_hidden_states=ReturnHiddenStates.NONE, max_batch_size=1)
Bases: PipelineModel[BaseContextType, Any, Any]
ModuleV3 pipeline model without KV cache.
Subclasses implement _instantiate_module() and optionally
_create_model_config(), _prepare_state_dict(), and
_module_default_dtype().
-
Parameters:
-
- pipeline_config (PipelineConfig)
- session (InferenceSession)
- devices (list[Device])
- kv_cache_config (KVCacheConfig)
- weights (Weights)
- adapter (WeightsAdapter | None)
- return_logits (ReturnLogits)
- memory_plan (MemoryPlan)
- return_hidden_states (ReturnHiddenStates)
- max_batch_size (int)
load_model()
load_model()
Build and compile the ModuleV3 callable.