IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python module

max.pipelines.architectures

Built-in model architectures for MAX pipelines.

Importing this package registers each architecture with PipelineRegistry; the registry imports an architecture’s module lazily, the first time that architecture is requested.

MAX includes built-in support for a wide range of model architectures. Each architecture module registers a SupportedArchitecture instance that tells the pipeline system how to load, configure, and execute a particular model family.

Text generation​

deepseekV2DeepSeek-V2 mixture-of-experts architecture for text generation.
deepseekV3DeepSeek-V3 mixture-of-experts architecture for text generation.
deepseekV3_2DeepSeek-V3.2 mixture-of-experts architecture for text generation.
deepseekV3_nextnDeepSeek-V3 NextN multi-token prediction draft model for speculative decoding.
deepseekV4DeepSeek-V4-Flash mixture-of-experts architecture for text generation.
dflash2_qwen3_5DFlash2 draft model for Qwen3.5-family targets.
dflash_llama3DFlash draft model for Llama3-family targets.
diffusion_gemmaDiffusionGemma block-diffusion architecture.
dspark_draftModel-agnostic DSpark draft: block nn.Module + registry placeholder.
eagle3_deepseekV3DeepseekV3 + Eagle3 speculator pipeline.
eagle_llama3EAGLE speculative decoding draft model for Llama 3.
gemma3Gemma 3 transformer architecture for text generation.
gemma3multimodalGemma 3 vision-language architecture for multimodal text generation.
gemma4Gemma 4 vision-language architecture for multimodal text generation.
gemma4_assistantGemma 4 assistant draft architecture: a lightweight decoder that cross-attends to the Gemma 4 target's KV cache to draft speculative tokens.
glm5_1GLM-5.1 (GlmMoeDsa) mixture-of-experts architecture for text generation.
glm5_nextGLM-5.3-Flash architecture: a multimodal MoE decoder with a vision tower, built on the DeepSeek V3.2 model.
gpt_ossGPT-OSS mixture-of-experts architecture for text generation.
graniteGranite architecture, builds on llama3.
hy_v3Tencent Hunyuan Hy3-preview (HYV3ForCausalLM).
idefics3Idefics3 vision-language architecture for multimodal text generation.
inklingInkling architecture: a text-and-vision pipeline model with KV cache and SSM state support.
internvlInternVL vision-language architecture for multimodal text generation.
kimik2_5Kimi K2.5 mixture-of-experts architecture for text generation.
lagunaLaguna architecture: a decoder-only MoE model that extends the Llama 3 architecture.
lfm2LFM2 architecture: a hybrid model combining full attention with short convolutions.
llama3Llama 3 transformer architecture for text generation.
llama4Llama 4 (text-only) transformer architecture for text generation.
mambaMamba state-space architecture for text generation.
mimo_v2MiMo-V2.6-Flash (MiMoV2ForCausalLM).
minimax_m2MiniMax-M2 architecture: a decoder-only MoE model that extends the Llama 3 architecture.
mistralMistral transformer architecture for text generation.
mistral3Mistral 3 vision-language architecture for multimodal text generation.
muse_glimmerMuse Glimmer vision-language architecture (ModuleV3 API).
nemotron_hNemotron-H architecture: a hybrid decoder interleaving Mamba-2 mixers, NoPE GQA attention, relu2 MLP blocks, and, in the Nemotron 3 MoE variants, mixture-of-experts blocks.
olmoOLMo transformer architecture for text generation.
olmo2OLMo 2 transformer architecture for text generation.
olmo3OLMo 3 transformer architecture for text generation.
phi3Phi-3 transformer architecture for text generation.
pixtralPixtral vision-language architecture for multimodal text generation.
qwen2Qwen2 transformer architecture for text generation.
qwen2_5vlQwen2.5-VL vision-language architecture for multimodal text generation.
qwen3Qwen3 transformer architecture for text generation.
qwen3_5Qwen3.5 architecture: a hybrid model interleaving Gated DeltaNet linear attention with full attention, plus a vision encoder.
qwen3vl_moeQwen3-VL vision-language architecture for multimodal text generation.
step3p5Step-3.5-Flash architecture, built on the Llama 3 model base.
unified_dflash2_qwen3_5Qwen3.5 fused with a DFlash2 block drafter for speculative decoding.
unified_dflash_gemma4_31bUnified DFlash speculative decoding for Gemma4 31B.
unified_dflash_kimi_k25DFlash speculative decoding for Kimi K2.5 with unified graph compilation.
unified_dflash_llama3DFlash speculative decoding for Llama3 with unified graph compilation.
unified_dflash_mimo_v2MiMo-V2.6-Flash with its DFlash drafter: the fused speculative graph, and the base graph that writes the drafter's context.
unified_dspark_deepseekV4DeepSeek-V4 speculative decoding with its in-checkpoint DSpark stages.
unified_dspark_gemma4_12bUnified DSpark speculative decoding for Gemma4.
unified_dspark_gemma4_31bUnified DSpark speculative decoding for Gemma4 31B.
unified_eagle_llama3EAGLE speculative decoding draft model for Llama 3 with unified graph compilation.
unified_mtp_deepseekV3DeepSeek-V3 multi-token prediction draft model for speculative decoding with unified graph compilation.
unified_mtp_gemma4Gemma4 with MTP draft model for speculative decoding with unified graph compilation.
unified_mtp_glm5_2GLM-5.2 (DeepSeek-V3.2 sparse) MTP draft model for unified speculative decoding.
unified_mtp_inklingInkling multi-token prediction for unified speculative decoding.
unified_mtp_qwen3_5Qwen3.5 MTP head fused with its target for speculative decoding.

Embeddings​

bertBERT sentence transformer architecture for embeddings generation.
mpnetMPNet sentence transformer architecture for embeddings generation.
qwen3_embeddingQwen3 architecture for embeddings generation.

Image generation​

flux2FLUX.2 diffusion architecture for image generation.
ideogram4Ideogram 4 flow-matching text-to-image architecture.
qwen_imageQwen-Image diffusion architecture for image generation.
qwen_image_editQwen-Image-Edit diffusion architecture for image editing.
wanWan diffusion architecture for video generation.

Audio generation​

minimax_music3Generates music from a text description and lyrics.