For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo module
ep
Expert Parallelism (EP) Communication Kernel.
comptime values
RT_LAYOUT_2D
comptime RT_LAYOUT_2D = RowMajorLayout[Int64, Int64]
Structs
-
DistributedEPCombine: Registers themo.distributed.ep.combinegraph op with the graph compiler. -
DistributedEPDispatch: Registers themo.distributed.ep.dispatchgraph op with the graph compiler. -
DistributedEPDispatchBlockScaledNV: Registers themo.distributed.ep.dispatch.block.scaled.nvgraph op with the graph compiler. -
DistributedEPDispatchBlockScaledNVDynGlobalScales: Registers themo.distributed.ep.dispatch.block.scaled.nv.dyn_global_scalesgraph op with the graph compiler. -
DistributedEPDispatchFP8: Registers themo.distributed.ep.dispatch.fp8graph op with the graph compiler. -
DistributedEPDispatchMXFP4: Registers themo.distributed.ep.dispatch.mxfp4graph op with the graph compiler. -
Struct_ep_combine: Registers theep.combinegraph op with the graph compiler. -
Struct_ep_combine_async: Registers theep.combine_asyncgraph op with the graph compiler. -
Struct_ep_combine_async_mx: Registers theep.combine_async.mxgraph op with the graph compiler. -
Struct_ep_combine_skip_a2a: Registers theep.combine.skip_a2agraph op with the graph compiler. -
Struct_ep_combine_wait: Registers theep.combine_waitgraph op with the graph compiler. -
Struct_ep_combine_wait_mx: Registers theep.combine_wait.mxgraph op with the graph compiler. -
Struct_ep_dispatch: Registers theep.dispatchgraph op with the graph compiler. -
Struct_ep_dispatch_async: Registers theep.dispatch_asyncgraph op with the graph compiler. -
Struct_ep_dispatch_async_block_scaled_nv: Registers theep.dispatch_async.block.scaled.nvgraph op with the graph compiler. -
Struct_ep_dispatch_async_mxfp4: Registers theep.dispatch_async.mxfp4graph op with the graph compiler. -
Struct_ep_dispatch_block_scaled_nv: Registers theep.dispatch.block.scaled.nvgraph op with the graph compiler. -
Struct_ep_dispatch_block_scaled_nv_dyn_global_scales: Registers theep.dispatch.block.scaled.nv.dyn_global_scalesgraph op with the graph compiler. -
Struct_ep_dispatch_block_scaled_nv_dyn_global_scales_expert_load: Registersep.dispatch.block.scaled.nv.dyn_global_scales.expert_load:ep.dispatch.block.scaled.nv.dyn_global_scalesthat also adds each local expert's routed-token count to an EPLB load tally. -
Struct_ep_dispatch_block_scaled_nv_expert_load: Registersep.dispatch.block.scaled.nv.expert_load:ep.dispatch.block.scaled.nvthat also adds each local expert's routed-token count to an EPLB load tally. -
Struct_ep_dispatch_expert_load: Registersep.dispatch.expert_load:ep.dispatchthat also adds each local expert's routed-token count to an EPLB load tally. -
Struct_ep_dispatch_fp8: Registers theep.dispatch.fp8graph op with the graph compiler. -
Struct_ep_dispatch_fp8_expert_load: Registersep.dispatch.fp8.expert_load:ep.dispatch.fp8that also adds each local expert's routed-token count to an EPLB load tally. -
Struct_ep_dispatch_mxfp4: Registers theep.dispatch.mxfp4graph op with the graph compiler. -
Struct_ep_dispatch_mxfp4_expert_load: Registersep.dispatch.mxfp4.expert_load:ep.dispatch.mxfp4that also adds each local expert's routed-token count to an EPLB load tally. -
Struct_ep_dispatch_wait: Registers theep.dispatch_waitgraph op with the graph compiler. -
Struct_ep_dispatch_wait_block_scaled_nv: Registers theep.dispatch_wait.block.scaled.nvgraph op with the graph compiler. -
Struct_ep_dispatch_wait_block_scaled_nv_expert_load: Registersep.dispatch_wait.block.scaled.nv.expert_load:ep.dispatch_wait.block.scaled.nvthat also adds each local expert's routed-token count to an EPLB load tally. -
Struct_ep_dispatch_wait_expert_load: Registersep.dispatch_wait.expert_load:ep.dispatch_waitthat also adds each local expert's routed-token count to an EPLB load tally. -
Struct_ep_dispatch_wait_fp8: Registers theep.dispatch_wait.fp8graph op with the graph compiler. -
Struct_ep_dispatch_wait_fp8_expert_load: Registersep.dispatch_wait.fp8.expert_load:ep.dispatch_wait.fp8that also adds each local expert's routed-token count to an EPLB load tally. -
Struct_ep_dispatch_wait_mxfp4: Registers theep.dispatch_wait.mxfp4graph op with the graph compiler. -
Struct_ep_dispatch_wait_mxfp4_expert_load: Registersep.dispatch_wait.mxfp4.expert_load:ep.dispatch_wait.mxfp4that also adds each local expert's routed-token count to an EPLB load tally. -
Struct_ep_fused_silu: Registers theep.fused_silugraph op with the graph compiler. -
Struct_ep_fused_silu_mxfp4: Registers theep.fused_silu.mxfp4graph op with the graph compiler. -
Struct_ep_fused_silu_mxfp6: Registers theep.fused_silu.mxfp6graph op with the graph compiler. -
Struct_ep_fused_silu_mxfp8: Registers theep.fused_silu.mxfp8graph op with the graph compiler. -
Struct_ep_fused_silu_nvfp4: Registers theep.fused_silu.nvfp4graph op with the graph compiler. -
Struct_ep_init: Registers theep.initgraph op with the graph compiler.