For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo module
bundled
Registers the per-device (mo.bundled.*) collective graph ops backed by the comm kernels.
A bundled collective is the single-device form of a mo.distributed.* op:
one instance runs per GPU, reading its peers' tensors directly. execute
reads them through live data pointers; build_graph reads them through
stable address slots so a recorded device graph can be replayed.
Structs
-
BundledAllGather: Registers themo.bundled.allgathergraph op with the graph compiler. -
BundledAllReduceAddRMSNormQuantFP8: Registers themo.composite.bundled.allreduce_add_rms_norm_quant_fp8graph op with the graph compiler. -
BundledAllReduceSum: Registers themo.bundled.allreduce.sumgraph op with the graph compiler. -
BundledBroadcast: Registers themo.bundled.broadcastgraph op with the graph compiler.