IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

ncclCommInitAll

def ncclCommInitAll(comms: Pointer[Optional[Pointer[NoneType, MutUntrackedOrigin]]], ndev: Int, devlist: Pointer[Int32]) -> ncclResult_t

Initializes NCCL/RCCL communicators for a set of GPUs.

Thin FFI wrapper around ncclCommInitAll. Allocates one communicator per device in devlist and stores the handles in comms. Must be called from a single thread; concurrent calls for the same device set cause undefined behavior in the NCCL library.

Args:

Returns:

ncclResult_t: ncclResult_t.ncclSuccess on success; a non-zero status on failure.

Raises:

If the CCL function symbol cannot be resolved from the vendor library.

Was this page helpful?