For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

DefaultCommTuningConfig

struct DefaultCommTuningConfig

Parameters: ngpus: Number of GPUs for running allreduce. num_bytes: Total number of input bytes supported by the config. sm_version: SM version (as string). num_blocks: Number of thread blocks for running allreduce.

Fields

• ​ngpus (Int):
• ​num_bytes (Int):
• ​sm_version (StaticString):
• ​num_blocks (Int):

Implemented traits

AnyType, CommTuningConfig, Copyable, Deinitable, ImplicitlyCopyable, Movable, RegisterPassable, TrivialRegisterPassable, TuningConfig, Writable

Methods

get_num_blocks

def get_num_blocks(self) -> Int

Returns:

Int

get_num_bytes

def get_num_bytes(self) -> Int

Returns:

Int

get_sm_version

def get_sm_version(self) -> StaticString

Returns:

StaticString

get_ngpus

def get_ngpus(self) -> Int

Returns:

Int

write_to

def write_to(self, mut writer: T)

Writes the tuning config as a string.

Args:

• ​writer (T): The writer to write to.