For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).

Mojo function

dispatch_select_comm_config

def dispatch_select_comm_config[TuningTableType: CommTuningConfig, //, ngpus: Int, sm_version: StringSlice[ImmStaticOrigin], tuning_table: Table[TuningTableType]](num_bytes: Int) -> TuningTableType

This function searches for tuning configs with matching sm_version and ngpus. If such configs are found, then the search continues for finding the config x where num_bytes <= x.num_bytes.

Falls back to the arch-specific default (ngpus=-1, num_bytes=-1, matching sm_version), or if none exists, to the global default (ngpus=-1, num_bytes=-1, sm_version="default").

Parameters:

TuningTableType (CommTuningConfig): The tuning-config entry type, constrained to CommTuningConfig.
ngpus (Int): Number of participating GPUs to select a config for.
sm_version (StringSlice[ImmStaticOrigin]): Target SM version string to match, such as "sm_90a".
tuning_table (Table[TuningTableType]): Compile-time table of tuning configs to search.

Args:

num_bytes (Int): Actual transfer size in bytes to select a config for.

Returns:

TuningTableType