For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python class

Collective

Collective

class max.experimental.sharding.Collective(value, names=<not given>, *values, module=None, qualname=None, type=None, start=1, boundary=None)

source

Bases: Enum

The collectives the cost model understands.

A Placement.transition_to() return value must be one of these. Custom Placement subclasses that return anything else are reported as infeasible by the cost model.

ALLGATHER

ALLGATHER = 'allgather'

source

ALLREDUCE

ALLREDUCE = 'allreduce'

source

ALL_TO_ALL

ALL_TO_ALL = 'all_to_all'

source

INFEASIBLE

INFEASIBLE = 'infeasible'

source

LOCAL_SLICE

LOCAL_SLICE = 'local_slice'

source

NOOP

NOOP = 'noop'

source

REDUCE_SCATTER

REDUCE_SCATTER = 'reduce_scatter'

source