IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo package

layout

Provides layout and tensor types, which abstract memory layout for multidimensional data.

  • The Layout type represents a mapping between a set of logical coordinates and a linear index. It can be used, for example, to map logical tensor coordinates to a memory address, or to map GPU threads to tiles of data.

  • The TileTensor type is the tensor with explicit memory layout, and TileTensorIter steps through a buffer of equally shaped tiles.

Packages​

  • ​atoms: Defines atoms: wrappers for single hardware intrinsics as typed operations on TileTensor operands.
  • ​tileops: Defines TileOps: tile-level operations built from layout.atoms.

Modules​

  • ​bit_layout: Defines BitLayout, a layout that is linear over F2.
  • ​coord: Subpackage exposing std.utils.coord as layout.coord for kernel imports.
  • ​layout: Provides a mixed compile-time/runtime layout system for tensor memory mapping.
  • ​math: Implements tensor math operations.
  • ​numpy: NumPy interoperability for TileTensor.
  • ​owned_tensor: Defines tensors that own their storage, with the storage supplied by an engine.
  • ​swizzle: Defines swizzle layouts for optimizing memory access patterns.
  • ​tensor_core: Tensor Core Module for High-Performance Matrix Operations.
  • ​tensor_core_async: Tensor Core Async Module.
  • ​tensor_engine: Defines the engines that operate on tile-backed tensor storage.
  • ​tile_async_copy: Tile copies into shared memory laid out for ldmatrix readers.
  • ​tile_io: Trait and utilities for copying data between TileTensors.
  • ​tile_iterator: A TileTensor iterator that walks a buffer one tile at a time.
  • ​tile_tensor: TileTensor type for structured memory access with compile-time layout information.
  • ​tma_async: Tensor Memory Accelerator (TMA) Asynchronous Operations Module.
  • ​tmem_engine: Defines the TensorEngine that views Blackwell Tensor Memory (TMEM).
  • ​two_level_layout: Provides a two-level TensorLayout conformer.

Was this page helpful?