For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Introduction to TileTensor
Mojo's layout package provides a
number of APIs for working with dense multidimensional arrays, which simplify
writing algorithms for handling linear algebra.
This section discusses the TileTensor abstraction and its related types:
TileTensoris a flexible tensor type that combines alayout.Layoutand a pointer to data.- The
layout.Layoutstruct describes an arrangement of data in memory. A layout is a function that maps a set of logical coordinates (like (x, y) in a two-dimensional array) to a linear index value (such as an offset into a memory buffer). Layouts can describe simple row-major or column-major matrices, but also more complex organizations, like a matrix subdivided into tiles. Coordis a tuple-like container for storing integer coordinates that supports both compile-time and run-time values. It's used for defining logical coordinates and layout shapes, among other things.
TileTensor supports layouts with run-time dimensions and nested layouts.
The Coord-based layout keeps the layout struct small, which helps reduce
register pressure on GPUs.
- To step through a buffer of equally shaped tiles, such as the stages of a
pipelined shared-memory buffer, use
TileTensorIter, as shown in Stepping through a buffer of tiles. - To walk the tiles of a 2D tensor, loop over the tile coordinates and call
tile()for each one, as shown in Iterating over tiles.