For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

device_graph

This module provides functionality for building and replaying device graphs. A device graph captures a sequence of GPU operations (such as kernel launches, memory copies, and memsets) as a reusable graph that can be replayed at a lower overhead than re-enqueueing each operation individually. The main entry point is DeviceGraph.create(), which hands a DeviceGraphBuilder to a scoped callback.

Structs

• ​DeviceGraph: Represents an instantiated device graph that can be replayed.
• ​DeviceGraphBuilder: Builder for explicit device graph construction.
• ​DeviceGraphCache: Holds the device graphs a model has already built, keyed for reuse.
• ​DeviceGraphNode: A handle to a node in an under-construction device graph.

Traits

• ​DeviceGraphInput: A device graph input that contributes to the graph's cache key.