IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

attention

Registers attention graph ops (MHA, MLA, fused QKV) and dispatches them to the nn.attention kernels.

comptime values​

logger​

comptime logger = Logger(stdout, prefix=String(""), source_location=False)

SM100​

comptime SM100 = ((ACCELERATOR & CUDA) & arch("sm_100a"))

Holds for CUDA devices with the sm_100a architecture.

SM103​

comptime SM103 = ((ACCELERATOR & CUDA) & arch("sm_103a"))

Holds for CUDA devices with the sm_103a architecture.

Structs​

Was this page helpful?