For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

dispatch

Provides the SM100 (Blackwell) flash-attention host-side dispatch entry point that selects a 1Q or 2Q FA4 kernel configuration, builds the Q/K/V/O TMA descriptors and tile scheduler, and enqueues the kernel onto the device.

comptime values

logger

comptime logger = Logger(stdout, prefix=String(""), source_location=False)

WS_RAW_GRID_CLAMP

comptime WS_RAW_GRID_CLAMP = UInt32(4)

Functions

• ​mha_sm100_dispatch: Dispatches the SM100 FA4 flash-attention kernel for a prefill or decode workload.
• ​ws_p_ceiling: Capture-invariant partition-count ceiling for the split-K crossover (M4): one GPC wave's SM-fill sm_count // raw_grid, flattened once raw_grid passes WS_RAW_GRID_CLAMP.