IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

block_scaled_dispatch

Provides dispatch logic for SM100 block-scaled (NVFP4, MXFP4, MXFP8) matmul kernels with optional elementwise epilogue.

comptime values​

compute_fn_unfused_m_cap​

comptime compute_fn_unfused_m_cap = 512

DISPATCH_HIT​

comptime DISPATCH_HIT = 1

DISPATCH_MISS​

comptime DISPATCH_MISS = 0

logger​

comptime logger = Logger(stdout, prefix=String(""), source_location=False)

Functions​

  • ​block_scaled_matmul_block_diagonal: Computes a block-diagonal block-scaled matmul on SM100.
  • ​heuristic_and_outliers_dispatch: Dispatches an SM100 block-scaled matmul by selecting a tuning config from per-format outlier tables for specific M ranges, falling back to a small-BN config for GEMVs (m == 1) and a heuristic config table for the remaining cases. Returns DISPATCH_HIT when a matching config is found and launched, or DISPATCH_MISS when no config matches.

Was this page helpful?