IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

block_scaled_quantization

Provides block-scaled quantization kernels for NVFP4, MXFP4, and MXFP8.

comptime values​

logger​

comptime logger = Logger(stdout, prefix=String(""), source_location=False)

nvfp4_row_input_fn_type​

comptime nvfp4_row_input_fn_type = def[dtype: DType, width: SIMDLength](SIMD[dtype, width]) capturing thin -> SIMD[dtype, width]

Elementwise transform applied to each input vector before quantizing.

grouped_quantize_nvfp4_row_amax quantizes input_fn(x) in place of x, for both the row amax and the payload; the result is rounded to the input dtype, as the graph op it replaces would round it. The graph op passes the Nemotron-H relu(x) * relu(x) built from nn.activations.relu.

Functions​

Was this page helpful?