IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

mla_kv_is_nvfp4

def mla_kv_is_nvfp4[KVType: MHAOperand]() -> Bool

Whether the KV operand stores packed NVFP4 (uint8 + E4M3 scales).

The operand's quantization_granularity counts packed bytes, so 16 elements are 8 of them.

Returns:

Bool

Was this page helpful?