For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo function
mla_kv_is_nvfp4
def mla_kv_is_nvfp4[KVType: MHAOperand]() -> Bool
Whether the KV operand stores packed NVFP4 (uint8 + E4M3 scales).
The operand's quantization_granularity counts packed bytes, so 16
elements are 8 of them.
Returns: