IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

nvfp4_mla_row_bytes

def nvfp4_mla_row_bytes[input_q_depth: Int]() -> Int

Bytes of one NVFP4 MLA cache row: the packed latent, then FP8 rope.

Returns:

Int

Was this page helpful?