IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

kv_cache

comptime values​

NVFP4_QK_LAUNCH_AUTO​

comptime NVFP4_QK_LAUNCH_AUTO = 0

NVFP4_QK_LAUNCH_ROW​

comptime NVFP4_QK_LAUNCH_ROW = 1

NVFP4_QK_LAUNCH_WARP​

comptime NVFP4_QK_LAUNCH_WARP = 2

Functions​

Was this page helpful?