IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python class

PagedCacheValues

PagedCacheValues​

max.nn.kv_cache.PagedCacheValues

source

Paged KV cache inputs for one device, with cache blocks and lengths as graph values.

alias of KVCacheInputsPerDevice[TensorValue, BufferValue]