For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Python class
PagedCacheValues
PagedCacheValues
max.nn.kv_cache.PagedCacheValues
Paged KV cache inputs for one device, with cache blocks and lengths as graph values.
alias of KVCacheInputsPerDevice[TensorValue, BufferValue]