For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python class

AttnKeyInterface

AttnKeyInterface

class max.nn.kv_cache.AttnKeyInterface

source

Bases: object

Common base for resolved attention keys.

pack_into_buffer()

pack_into_buffer(device, max_cache_valid_length)

source

Packs this into a kernel dispatch-metadata buffer.

max_cache_valid_length is the runtime cache length; it is supplied here rather than stored so the identity is independent of it.

Parameters:

• device (Device)
• max_cache_valid_length (int)

Return type:

Buffer