IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

Struct_compress_windows_ragged_paged

struct Struct_compress_windows_ragged_paged

Registers the attention.compress_windows.ragged.paged graph op with the graph compiler.

DeepSeek-V4's compressor over the windows of a ragged chunk, reading the positions before the chunk from a paged state leaf. See nn.attention.compress_windows.

Implemented traitsโ€‹

AnyType, Deinitable, Movable

Methodsโ€‹

executeโ€‹

static def execute[rotate: Bool](output: T, kv: T, score: T, ape: T, norm_weight: T, freqs: T, input_row_offsets: T, window_offsets: T, starts: T, kv_blocks: T, page_stride: T, cache_lengths: T, kv_lookup_table: T, max_prompt_length: T, max_cache_length: T, layer: UInt32, epsilon: Float32, context: DeviceContext)

Was this page helpful?