For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_kv_cache_row_offsets_ragged_paged
struct Struct_kv_cache_row_offsets_ragged_paged
Registers the kv_cache.row_offsets.ragged.paged graph op with the graph compiler.
Implemented traitsโ
Methodsโ
executeโ
static def execute(cache_row_offsets: T, input_row_offsets: T, cache_lengths: T, context: DeviceContext)