For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Mamba2SSDChunkScanVarlenFwdInplaceRows
struct Mamba2SSDChunkScanVarlenFwdInplaceRows[dt_softplus: Bool = True]
mamba2_ssd_chunk_scan_varlen_fwd_inplace in a mixed verify graph.
The verify width K is the length of verify_width, whose contents
are never read. A row longer than K + 1 tokens is a prefill row: it
commits its state at its last real token whatever update_state
says; the flag keeps its meaning for shorter rows. A mixed launch
whose prefill rows reach the chunked floor runs the serial scan with
SKIP_LONG_ROWS and the chunked scan; any other launch runs one
serial scan with the row rule alone.
Tensor shapes:
As mamba2_ssd_chunk_scan_varlen_fwd_inplace, plus
- verify_width : [K] int64
Parameters
- dt_softplus (
Bool): If True (default), apply softplus todt + dt_bias.
Implemented traits
Methods
execute
static def execute(y: T, x: T, dt: T, A: T, B: T, C: T, D: T, dt_bias: T, ssm_pool: T, query_start_loc: T, has_initial_state: T, cache_indices: T, update_state: T, xbc: T, verify_width: T, ctx: DeviceContext)