IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

Mamba2SSDChunkScanVarlenFwdInplaceRows

struct Mamba2SSDChunkScanVarlenFwdInplaceRows[dt_softplus: Bool = True]

mamba2_ssd_chunk_scan_varlen_fwd_inplace in a mixed verify graph.

The verify width K is the length of verify_width, whose contents are never read. A row longer than K + 1 tokens is a prefill row: it commits its state at its last real token whatever update_state says; the flag keeps its meaning for shorter rows. A mixed launch whose prefill rows reach the chunked floor runs the serial scan with SKIP_LONG_ROWS and the chunked scan; any other launch runs one serial scan with the row rule alone.

Tensor shapes: As mamba2_ssd_chunk_scan_varlen_fwd_inplace, plus - verify_width : [K] int64

Parameters​

  • ​dt_softplus (Bool): If True (default), apply softplus to dt + dt_bias.

Implemented traits​

AnyType, Deinitable, Movable

Methods​

execute​

static def execute(y: T, x: T, dt: T, A: T, B: T, C: T, D: T, dt_bias: T, ssm_pool: T, query_start_loc: T, has_initial_state: T, cache_indices: T, update_state: T, xbc: T, verify_width: T, ctx: DeviceContext)

Was this page helpful?