For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
StateSpaceCopyRows
struct StateSpaceCopyRows
Copies selected state rows into a separately addressed scratch pool.
Only the active batch's rows move; the pool may be much larger. Both operands are mutable to order this snapshot with the verify and replay.
Implemented traits
Methods
execute
static def execute[dtype: DType, rank: Int, target: StringSpan[ImmStaticOrigin]](dst: ManagedTensorSlice[IOSpec[_, _].MutableInput, static_spec=dst.static_spec], src: ManagedTensorSlice[IOSpec[_, _].MutableInput, static_spec=src.static_spec], dst_rows: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=dst_rows.static_spec], src_rows: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=src_rows.static_spec], ctx: DeviceContextBase)