For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
KBufferConfig
struct KBufferConfig[BN: Int, BK: Int, WN: Int]
K-role decode buffer config that iterates DRAM along the column axis.
The warp tile is [WN, BK] (key-block width by strip width), the block
tile is [BN, BK], and iterator_axis = 1 advances tile_idx across
column strips of the DRAM tile.
Parameters
- BN (
Int): Number of keys per block tile (extent along the key axis). - BK (
Int): Strip width along the MMA K dimension. - WN (
Int): Number of keys per warp tile.
Implemented traits
AnyType,
Deinitable,
KVBufferConfig,
Movable
comptime members
btile_dim0
comptime btile_dim0 = BN
btile_dim1
comptime btile_dim1 = BK
iterator_axis
comptime iterator_axis = 1
wsize
comptime wsize = KBufferConfig[BN, BK, WN].wtile_dim0
wtile_dim0
comptime wtile_dim0 = WN
wtile_dim1
comptime wtile_dim1 = BK