For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

row_mean_of_squares_qk

def row_mean_of_squares_qk[in_dtype: DType, out_dtype: DType, //, target: StringSpan[ImmStaticOrigin] = StringSpan("cpu")](output: TileTensor[out_dtype, Storage=output.Storage, address_space=output.address_space, linear_idx_type=output.linear_idx_type], query: TileTensor[in_dtype, Storage=query.Storage, address_space=query.address_space, linear_idx_type=query.linear_idx_type], key: TileTensor[in_dtype, Storage=key.Storage, address_space=key.address_space, linear_idx_type=key.linear_idx_type], rows: Int, q_cols: Int, k_cols: Int, ctx: DeviceContext)