IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

qk_lane

def qk_lane[cache_dtype: DType, freq_dtype: DType, //, n_q: Int, n_kv: Int, page_size: Int, poison: Int](a: QkArgs[cache_dtype, freq_dtype], i: Int)

Lane i's 8 channels of its (token, head) row. Every lane of a token's warps must call it: the norm and RoPE shuffle across them.

Was this page helpful?