IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

qk_norm_rope_store

def qk_norm_rope_store[cache_dtype: DType, freq_dtype: DType, //, n_q: Int, n_kv: Int, page_size: Int, poison: Int = Int(0)](a: QkArgs[cache_dtype, freq_dtype], ctx: DeviceContext)

Writes the roped Q and stores the roped K and the V.

The projection's rows and the Q output are 16-byte aligned. poison plants a fault for the tests.

Was this page helpful?