For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo function
qk_norm_rope_store
def qk_norm_rope_store[cache_dtype: DType, freq_dtype: DType, //, n_q: Int, n_kv: Int, page_size: Int, poison: Int = Int(0)](a: QkArgs[cache_dtype, freq_dtype], ctx: DeviceContext)
Writes the roped Q and stores the roped K and the V.
The projection's rows and the Q output are 16-byte aligned. poison
plants a fault for the tests.