For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_indexer_q_ssmax_rope_quantize_fp8
struct Struct_indexer_q_ssmax_rope_quantize_fp8
Registers indexer.q.ssmax_rope_quantize.fp8.
Applies SSMax to a [rows, heads, 128] index query, rotates the leading
rope_dim columns of each head, and FP8-quantizes each head with one
E8M0 scale, in one launch. See nn.indexer_qk_quantize.
Implemented traitsโ
Methodsโ
executeโ
static def execute[rope_dim: Int](q_out: T, scale_out: T, q: T, positions: T, ssmax_s: T, ssmax_b: T, freqs_cis: T, input_row_offsets: T, start_pos: T, context: DeviceContext)