IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

Struct_indexer_q_ssmax_rope_quantize_fp8

struct Struct_indexer_q_ssmax_rope_quantize_fp8

Registers indexer.q.ssmax_rope_quantize.fp8.

Applies SSMax to a [rows, heads, 128] index query, rotates the leading rope_dim columns of each head, and FP8-quantizes each head with one E8M0 scale, in one launch. See nn.indexer_qk_quantize.

Implemented traitsโ€‹

AnyType, Deinitable, Movable

Methodsโ€‹

executeโ€‹

static def execute[rope_dim: Int](q_out: T, scale_out: T, q: T, positions: T, ssmax_s: T, ssmax_b: T, freqs_cis: T, input_row_offsets: T, start_pos: T, context: DeviceContext)

Was this page helpful?