For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

q4_k_dequantize_impl

def q4_k_dequantize_impl(input_tt: TileTensor[.uint8, Engine=input_tt.Engine, linear_idx_type=input_tt.linear_idx_type], output_tt: TileTensor[.float32, Engine=output_tt.Engine, linear_idx_type=output_tt.linear_idx_type])

Dequantizes a Q4_K encoded tensor into a float32 output tensor.

Args:

• ​input_tt (TileTensor[.uint8, Engine=input_tt.Engine, linear_idx_type=input_tt.linear_idx_type]): The input tensor containing Q4_K encoded data.
• ​output_tt (TileTensor[.float32, Engine=output_tt.Engine, linear_idx_type=output_tt.linear_idx_type]): The output tensor to write dequantized float32 values to.