IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

ihc_mix_gemv_kernel

def ihc_mix_gemv_kernel[dtype: DType, PartialsLayoutType: TensorLayout, StreamsLayoutType: TensorLayout, WeightLayoutType: TensorLayout, num_mix: Int, k: Int, num_warps: Int, poison: Int](partials: TileTensor[.float32, PartialsLayoutType, MutUntrackedOrigin], streams: TileTensor[dtype, StreamsLayoutType, ImmUntrackedOrigin], weight: TileTensor[.float32, WeightLayoutType, ImmUntrackedOrigin], num_rows: Int32)

Runs ihc_mix_gemv_block for block (row_block, split).

Parameters:

  • ​dtype (DType): The stream dtype.
  • ​PartialsLayoutType (TensorLayout): Layout of partials.
  • ​StreamsLayoutType (TensorLayout): Layout of streams.
  • ​WeightLayoutType (TensorLayout): Layout of weight.
  • ​num_mix (Int): Number of weight rows.
  • ​k (Int): Width of the flattened streams, hc_mult * hidden.
  • ​num_warps (Int): Warps per block.
  • ​poison (Int): A planted fault (IHC_POISONS), 0 for none.

Args:

Was this page helpful?