For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /max/get-started.md).
Mojo struct
Struct_lora_sgmv_qkv_expand_ragged
struct Struct_lora_sgmv_qkv_expand_ragged
Implemented traits
Methods
execute
static def execute[q_type: DType, kv_type: DType, p_type: DType, b_type: DType, //, target: StringSlice[ImmStaticOrigin]](q_out: ManagedTensorSlice[IOSpec[_, _].Output, static_spec=q_out.static_spec], kv_out: ManagedTensorSlice[IOSpec[_, _].Output, static_spec=kv_out.static_spec], p: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=p.static_spec], b: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=b.static_spec], lora_grouped_offsets: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=lora_grouped_offsets.static_spec], lora_ids: ManagedTensorSlice[IOSpec[_, _].Input, static_spec=lora_ids.static_spec], max_seq_length: UInt32, context: DeviceContext)
Was this page helpful?
Thank you! We'll create more content like this.
Thank you for helping us improve!