For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
MatmulSwiGLUBias
struct MatmulSwiGLUBias
Fused GEMM+SwiGLU+bias on SM100 for BF16 inputs.
Like matmul.swiglu but adds a 1D bias vector before the activation.
The bias must be sigma-permuted to match the weight layout: even element
bias[2h] is added to the gate column and odd element bias[2h+1] to
the up column before silu(gate) * up is computed.
Implemented traitsโ
Methodsโ
executeโ
static def execute(output: T, a: T, b: T, bias: T, ctx: DeviceContext)