For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo module
attn_res
Graph-op binding for Kimi K3's attention-residual softmax mixture.
The kernel lives in //Kernels/lib/attn_res (attn_res.mix); only the
@extensibility.register wrapper lives here, mirroring the msa.mojo
binding -- registration has to be declared inside the built-in kernel
library itself, not the standalone lib, for a served graph to resolve
the op.
Structs
-
AttnResMix: Kimi K3 attention-residual softmax mixture, fused into one kernel.