IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

attn_res

Graph-op binding for Kimi K3's attention-residual softmax mixture.

The kernel lives in //Kernels/lib/attn_res (attn_res.mix); only the @extensibility.register wrapper lives here, mirroring the msa.mojo binding -- registration has to be declared inside the built-in kernel library itself, not the standalone lib, for a served graph to resolve the op.

Structs

  • AttnResMix: Kimi K3 attention-residual softmax mixture, fused into one kernel.