For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo module

mtp

Graph-op bindings for multi-token-prediction draft layers.

The kernel math lives in nn.mtp_eh_norm. Registration must be declared inside the built-in kernel library; importing the kernel from nn does not add the op to the graph compiler's registry.

Structs

• ​MTPEhNorm: Registers the mo.mtp.eh_norm graph op with the graph compiler.