IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

ep_p2p_prefill_on

def ep_p2p_prefill_on[n_experts: Int, n_ranks: Int, top_k: Int]() -> Bool

Whether a step the P2P small path declines takes the P2P prefill dispatch and the partial-row combine, which the dispatch and combine APIs decide alike: a token's partial rows (one per device) take the slots of its top-k rows, the kernels hold top-k-wide vectors, and the place kernel has a thread per expert group.

Returns:

Bool

Was this page helpful?