IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

ep_p2p_dispatch_header_bytes

def ep_p2p_dispatch_header_bytes[n_experts: Int, n_ranks: Int, max_tokens_per_rank: Int, top_k: Int]() -> Int

Returns the bytes ep.init puts before each single-node dispatch receive buffer that takes the P2P paths: the small path's flags, and the prefill dispatch's scratch when it is on. None of it depends on the message size, so exchanges that share the buffers agree on it.

Returns:

Int

Was this page helpful?