For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_moe_single_group_router_eplb
struct Struct_moe_single_group_router_eplb
Registers the moe.single.group.router.eplb graph op with the graph compiler.
Implemented traitsโ
Methodsโ
executeโ
static def execute[n_routed_experts: Int, n_experts_per_tok: Int, norm_weights: Bool, num_log: Int, max_replicas: Int, hash_decorrelate: Bool](expert_indices: T, expert_indices_log: T, expert_weights: T, expert_scores: T, expert_bias: T, logcnt: T, log2phy: T, layer_idx: T, routed_scaling_factor: Float32, context: DeviceContext)