For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
Struct_fused_token_sampling
struct Struct_fused_token_sampling
Registers the sampler.fused_token_sampling graph op with the graph compiler.
Implemented traitsโ
Methodsโ
executeโ
static def execute[_trace_name: StaticString](out_idxs: T, K: T, max_k: Scalar, temperature: T, top_p: T, min_top_p: Float32, min_p: T, seed: T, input: T, ctx: DeviceContext)