For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
PaddedFlashAttentionGPU
struct PaddedFlashAttentionGPU
Registers the attention.mha.padded.no_cache graph op with the graph compiler.
Implemented traitsโ
Methodsโ
executeโ
static def execute[mask_str: StaticString, local_window_size: Int = Int(-1)](output: T, q: T, k: T, v: T, valid_length: T, scale: Float32, ctx: DeviceContext)