For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
NVFP4PrefillWorkspace
struct NVFP4PrefillWorkspace
Owns reusable conversion storage allocated outside graph recording.
Fields
- fp8 (
DeviceBuffer[.float8_e4m3fn]): - page_slots (
DeviceBuffer[.uint32]): - indices (
DeviceBuffer[.int32]):
Implemented traits
Methods
__init__
def __init__(out self, fp8_elems: Int, num_blocks: Int, indices_elems: Int, ctx: DeviceContext)