IMPORTANT: To view this page as Markdown, append `.md` to the URL (e.g. /get-started.md). For the complete documentation index, see llms.txt.
Skip to main content
For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo struct

NVFP4PrefillWorkspace

struct NVFP4PrefillWorkspace

Owns reusable conversion storage allocated outside graph recording.

Fields​

  • ​fp8 (DeviceBuffer[.float8_e4m3fn]):
  • ​page_slots (DeviceBuffer[.uint32]):
  • ​indices (DeviceBuffer[.int32]):

Implemented traits​

AnyType, Deinitable, Movable

Methods​

__init__​

def __init__(out self, fp8_elems: Int, num_blocks: Int, indices_elems: Int, ctx: DeviceContext)

view​

def view(mut self) -> NVFP4PrefillWorkspaceView

Returns:

NVFP4PrefillWorkspaceView

Was this page helpful?