For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo function

fp8_p_rescale_threshold

def fp8_p_rescale_threshold[fp8_p: Bool](threshold: Float32) -> Float32

Returns the lazy-rescale threshold the softmax uses.

Parameters:

• ​fp8_p (Bool): Whether P is converted to fp8 before the P@V MMA.

Args:

• ​threshold (Float32): The configured threshold, in the log2 domain.

Returns:

Float32: The threshold, capped at -2 when fp8_p is True.