For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Mojo trait

RowScales

Per-row output scales applied in the epilogue.

Implemented traits

AnyType, Copyable, Deinitable, DevicePassable, ImplicitlyCopyable, Movable, RegisterPassable, TrivialRegisterPassable

comptime members

Enabled

comptime Enabled

Whether the epilogue applies row scales. False compiles them out.

Required methods

load

def load(self, row: Int) -> Float32

Returns the scale of one output row.

Args:

• ​row (Int): Absolute output row (token) index.

Returns:

Float32: The row's scale.