For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).
Mojo struct
GateArgs
struct GateArgs
head_norm_gate's operands, one kernel parameter.
Fields
- x (
In[.bfloat16]): The attention output[tokens, n_heads * HEAD_DIM]. - gate (
In[.bfloat16]): The gate's first column,gate_strideelements a token. - out (
Out[.bfloat16]): - gate_stride (
Int64): - tokens (
Int64): - eps (
Float32):
Implemented traits
AnyType,
Copyable,
Deinitable,
DevicePassable,
ImplicitlyCopyable,
Movable
comptime members
device_type
comptime device_type = GateArgs