For the complete documentation index, see llms.txt. Markdown versions of all pages are available by appending .md to any URL (e.g. /get-started.md).

Python class

Llama3RopeScalingParams

Llama3RopeScalingParams

class max.nn.Llama3RopeScalingParams(factor, low_freq_factor, high_freq_factor, orig_max_position)

source

Bases: object

Scaling parameters for Llama3’s frequency-based context extension.

Parameters:

• factor (float)
• low_freq_factor (float)
• high_freq_factor (float)
• orig_max_position (int)

factor

factor: float

source

Main scaling factor for the frequency components of the rope.

high_freq_factor

high_freq_factor: float

source

Factor to scale the high frequency components of the rope.

low_freq_factor

low_freq_factor: float

source

Factor to scale the low frequency components of the rope.

orig_max_position

orig_max_position: int

source

The original maximum position length supported by the model.