jalr/tabbyAPI-ollama
1
0
Fork 0
Code Issues Pull requests Projects Releases Packages Wiki Activity Actions

Fix RoPE Ratio

Browse source
This commit is contained in:
Vhallo 2025-04-21 01:46:18 +02:00 • committed by GitHub
parent 13beef8021
commit 1aefa01a68
No known key found for this signature in database
GPG key ID: B5690EEEBB952194
1 changed files with 1 additions and 1 deletions
Download patch file Download diff file Expand all files Collapse all files

2
common/utils.py
View file

@ -98,7 +98,7 @@ def calculate_rope_alpha(base_seq_len: int, target_seq_len: int):
"""
# Get the ratio of the model's max sequence length to the target
ratio = base_seq_len / target_seq_len
ratio = target_seq_len / base_seq_len
# Default to a 1 alpha if the sequence length is ever less
# than or equal to 1