meta-llama

/

Llama-3.1-8B-Instruct

like 3.78k

Follow

Meta Llama 34.2k

Hello,

I am attempting to fine-tune a llama-3.1-8B-Instruct model but continue to run into this error - ValueError: rope_scaling must contain keys {'type', 'factor'}

I followed the recommendations in this post - https://huggingface.co/meta-llama/Llama-3.1-8B-Instruct/discussions/15
(mainly upgrading my transformers and VLLM but no luck. This also happens on the 1B model.

Any ideas?