datalama/EXAONE-3.5-32B-Instruct-Llamafied

Updates in EXAONE-3.5

Key Changes

• RoPE Scaling Parameter: Added to support longer context_length.
• Memory Optimization: For the 2.4B model, tie_word_embeddings is set to True for improved memory efficiency.

⚠️ Using the original Llamafy script as-is may lead to performance degradation.

To address this, I have updated the script and uploaded the Llamafied version of the model.

Special Thanks

• @maywell
  For updating the code and uploading the model.

• LG AI Research
  For releasing the original model.
  Check out the original release here.