Updates in EXAONE-3.5
Key Changes
- RoPE Scaling Parameter: Added to support longer
context_length. - Memory Optimization: For the 2.4B model,
tie_word_embeddingsis set toTruefor improved memory efficiency.
⚠️ Using the original Llamafy script as-is may lead to performance degradation.
To address this, I have updated the script and uploaded the Llamafied version of the model.
Special Thanks
@maywell
For updating the code and uploading the model.LG AI Research
For releasing the original model.
Check out the original release here.
- Downloads last month
- 15
Inference Providers
NEW
This model is not currently available via any of the supported third-party Inference Providers, and
the model is not deployed on the HF Inference API.