metadata
license: other
license_name: exaone
license_link: LICENSE
language:
- en
- ko
tags:
- lg-ai
- exaone
- exaone-3.5
pipeline_tag: text-generation
library_name: transformers
Updates in EXAONE-3.5
Key Changes
- RoPE Scaling Parameter: Added to support longer
context_length
. - Memory Optimization: For the 2.4B model,
tie_word_embeddings
is set toTrue
for improved memory efficiency.
⚠️ Using the original Llamafy script as-is may lead to performance degradation.
To address this, I have updated the script and uploaded the Llamafied version of the model.
Special Thanks
@maywell
For updating the code and uploading the model.LG AI Research
For releasing the original model.
Check out the original release here.