forbiddensoul90 commited on
Commit
accf567
·
verified ·
1 Parent(s): 754a142

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -2
README.md CHANGED
@@ -110,8 +110,8 @@ Output:
110
  1. **Framework:** The fine-tuning was conducted using [Unsloth](https://github.com/unsloth/unsloth), a LoRA-based fine-tuning library.
111
  2. **Steps:**
112
  - Initialized the Llama-3.1-8B-Instruct model.
113
- - Applied LoRA adapters for efficient training.
114
- - Fine-tuned using the Luxembourgish CoT dataset on the Meluxina HPC cluster.
115
  3. **Hardware:** High-performance A100 GPUs provided by Meluxina ensured rapid convergence.
116
 
117
  ## Dataset Description
 
110
  1. **Framework:** The fine-tuning was conducted using [Unsloth](https://github.com/unsloth/unsloth), a LoRA-based fine-tuning library.
111
  2. **Steps:**
112
  - Initialized the Llama-3.1-8B-Instruct model.
113
+ - Applied LoRA adapters for efficient training via Unsloth.
114
+ - Evaluated the best checkpoints on preliminary benchmarks.
115
  3. **Hardware:** High-performance A100 GPUs provided by Meluxina ensured rapid convergence.
116
 
117
  ## Dataset Description