forbiddensoul90
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -110,8 +110,8 @@ Output:
|
|
110 |
1. **Framework:** The fine-tuning was conducted using [Unsloth](https://github.com/unsloth/unsloth), a LoRA-based fine-tuning library.
|
111 |
2. **Steps:**
|
112 |
- Initialized the Llama-3.1-8B-Instruct model.
|
113 |
-
- Applied LoRA adapters for efficient training.
|
114 |
-
-
|
115 |
3. **Hardware:** High-performance A100 GPUs provided by Meluxina ensured rapid convergence.
|
116 |
|
117 |
## Dataset Description
|
|
|
110 |
1. **Framework:** The fine-tuning was conducted using [Unsloth](https://github.com/unsloth/unsloth), a LoRA-based fine-tuning library.
|
111 |
2. **Steps:**
|
112 |
- Initialized the Llama-3.1-8B-Instruct model.
|
113 |
+
- Applied LoRA adapters for efficient training via Unsloth.
|
114 |
+
- Evaluated the best checkpoints on preliminary benchmarks.
|
115 |
3. **Hardware:** High-performance A100 GPUs provided by Meluxina ensured rapid convergence.
|
116 |
|
117 |
## Dataset Description
|