Update README.md
Browse files
README.md
CHANGED
|
@@ -10,16 +10,18 @@ Fine-tuned Llama3-8b model with Lora (trained 1 epoch on colap A100 for experime
|
|
| 10 |
|
| 11 |
Base Model: unsloth/llama-3-8b-bnb-4bit
|
| 12 |
|
| 13 |
-
Fine-tuning process https://www.youtube.com/watch?v=pK8u4QfdLx0&ab_channel=DavidOndrej
|
|
|
|
| 14 |
Turkish Fine-tune notebook: https://github.com/yudumpacin/LLM/blob/main/Alpaca_%2B_Llama_3_8b_full_Turkish.ipynb
|
|
|
|
| 15 |
Original unsloth notebook: https://colab.research.google.com/drive/135ced7oHytdxu3N2DNe1Z0kqjyYIkDXp?usp=sharing
|
| 16 |
|
| 17 |
Fine-tuning data :
|
| 18 |
-
Yudum/turkish-instruct-dataset which includes;
|
| 19 |
-
open question category of atasoglu/databricks-dolly-15k-tr
|
| 20 |
-
parsak/alpaca-tr-1k-longest
|
| 21 |
-
TFLai/Turkish-Alpaca
|
| 22 |
-
umarigan/GPTeacher-General-Instruct-tr
|
| 23 |
|
| 24 |
# Usage
|
| 25 |
```python
|
|
|
|
| 10 |
|
| 11 |
Base Model: unsloth/llama-3-8b-bnb-4bit
|
| 12 |
|
| 13 |
+
Fine-tuning process video: https://www.youtube.com/watch?v=pK8u4QfdLx0&ab_channel=DavidOndrej
|
| 14 |
+
|
| 15 |
Turkish Fine-tune notebook: https://github.com/yudumpacin/LLM/blob/main/Alpaca_%2B_Llama_3_8b_full_Turkish.ipynb
|
| 16 |
+
|
| 17 |
Original unsloth notebook: https://colab.research.google.com/drive/135ced7oHytdxu3N2DNe1Z0kqjyYIkDXp?usp=sharing
|
| 18 |
|
| 19 |
Fine-tuning data :
|
| 20 |
+
- Yudum/turkish-instruct-dataset which includes;
|
| 21 |
+
* open question category of atasoglu/databricks-dolly-15k-tr
|
| 22 |
+
* parsak/alpaca-tr-1k-longest
|
| 23 |
+
* TFLai/Turkish-Alpaca
|
| 24 |
+
* umarigan/GPTeacher-General-Instruct-tr
|
| 25 |
|
| 26 |
# Usage
|
| 27 |
```python
|