saheedniyi
commited on
Commit
•
25df64b
1
Parent(s):
b18114d
Update README.md
Browse files
README.md
CHANGED
@@ -11,9 +11,9 @@ pipeline_tag: text-generation
|
|
11 |
# Model Card for Model ID
|
12 |
|
13 |
<!-- Provide a quick summary of what the model is/does. -->
|
14 |
-
|
15 |
-
|
16 |
-
|
17 |
## Model Details
|
18 |
|
19 |
### Model Description
|
|
|
11 |
# Model Card for Model ID
|
12 |
|
13 |
<!-- Provide a quick summary of what the model is/does. -->
|
14 |
+
Excited to announce the release of Llama3-8b-Naija_v1 a finetuned version of Meta-Llama-3-8B trained on a Question - Answer dataset from Nairaland.
|
15 |
+
Llama3-8b-Naija_v1 is developed using QLora Fine-tuning with a rank of 64 and Alpha of 128. The model was built in an attempt to "Nigerialize" Llama-3, giving it a Nigerian - like behavior.
|
16 |
+
The model was trained on Google colab and it took about 12 hrs on the A100 GPU.
|
17 |
## Model Details
|
18 |
|
19 |
### Model Description
|