frankmorales2020
commited on
Commit
•
9b93d23
1
Parent(s):
fca9d67
Update README.md
Browse files
README.md
CHANGED
@@ -20,21 +20,21 @@ should probably proofread and complete it, then remove this comment. -->
|
|
20 |
|
21 |
This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) on the generator dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
-
- Loss:
|
24 |
|
25 |
## Model description
|
26 |
|
27 |
-
|
28 |
|
29 |
-
## Intended uses & limitations
|
30 |
-
|
31 |
-
More information needed
|
32 |
|
33 |
## Training and evaluation data
|
34 |
|
35 |
-
|
|
|
|
|
|
|
|
|
36 |
|
37 |
-
## Training procedure
|
38 |
|
39 |
### Training hyperparameters
|
40 |
|
@@ -52,12 +52,6 @@ The following hyperparameters were used during training:
|
|
52 |
|
53 |
### Training results
|
54 |
|
55 |
-
| Training Loss | Epoch | Step | Validation Loss |
|
56 |
-
|:-------------:|:------:|:----:|:---------------:|
|
57 |
-
| 2.5114 | 0.0164 | 100 | 2.4076 |
|
58 |
-
| 2.4269 | 0.0327 | 200 | 2.4570 |
|
59 |
-
| 2.4619 | 0.0491 | 300 | 2.4668 |
|
60 |
-
| 2.4684 | 0.0654 | 400 | 2.4725 |
|
61 |
|
62 |
|
63 |
### Framework versions
|
|
|
20 |
|
21 |
This model is a fine-tuned version of [meta-llama/Meta-Llama-3-8B](https://huggingface.co/meta-llama/Meta-Llama-3-8B) on the generator dataset.
|
22 |
It achieves the following results on the evaluation set:
|
23 |
+
- Loss: TBD
|
24 |
|
25 |
## Model description
|
26 |
|
27 |
+
Article: https://medium.com/@frankmorales_91352/fine-tuning-meta-llama-3-8b-with-medal-a-refined-approach-for-enhanced-medical-language-b924d226b09d
|
28 |
|
|
|
|
|
|
|
29 |
|
30 |
## Training and evaluation data
|
31 |
|
32 |
+
Article: https://medium.com/@frankmorales_91352/fine-tuning-meta-llama-3-8b-with-medal-a-refined-approach-for-enhanced-medical-language-b924d226b09d
|
33 |
+
|
34 |
+
Fine-Tuning: https://github.com/frank-morales2020/MLxDL/blob/main/FineTuning_LLM_Meta_Llama_3_8B_for_MEDAL_EVALDATA.ipynb
|
35 |
+
|
36 |
+
Evaluation: https://github.com/frank-morales2020/MLxDL/blob/main/Meta_Llama_3_8B_for_MEDAL_EVALUATOR_evaldata.ipynb
|
37 |
|
|
|
38 |
|
39 |
### Training hyperparameters
|
40 |
|
|
|
52 |
|
53 |
### Training results
|
54 |
|
|
|
|
|
|
|
|
|
|
|
|
|
55 |
|
56 |
|
57 |
### Framework versions
|