Grigorij
/

zephyr_instruct_generation

Generated from Trainer

Model card Files Files and versions Community

Grigorij commited on Jan 1

Commit

0f671d8

•

1 Parent(s): 53d72ed

Model save

Files changed (1) hide show

README.md +16 -16

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
 This model is a fine-tuned version of [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.9931
 ## Model description
@@ -50,21 +50,21 @@ The following hyperparameters were used during training:
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
-| 3.0117        | 0.77  | 10   | 2.3732          |
-| 1.8306        | 1.54  | 20   | 1.3573          |
-| 1.0831        | 2.31  | 30   | 1.0436          |
-| 0.9737        | 3.08  | 40   | 0.9262          |
-| 0.8221        | 3.85  | 50   | 0.8332          |
-| 0.6876        | 4.62  | 60   | 0.7937          |
-| 0.6528        | 5.38  | 70   | 0.7810          |
-| 0.5818        | 6.15  | 80   | 0.7389          |
-| 0.5041        | 6.92  | 90   | 0.7892          |
-| 0.4484        | 7.69  | 100  | 0.7777          |
-| 0.3876        | 8.46  | 110  | 0.8553          |
-| 0.3731        | 9.23  | 120  | 0.8669          |
-| 0.338         | 10.0  | 130  | 0.8619          |
-| 0.318         | 10.77 | 140  | 0.9050          |
-| 0.3198        | 11.54 | 150  | 0.9931          |
 ### Framework versions

 This model is a fine-tuned version of [HuggingFaceH4/zephyr-7b-beta](https://huggingface.co/HuggingFaceH4/zephyr-7b-beta) on an unknown dataset.
 It achieves the following results on the evaluation set:
+- Loss: 0.5753
 ## Model description
 | Training Loss | Epoch | Step | Validation Loss |
 |:-------------:|:-----:|:----:|:---------------:|
+| 2.8455        | 0.4   | 10   | 2.2310          |
+| 1.8394        | 0.8   | 20   | 1.3360          |
+| 1.0736        | 1.2   | 30   | 0.9132          |
+| 0.8515        | 1.6   | 40   | 0.7353          |
+| 0.7499        | 2.0   | 50   | 0.6281          |
+| 0.5876        | 2.4   | 60   | 0.5897          |
+| 0.6041        | 2.8   | 70   | 0.5737          |
+| 0.5057        | 3.2   | 80   | 0.5581          |
+| 0.512         | 3.6   | 90   | 0.5704          |
+| 0.5419        | 4.0   | 100  | 0.5537          |
+| 0.4451        | 4.4   | 110  | 0.5777          |
+| 0.4467        | 4.8   | 120  | 0.5541          |
+| 0.4351        | 5.2   | 130  | 0.5612          |
+| 0.3963        | 5.6   | 140  | 0.5898          |
+| 0.4264        | 6.0   | 150  | 0.5753          |
 ### Framework versions