deveshreddy27 commited on
Commit
a400ac7
·
verified ·
1 Parent(s): 9ab7d34

End of training

Browse files
Files changed (1) hide show
  1. README.md +13 -1
README.md CHANGED
@@ -6,6 +6,8 @@ tags:
6
  - sft
7
  - generated_from_trainer
8
  base_model: microsoft/phi-1_5
 
 
9
  model-index:
10
  - name: phiverse-1_5-lora-tuned-dolly.sft
11
  results: []
@@ -16,7 +18,9 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  # phiverse-1_5-lora-tuned-dolly.sft
18
 
19
- This model is a fine-tuned version of [microsoft/phi-1_5](https://huggingface.co/microsoft/phi-1_5) on an unknown dataset.
 
 
20
 
21
  ## Model description
22
 
@@ -46,6 +50,14 @@ The following hyperparameters were used during training:
46
  - lr_scheduler_warmup_ratio: 0.05
47
  - training_steps: 296
48
 
 
 
 
 
 
 
 
 
49
  ### Framework versions
50
 
51
  - PEFT 0.11.1
 
6
  - sft
7
  - generated_from_trainer
8
  base_model: microsoft/phi-1_5
9
+ datasets:
10
+ - generator
11
  model-index:
12
  - name: phiverse-1_5-lora-tuned-dolly.sft
13
  results: []
 
18
 
19
  # phiverse-1_5-lora-tuned-dolly.sft
20
 
21
+ This model is a fine-tuned version of [microsoft/phi-1_5](https://huggingface.co/microsoft/phi-1_5) on the generator dataset.
22
+ It achieves the following results on the evaluation set:
23
+ - Loss: 2.4899
24
 
25
  ## Model description
26
 
 
50
  - lr_scheduler_warmup_ratio: 0.05
51
  - training_steps: 296
52
 
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss |
56
+ |:-------------:|:------:|:----:|:---------------:|
57
+ | 2.7682 | 1.6129 | 100 | 2.5802 |
58
+ | 2.5575 | 3.2258 | 200 | 2.4899 |
59
+
60
+
61
  ### Framework versions
62
 
63
  - PEFT 0.11.1