satyanshu404 commited on
Commit
1dfb630
1 Parent(s): 8b6052d

End of training

Browse files
Files changed (2) hide show
  1. README.md +106 -0
  2. generation_config.json +7 -0
README.md ADDED
@@ -0,0 +1,106 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ base_model: google/long-t5-local-base
4
+ tags:
5
+ - generated_from_trainer
6
+ model-index:
7
+ - name: long-t5-local-base-finetuned-justification-v08
8
+ results: []
9
+ ---
10
+
11
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
+ should probably proofread and complete it, then remove this comment. -->
13
+
14
+ # long-t5-local-base-finetuned-justification-v08
15
+
16
+ This model is a fine-tuned version of [google/long-t5-local-base](https://huggingface.co/google/long-t5-local-base) on the None dataset.
17
+ It achieves the following results on the evaluation set:
18
+ - Loss: nan
19
+
20
+ ## Model description
21
+
22
+ More information needed
23
+
24
+ ## Intended uses & limitations
25
+
26
+ More information needed
27
+
28
+ ## Training and evaluation data
29
+
30
+ More information needed
31
+
32
+ ## Training procedure
33
+
34
+ ### Training hyperparameters
35
+
36
+ The following hyperparameters were used during training:
37
+ - learning_rate: 3e-07
38
+ - train_batch_size: 1
39
+ - eval_batch_size: 1
40
+ - seed: 42
41
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
+ - lr_scheduler_type: linear
43
+ - num_epochs: 50
44
+
45
+ ### Training results
46
+
47
+ | Training Loss | Epoch | Step | Validation Loss |
48
+ |:-------------:|:-----:|:-----:|:---------------:|
49
+ | 5.1991 | 1.0 | 676 | nan |
50
+ | 0.0 | 2.0 | 1352 | nan |
51
+ | 0.0 | 3.0 | 2028 | nan |
52
+ | 0.0 | 4.0 | 2704 | nan |
53
+ | 0.0 | 5.0 | 3380 | nan |
54
+ | 0.0 | 6.0 | 4056 | nan |
55
+ | 0.0 | 7.0 | 4732 | nan |
56
+ | 0.0 | 8.0 | 5408 | nan |
57
+ | 0.0 | 9.0 | 6084 | nan |
58
+ | 0.0 | 10.0 | 6760 | nan |
59
+ | 0.0 | 11.0 | 7436 | nan |
60
+ | 0.0 | 12.0 | 8112 | nan |
61
+ | 0.0 | 13.0 | 8788 | nan |
62
+ | 0.0 | 14.0 | 9464 | nan |
63
+ | 0.0 | 15.0 | 10140 | nan |
64
+ | 0.0 | 16.0 | 10816 | nan |
65
+ | 0.0 | 17.0 | 11492 | nan |
66
+ | 0.0 | 18.0 | 12168 | nan |
67
+ | 0.0 | 19.0 | 12844 | nan |
68
+ | 0.0 | 20.0 | 13520 | nan |
69
+ | 0.0 | 21.0 | 14196 | nan |
70
+ | 0.0 | 22.0 | 14872 | nan |
71
+ | 0.0 | 23.0 | 15548 | nan |
72
+ | 0.0 | 24.0 | 16224 | nan |
73
+ | 0.0 | 25.0 | 16900 | nan |
74
+ | 0.0 | 26.0 | 17576 | nan |
75
+ | 0.0 | 27.0 | 18252 | nan |
76
+ | 0.0 | 28.0 | 18928 | nan |
77
+ | 0.0 | 29.0 | 19604 | nan |
78
+ | 0.0 | 30.0 | 20280 | nan |
79
+ | 0.0 | 31.0 | 20956 | nan |
80
+ | 0.0 | 32.0 | 21632 | nan |
81
+ | 0.0 | 33.0 | 22308 | nan |
82
+ | 0.0 | 34.0 | 22984 | nan |
83
+ | 0.0 | 35.0 | 23660 | nan |
84
+ | 0.0 | 36.0 | 24336 | nan |
85
+ | 0.0 | 37.0 | 25012 | nan |
86
+ | 0.0 | 38.0 | 25688 | nan |
87
+ | 0.0 | 39.0 | 26364 | nan |
88
+ | 0.0 | 40.0 | 27040 | nan |
89
+ | 0.0 | 41.0 | 27716 | nan |
90
+ | 0.0 | 42.0 | 28392 | nan |
91
+ | 0.0 | 43.0 | 29068 | nan |
92
+ | 0.0 | 44.0 | 29744 | nan |
93
+ | 0.0 | 45.0 | 30420 | nan |
94
+ | 0.0 | 46.0 | 31096 | nan |
95
+ | 0.0 | 47.0 | 31772 | nan |
96
+ | 0.0 | 48.0 | 32448 | nan |
97
+ | 0.0 | 49.0 | 33124 | nan |
98
+ | 0.0 | 50.0 | 33800 | nan |
99
+
100
+
101
+ ### Framework versions
102
+
103
+ - Transformers 4.39.3
104
+ - Pytorch 2.2.2+cu121
105
+ - Datasets 2.18.0
106
+ - Tokenizers 0.15.2
generation_config.json ADDED
@@ -0,0 +1,7 @@
 
 
 
 
 
 
 
 
1
+ {
2
+ "_from_model_config": true,
3
+ "decoder_start_token_id": 0,
4
+ "eos_token_id": 1,
5
+ "pad_token_id": 0,
6
+ "transformers_version": "4.39.3"
7
+ }