Hugging Face's logo

Rcarvalo
/
Qwen_finetuned

PEFT
Safetensors
Model card Files Community
Rcarvalo commited on
Commit
30e4ea9
·
verified ·
1 Parent(s): 540c817

Upload 14 files

Browse files
Files changed (14) hide show
  1. README.md +202 -3
  2. adapter_config.json +29 -0
  3. adapter_model.safetensors +3 -0
  4. added_tokens.json +24 -0
  5. merges.txt +0 -0
  6. optimizer.pt +3 -0
  7. rng_state.pth +3 -0
  8. scheduler.pt +3 -0
  9. special_tokens_map.json +25 -0
  10. tokenizer.json +0 -0
  11. tokenizer_config.json +207 -0
  12. trainer_state.json +3129 -0
  13. training_args.bin +3 -0
  14. vocab.json +0 -0
README.md CHANGED
@@ -1,3 +1,202 @@
1
- ---
2
- license: apache-2.0
3
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: peft
3
+ base_model: Qwen/Qwen2.5-3B-Instruct
4
+ ---
5
+
6
+ # Model Card for Model ID
7
+
8
+ <!-- Provide a quick summary of what the model is/does. -->
9
+
10
+
11
+
12
+ ## Model Details
13
+
14
+ ### Model Description
15
+
16
+ <!-- Provide a longer summary of what this model is. -->
17
+
18
+
19
+
20
+ - **Developed by:** [More Information Needed]
21
+ - **Funded by [optional]:** [More Information Needed]
22
+ - **Shared by [optional]:** [More Information Needed]
23
+ - **Model type:** [More Information Needed]
24
+ - **Language(s) (NLP):** [More Information Needed]
25
+ - **License:** [More Information Needed]
26
+ - **Finetuned from model [optional]:** [More Information Needed]
27
+
28
+ ### Model Sources [optional]
29
+
30
+ <!-- Provide the basic links for the model. -->
31
+
32
+ - **Repository:** [More Information Needed]
33
+ - **Paper [optional]:** [More Information Needed]
34
+ - **Demo [optional]:** [More Information Needed]
35
+
36
+ ## Uses
37
+
38
+ <!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
39
+
40
+ ### Direct Use
41
+
42
+ <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
+
44
+ [More Information Needed]
45
+
46
+ ### Downstream Use [optional]
47
+
48
+ <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
+
50
+ [More Information Needed]
51
+
52
+ ### Out-of-Scope Use
53
+
54
+ <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
+
56
+ [More Information Needed]
57
+
58
+ ## Bias, Risks, and Limitations
59
+
60
+ <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
+
62
+ [More Information Needed]
63
+
64
+ ### Recommendations
65
+
66
+ <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
+
68
+ Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
+
70
+ ## How to Get Started with the Model
71
+
72
+ Use the code below to get started with the model.
73
+
74
+ [More Information Needed]
75
+
76
+ ## Training Details
77
+
78
+ ### Training Data
79
+
80
+ <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
+
82
+ [More Information Needed]
83
+
84
+ ### Training Procedure
85
+
86
+ <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
+
88
+ #### Preprocessing [optional]
89
+
90
+ [More Information Needed]
91
+
92
+
93
+ #### Training Hyperparameters
94
+
95
+ - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
+
97
+ #### Speeds, Sizes, Times [optional]
98
+
99
+ <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
+
101
+ [More Information Needed]
102
+
103
+ ## Evaluation
104
+
105
+ <!-- This section describes the evaluation protocols and provides the results. -->
106
+
107
+ ### Testing Data, Factors & Metrics
108
+
109
+ #### Testing Data
110
+
111
+ <!-- This should link to a Dataset Card if possible. -->
112
+
113
+ [More Information Needed]
114
+
115
+ #### Factors
116
+
117
+ <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
+
119
+ [More Information Needed]
120
+
121
+ #### Metrics
122
+
123
+ <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
+
125
+ [More Information Needed]
126
+
127
+ ### Results
128
+
129
+ [More Information Needed]
130
+
131
+ #### Summary
132
+
133
+
134
+
135
+ ## Model Examination [optional]
136
+
137
+ <!-- Relevant interpretability work for the model goes here -->
138
+
139
+ [More Information Needed]
140
+
141
+ ## Environmental Impact
142
+
143
+ <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
+
145
+ Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
+
147
+ - **Hardware Type:** [More Information Needed]
148
+ - **Hours used:** [More Information Needed]
149
+ - **Cloud Provider:** [More Information Needed]
150
+ - **Compute Region:** [More Information Needed]
151
+ - **Carbon Emitted:** [More Information Needed]
152
+
153
+ ## Technical Specifications [optional]
154
+
155
+ ### Model Architecture and Objective
156
+
157
+ [More Information Needed]
158
+
159
+ ### Compute Infrastructure
160
+
161
+ [More Information Needed]
162
+
163
+ #### Hardware
164
+
165
+ [More Information Needed]
166
+
167
+ #### Software
168
+
169
+ [More Information Needed]
170
+
171
+ ## Citation [optional]
172
+
173
+ <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
+
175
+ **BibTeX:**
176
+
177
+ [More Information Needed]
178
+
179
+ **APA:**
180
+
181
+ [More Information Needed]
182
+
183
+ ## Glossary [optional]
184
+
185
+ <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
+
187
+ [More Information Needed]
188
+
189
+ ## More Information [optional]
190
+
191
+ [More Information Needed]
192
+
193
+ ## Model Card Authors [optional]
194
+
195
+ [More Information Needed]
196
+
197
+ ## Model Card Contact
198
+
199
+ [More Information Needed]
200
+ ### Framework versions
201
+
202
+ - PEFT 0.10.0
adapter_config.json ADDED
@@ -0,0 +1,29 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "alpha_pattern": {},
3
+ "auto_mapping": null,
4
+ "base_model_name_or_path": "Qwen/Qwen2.5-3B-Instruct",
5
+ "bias": "none",
6
+ "fan_in_fan_out": false,
7
+ "inference_mode": true,
8
+ "init_lora_weights": true,
9
+ "layer_replication": null,
10
+ "layers_pattern": null,
11
+ "layers_to_transform": null,
12
+ "loftq_config": {},
13
+ "lora_alpha": 32,
14
+ "lora_dropout": 0.1,
15
+ "megatron_config": null,
16
+ "megatron_core": "megatron.core",
17
+ "modules_to_save": null,
18
+ "peft_type": "LORA",
19
+ "r": 64,
20
+ "rank_pattern": {},
21
+ "revision": null,
22
+ "target_modules": [
23
+ "q_proj",
24
+ "v_proj"
25
+ ],
26
+ "task_type": "SEQ_CLS",
27
+ "use_dora": false,
28
+ "use_rslora": true
29
+ }
adapter_model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:740e2083ed04d401ebee4ac747b2aa1c57d94a1d00ccaa177e0eea4772840401
3
+ size 59034616
added_tokens.json ADDED
@@ -0,0 +1,24 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "</tool_call>": 151658,
3
+ "<tool_call>": 151657,
4
+ "<|box_end|>": 151649,
5
+ "<|box_start|>": 151648,
6
+ "<|endoftext|>": 151643,
7
+ "<|file_sep|>": 151664,
8
+ "<|fim_middle|>": 151660,
9
+ "<|fim_pad|>": 151662,
10
+ "<|fim_prefix|>": 151659,
11
+ "<|fim_suffix|>": 151661,
12
+ "<|im_end|>": 151645,
13
+ "<|im_start|>": 151644,
14
+ "<|image_pad|>": 151655,
15
+ "<|object_ref_end|>": 151647,
16
+ "<|object_ref_start|>": 151646,
17
+ "<|quad_end|>": 151651,
18
+ "<|quad_start|>": 151650,
19
+ "<|repo_name|>": 151663,
20
+ "<|video_pad|>": 151656,
21
+ "<|vision_end|>": 151653,
22
+ "<|vision_pad|>": 151654,
23
+ "<|vision_start|>": 151652
24
+ }
merges.txt ADDED
The diff for this file is too large to render. See raw diff
 
optimizer.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:afb707efb61b231a03469b1459c101077201dabb7dc970a329cd5168a2322d74
3
+ size 118152698
rng_state.pth ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:c6912b2b28b32ae9b065e88d3eb40d3f8045820989866c05aa66a1862407d291
3
+ size 14244
scheduler.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:648aad84010bb97e11b827fee2ddb3f69616706eb45bb7e4d289bc77b2a43306
3
+ size 1064
special_tokens_map.json ADDED
@@ -0,0 +1,25 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "additional_special_tokens": [
3
+ "<|im_start|>",
4
+ "<|im_end|>",
5
+ "<|object_ref_start|>",
6
+ "<|object_ref_end|>",
7
+ "<|box_start|>",
8
+ "<|box_end|>",
9
+ "<|quad_start|>",
10
+ "<|quad_end|>",
11
+ "<|vision_start|>",
12
+ "<|vision_end|>",
13
+ "<|vision_pad|>",
14
+ "<|image_pad|>",
15
+ "<|video_pad|>"
16
+ ],
17
+ "eos_token": {
18
+ "content": "<|im_end|>",
19
+ "lstrip": false,
20
+ "normalized": false,
21
+ "rstrip": false,
22
+ "single_word": false
23
+ },
24
+ "pad_token": "<|im_end|>"
25
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,207 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "add_bos_token": false,
3
+ "add_prefix_space": false,
4
+ "added_tokens_decoder": {
5
+ "151643": {
6
+ "content": "<|endoftext|>",
7
+ "lstrip": false,
8
+ "normalized": false,
9
+ "rstrip": false,
10
+ "single_word": false,
11
+ "special": true
12
+ },
13
+ "151644": {
14
+ "content": "<|im_start|>",
15
+ "lstrip": false,
16
+ "normalized": false,
17
+ "rstrip": false,
18
+ "single_word": false,
19
+ "special": true
20
+ },
21
+ "151645": {
22
+ "content": "<|im_end|>",
23
+ "lstrip": false,
24
+ "normalized": false,
25
+ "rstrip": false,
26
+ "single_word": false,
27
+ "special": true
28
+ },
29
+ "151646": {
30
+ "content": "<|object_ref_start|>",
31
+ "lstrip": false,
32
+ "normalized": false,
33
+ "rstrip": false,
34
+ "single_word": false,
35
+ "special": true
36
+ },
37
+ "151647": {
38
+ "content": "<|object_ref_end|>",
39
+ "lstrip": false,
40
+ "normalized": false,
41
+ "rstrip": false,
42
+ "single_word": false,
43
+ "special": true
44
+ },
45
+ "151648": {
46
+ "content": "<|box_start|>",
47
+ "lstrip": false,
48
+ "normalized": false,
49
+ "rstrip": false,
50
+ "single_word": false,
51
+ "special": true
52
+ },
53
+ "151649": {
54
+ "content": "<|box_end|>",
55
+ "lstrip": false,
56
+ "normalized": false,
57
+ "rstrip": false,
58
+ "single_word": false,
59
+ "special": true
60
+ },
61
+ "151650": {
62
+ "content": "<|quad_start|>",
63
+ "lstrip": false,
64
+ "normalized": false,
65
+ "rstrip": false,
66
+ "single_word": false,
67
+ "special": true
68
+ },
69
+ "151651": {
70
+ "content": "<|quad_end|>",
71
+ "lstrip": false,
72
+ "normalized": false,
73
+ "rstrip": false,
74
+ "single_word": false,
75
+ "special": true
76
+ },
77
+ "151652": {
78
+ "content": "<|vision_start|>",
79
+ "lstrip": false,
80
+ "normalized": false,
81
+ "rstrip": false,
82
+ "single_word": false,
83
+ "special": true
84
+ },
85
+ "151653": {
86
+ "content": "<|vision_end|>",
87
+ "lstrip": false,
88
+ "normalized": false,
89
+ "rstrip": false,
90
+ "single_word": false,
91
+ "special": true
92
+ },
93
+ "151654": {
94
+ "content": "<|vision_pad|>",
95
+ "lstrip": false,
96
+ "normalized": false,
97
+ "rstrip": false,
98
+ "single_word": false,
99
+ "special": true
100
+ },
101
+ "151655": {
102
+ "content": "<|image_pad|>",
103
+ "lstrip": false,
104
+ "normalized": false,
105
+ "rstrip": false,
106
+ "single_word": false,
107
+ "special": true
108
+ },
109
+ "151656": {
110
+ "content": "<|video_pad|>",
111
+ "lstrip": false,
112
+ "normalized": false,
113
+ "rstrip": false,
114
+ "single_word": false,
115
+ "special": true
116
+ },
117
+ "151657": {
118
+ "content": "<tool_call>",
119
+ "lstrip": false,
120
+ "normalized": false,
121
+ "rstrip": false,
122
+ "single_word": false,
123
+ "special": false
124
+ },
125
+ "151658": {
126
+ "content": "</tool_call>",
127
+ "lstrip": false,
128
+ "normalized": false,
129
+ "rstrip": false,
130
+ "single_word": false,
131
+ "special": false
132
+ },
133
+ "151659": {
134
+ "content": "<|fim_prefix|>",
135
+ "lstrip": false,
136
+ "normalized": false,
137
+ "rstrip": false,
138
+ "single_word": false,
139
+ "special": false
140
+ },
141
+ "151660": {
142
+ "content": "<|fim_middle|>",
143
+ "lstrip": false,
144
+ "normalized": false,
145
+ "rstrip": false,
146
+ "single_word": false,
147
+ "special": false
148
+ },
149
+ "151661": {
150
+ "content": "<|fim_suffix|>",
151
+ "lstrip": false,
152
+ "normalized": false,
153
+ "rstrip": false,
154
+ "single_word": false,
155
+ "special": false
156
+ },
157
+ "151662": {
158
+ "content": "<|fim_pad|>",
159
+ "lstrip": false,
160
+ "normalized": false,
161
+ "rstrip": false,
162
+ "single_word": false,
163
+ "special": false
164
+ },
165
+ "151663": {
166
+ "content": "<|repo_name|>",
167
+ "lstrip": false,
168
+ "normalized": false,
169
+ "rstrip": false,
170
+ "single_word": false,
171
+ "special": false
172
+ },
173
+ "151664": {
174
+ "content": "<|file_sep|>",
175
+ "lstrip": false,
176
+ "normalized": false,
177
+ "rstrip": false,
178
+ "single_word": false,
179
+ "special": false
180
+ }
181
+ },
182
+ "additional_special_tokens": [
183
+ "<|im_start|>",
184
+ "<|im_end|>",
185
+ "<|object_ref_start|>",
186
+ "<|object_ref_end|>",
187
+ "<|box_start|>",
188
+ "<|box_end|>",
189
+ "<|quad_start|>",
190
+ "<|quad_end|>",
191
+ "<|vision_start|>",
192
+ "<|vision_end|>",
193
+ "<|vision_pad|>",
194
+ "<|image_pad|>",
195
+ "<|video_pad|>"
196
+ ],
197
+ "bos_token": null,
198
+ "chat_template": "{%- if tools %}\n {{- '<|im_start|>system\\n' }}\n {%- if messages[0]['role'] == 'system' %}\n {{- messages[0]['content'] }}\n {%- else %}\n {{- 'You are Qwen, created by Alibaba Cloud. You are a helpful assistant.' }}\n {%- endif %}\n {{- \"\\n\\n# Tools\\n\\nYou may call one or more functions to assist with the user query.\\n\\nYou are provided with function signatures within <tools></tools> XML tags:\\n<tools>\" }}\n {%- for tool in tools %}\n {{- \"\\n\" }}\n {{- tool | tojson }}\n {%- endfor %}\n {{- \"\\n</tools>\\n\\nFor each function call, return a json object with function name and arguments within <tool_call></tool_call> XML tags:\\n<tool_call>\\n{\\\"name\\\": <function-name>, \\\"arguments\\\": <args-json-object>}\\n</tool_call><|im_end|>\\n\" }}\n{%- else %}\n {%- if messages[0]['role'] == 'system' %}\n {{- '<|im_start|>system\\n' + messages[0]['content'] + '<|im_end|>\\n' }}\n {%- else %}\n {{- '<|im_start|>system\\nYou are Qwen, created by Alibaba Cloud. You are a helpful assistant.<|im_end|>\\n' }}\n {%- endif %}\n{%- endif %}\n{%- for message in messages %}\n {%- if (message.role == \"user\") or (message.role == \"system\" and not loop.first) or (message.role == \"assistant\" and not message.tool_calls) %}\n {{- '<|im_start|>' + message.role + '\\n' + message.content + '<|im_end|>' + '\\n' }}\n {%- elif message.role == \"assistant\" %}\n {{- '<|im_start|>' + message.role }}\n {%- if message.content %}\n {{- '\\n' + message.content }}\n {%- endif %}\n {%- for tool_call in message.tool_calls %}\n {%- if tool_call.function is defined %}\n {%- set tool_call = tool_call.function %}\n {%- endif %}\n {{- '\\n<tool_call>\\n{\"name\": \"' }}\n {{- tool_call.name }}\n {{- '\", \"arguments\": ' }}\n {{- tool_call.arguments | tojson }}\n {{- '}\\n</tool_call>' }}\n {%- endfor %}\n {{- '<|im_end|>\\n' }}\n {%- elif message.role == \"tool\" %}\n {%- if (loop.index0 == 0) or (messages[loop.index0 - 1].role != \"tool\") %}\n {{- '<|im_start|>user' }}\n {%- endif %}\n {{- '\\n<tool_response>\\n' }}\n {{- message.content }}\n {{- '\\n</tool_response>' }}\n {%- if loop.last or (messages[loop.index0 + 1].role != \"tool\") %}\n {{- '<|im_end|>\\n' }}\n {%- endif %}\n {%- endif %}\n{%- endfor %}\n{%- if add_generation_prompt %}\n {{- '<|im_start|>assistant\\n' }}\n{%- endif %}\n",
199
+ "clean_up_tokenization_spaces": false,
200
+ "eos_token": "<|im_end|>",
201
+ "errors": "replace",
202
+ "model_max_length": 131072,
203
+ "pad_token": "<|im_end|>",
204
+ "split_special_tokens": false,
205
+ "tokenizer_class": "Qwen2Tokenizer",
206
+ "unk_token": null
207
+ }
trainer_state.json ADDED
@@ -0,0 +1,3129 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_metric": null,
3
+ "best_model_checkpoint": null,
4
+ "epoch": 0.9792492422476101,
5
+ "eval_steps": 300,
6
+ "global_step": 4200,
7
+ "is_hyper_param_search": false,
8
+ "is_local_process_zero": true,
9
+ "is_world_process_zero": true,
10
+ "log_history": [
11
+ {
12
+ "epoch": 0.0023315458148752623,
13
+ "grad_norm": 58.996910095214844,
14
+ "learning_rate": 4.997668454185125e-05,
15
+ "loss": 2.8188,
16
+ "step": 10
17
+ },
18
+ {
19
+ "epoch": 0.004663091629750525,
20
+ "grad_norm": 46.450401306152344,
21
+ "learning_rate": 4.995336908370249e-05,
22
+ "loss": 2.2969,
23
+ "step": 20
24
+ },
25
+ {
26
+ "epoch": 0.006994637444625787,
27
+ "grad_norm": 20.279075622558594,
28
+ "learning_rate": 4.993005362555374e-05,
29
+ "loss": 2.2492,
30
+ "step": 30
31
+ },
32
+ {
33
+ "epoch": 0.00932618325950105,
34
+ "grad_norm": 54.02119445800781,
35
+ "learning_rate": 4.9906738167404995e-05,
36
+ "loss": 2.0938,
37
+ "step": 40
38
+ },
39
+ {
40
+ "epoch": 0.011657729074376311,
41
+ "grad_norm": 20.223501205444336,
42
+ "learning_rate": 4.988342270925624e-05,
43
+ "loss": 1.9648,
44
+ "step": 50
45
+ },
46
+ {
47
+ "epoch": 0.013989274889251575,
48
+ "grad_norm": 32.29741668701172,
49
+ "learning_rate": 4.9860107251107484e-05,
50
+ "loss": 1.8797,
51
+ "step": 60
52
+ },
53
+ {
54
+ "epoch": 0.016320820704126836,
55
+ "grad_norm": 36.739723205566406,
56
+ "learning_rate": 4.983679179295873e-05,
57
+ "loss": 1.6664,
58
+ "step": 70
59
+ },
60
+ {
61
+ "epoch": 0.0186523665190021,
62
+ "grad_norm": 53.299015045166016,
63
+ "learning_rate": 4.981347633480998e-05,
64
+ "loss": 1.6,
65
+ "step": 80
66
+ },
67
+ {
68
+ "epoch": 0.02098391233387736,
69
+ "grad_norm": 25.623676300048828,
70
+ "learning_rate": 4.979016087666123e-05,
71
+ "loss": 1.6898,
72
+ "step": 90
73
+ },
74
+ {
75
+ "epoch": 0.023315458148752622,
76
+ "grad_norm": 34.87362289428711,
77
+ "learning_rate": 4.9766845418512476e-05,
78
+ "loss": 1.5578,
79
+ "step": 100
80
+ },
81
+ {
82
+ "epoch": 0.025647003963627884,
83
+ "grad_norm": 25.20810317993164,
84
+ "learning_rate": 4.974352996036372e-05,
85
+ "loss": 1.5078,
86
+ "step": 110
87
+ },
88
+ {
89
+ "epoch": 0.02797854977850315,
90
+ "grad_norm": 43.89160919189453,
91
+ "learning_rate": 4.972021450221497e-05,
92
+ "loss": 1.4242,
93
+ "step": 120
94
+ },
95
+ {
96
+ "epoch": 0.03031009559337841,
97
+ "grad_norm": 43.445186614990234,
98
+ "learning_rate": 4.969689904406622e-05,
99
+ "loss": 1.3207,
100
+ "step": 130
101
+ },
102
+ {
103
+ "epoch": 0.03264164140825367,
104
+ "grad_norm": 49.01000213623047,
105
+ "learning_rate": 4.967358358591747e-05,
106
+ "loss": 1.1633,
107
+ "step": 140
108
+ },
109
+ {
110
+ "epoch": 0.034973187223128935,
111
+ "grad_norm": 32.247344970703125,
112
+ "learning_rate": 4.9650268127768713e-05,
113
+ "loss": 0.9754,
114
+ "step": 150
115
+ },
116
+ {
117
+ "epoch": 0.0373047330380042,
118
+ "grad_norm": 37.74547576904297,
119
+ "learning_rate": 4.962695266961996e-05,
120
+ "loss": 0.9918,
121
+ "step": 160
122
+ },
123
+ {
124
+ "epoch": 0.03963627885287946,
125
+ "grad_norm": 29.272994995117188,
126
+ "learning_rate": 4.960363721147121e-05,
127
+ "loss": 1.132,
128
+ "step": 170
129
+ },
130
+ {
131
+ "epoch": 0.04196782466775472,
132
+ "grad_norm": 34.0861930847168,
133
+ "learning_rate": 4.9580321753322454e-05,
134
+ "loss": 1.0285,
135
+ "step": 180
136
+ },
137
+ {
138
+ "epoch": 0.04429937048262998,
139
+ "grad_norm": 41.01604461669922,
140
+ "learning_rate": 4.95570062951737e-05,
141
+ "loss": 0.9484,
142
+ "step": 190
143
+ },
144
+ {
145
+ "epoch": 0.046630916297505244,
146
+ "grad_norm": 27.387298583984375,
147
+ "learning_rate": 4.953369083702495e-05,
148
+ "loss": 0.9852,
149
+ "step": 200
150
+ },
151
+ {
152
+ "epoch": 0.048962462112380506,
153
+ "grad_norm": 27.99677848815918,
154
+ "learning_rate": 4.9510375378876195e-05,
155
+ "loss": 0.6836,
156
+ "step": 210
157
+ },
158
+ {
159
+ "epoch": 0.05129400792725577,
160
+ "grad_norm": 26.071035385131836,
161
+ "learning_rate": 4.948705992072745e-05,
162
+ "loss": 0.8875,
163
+ "step": 220
164
+ },
165
+ {
166
+ "epoch": 0.05362555374213103,
167
+ "grad_norm": 29.15469741821289,
168
+ "learning_rate": 4.946374446257869e-05,
169
+ "loss": 0.893,
170
+ "step": 230
171
+ },
172
+ {
173
+ "epoch": 0.0559570995570063,
174
+ "grad_norm": 39.19640350341797,
175
+ "learning_rate": 4.9440429004429936e-05,
176
+ "loss": 0.8641,
177
+ "step": 240
178
+ },
179
+ {
180
+ "epoch": 0.05828864537188156,
181
+ "grad_norm": 24.756563186645508,
182
+ "learning_rate": 4.941711354628119e-05,
183
+ "loss": 0.9574,
184
+ "step": 250
185
+ },
186
+ {
187
+ "epoch": 0.06062019118675682,
188
+ "grad_norm": 33.53086471557617,
189
+ "learning_rate": 4.939379808813244e-05,
190
+ "loss": 0.8523,
191
+ "step": 260
192
+ },
193
+ {
194
+ "epoch": 0.06295173700163208,
195
+ "grad_norm": 14.436066627502441,
196
+ "learning_rate": 4.9370482629983684e-05,
197
+ "loss": 0.7646,
198
+ "step": 270
199
+ },
200
+ {
201
+ "epoch": 0.06528328281650735,
202
+ "grad_norm": 20.99724769592285,
203
+ "learning_rate": 4.934716717183493e-05,
204
+ "loss": 0.8172,
205
+ "step": 280
206
+ },
207
+ {
208
+ "epoch": 0.0676148286313826,
209
+ "grad_norm": 27.321861267089844,
210
+ "learning_rate": 4.932385171368617e-05,
211
+ "loss": 0.8965,
212
+ "step": 290
213
+ },
214
+ {
215
+ "epoch": 0.06994637444625787,
216
+ "grad_norm": 14.228981971740723,
217
+ "learning_rate": 4.9300536255537425e-05,
218
+ "loss": 0.8838,
219
+ "step": 300
220
+ },
221
+ {
222
+ "epoch": 0.06994637444625787,
223
+ "eval_accuracy": 0.6251025430680885,
224
+ "eval_f1": 0.6198441320333742,
225
+ "eval_loss": 0.9746333956718445,
226
+ "eval_precision": 0.6288553718864676,
227
+ "eval_recall": 0.6346714934867023,
228
+ "eval_runtime": 32.8297,
229
+ "eval_samples_per_second": 37.131,
230
+ "eval_steps_per_second": 2.345,
231
+ "step": 300
232
+ },
233
+ {
234
+ "epoch": 0.07227792026113312,
235
+ "grad_norm": 11.636761665344238,
236
+ "learning_rate": 4.9277220797388676e-05,
237
+ "loss": 0.6803,
238
+ "step": 310
239
+ },
240
+ {
241
+ "epoch": 0.0746094660760084,
242
+ "grad_norm": 28.35625457763672,
243
+ "learning_rate": 4.925390533923992e-05,
244
+ "loss": 0.7066,
245
+ "step": 320
246
+ },
247
+ {
248
+ "epoch": 0.07694101189088366,
249
+ "grad_norm": 34.743988037109375,
250
+ "learning_rate": 4.9230589881091165e-05,
251
+ "loss": 0.6387,
252
+ "step": 330
253
+ },
254
+ {
255
+ "epoch": 0.07927255770575892,
256
+ "grad_norm": 27.67451286315918,
257
+ "learning_rate": 4.920727442294241e-05,
258
+ "loss": 0.8309,
259
+ "step": 340
260
+ },
261
+ {
262
+ "epoch": 0.08160410352063419,
263
+ "grad_norm": 35.13928985595703,
264
+ "learning_rate": 4.918395896479366e-05,
265
+ "loss": 0.8715,
266
+ "step": 350
267
+ },
268
+ {
269
+ "epoch": 0.08393564933550944,
270
+ "grad_norm": 35.64329147338867,
271
+ "learning_rate": 4.916064350664491e-05,
272
+ "loss": 0.6961,
273
+ "step": 360
274
+ },
275
+ {
276
+ "epoch": 0.08626719515038471,
277
+ "grad_norm": 26.17702293395996,
278
+ "learning_rate": 4.913732804849616e-05,
279
+ "loss": 0.7254,
280
+ "step": 370
281
+ },
282
+ {
283
+ "epoch": 0.08859874096525996,
284
+ "grad_norm": 26.370773315429688,
285
+ "learning_rate": 4.91140125903474e-05,
286
+ "loss": 0.7217,
287
+ "step": 380
288
+ },
289
+ {
290
+ "epoch": 0.09093028678013523,
291
+ "grad_norm": 34.7267951965332,
292
+ "learning_rate": 4.909069713219865e-05,
293
+ "loss": 0.7297,
294
+ "step": 390
295
+ },
296
+ {
297
+ "epoch": 0.09326183259501049,
298
+ "grad_norm": 40.13215637207031,
299
+ "learning_rate": 4.906738167404989e-05,
300
+ "loss": 0.865,
301
+ "step": 400
302
+ },
303
+ {
304
+ "epoch": 0.09559337840988576,
305
+ "grad_norm": 31.081972122192383,
306
+ "learning_rate": 4.904406621590114e-05,
307
+ "loss": 0.7848,
308
+ "step": 410
309
+ },
310
+ {
311
+ "epoch": 0.09792492422476101,
312
+ "grad_norm": 29.940229415893555,
313
+ "learning_rate": 4.9020750757752395e-05,
314
+ "loss": 0.7045,
315
+ "step": 420
316
+ },
317
+ {
318
+ "epoch": 0.10025647003963628,
319
+ "grad_norm": 28.462858200073242,
320
+ "learning_rate": 4.899743529960364e-05,
321
+ "loss": 0.5851,
322
+ "step": 430
323
+ },
324
+ {
325
+ "epoch": 0.10258801585451154,
326
+ "grad_norm": 26.055572509765625,
327
+ "learning_rate": 4.8974119841454884e-05,
328
+ "loss": 0.6502,
329
+ "step": 440
330
+ },
331
+ {
332
+ "epoch": 0.1049195616693868,
333
+ "grad_norm": 31.78554344177246,
334
+ "learning_rate": 4.8950804383306136e-05,
335
+ "loss": 0.8398,
336
+ "step": 450
337
+ },
338
+ {
339
+ "epoch": 0.10725110748426206,
340
+ "grad_norm": 27.621715545654297,
341
+ "learning_rate": 4.892748892515738e-05,
342
+ "loss": 0.6201,
343
+ "step": 460
344
+ },
345
+ {
346
+ "epoch": 0.10958265329913733,
347
+ "grad_norm": 46.45154571533203,
348
+ "learning_rate": 4.890417346700863e-05,
349
+ "loss": 0.8129,
350
+ "step": 470
351
+ },
352
+ {
353
+ "epoch": 0.1119141991140126,
354
+ "grad_norm": 30.32659339904785,
355
+ "learning_rate": 4.8880858008859876e-05,
356
+ "loss": 0.8564,
357
+ "step": 480
358
+ },
359
+ {
360
+ "epoch": 0.11424574492888785,
361
+ "grad_norm": 11.306530952453613,
362
+ "learning_rate": 4.885754255071112e-05,
363
+ "loss": 0.7492,
364
+ "step": 490
365
+ },
366
+ {
367
+ "epoch": 0.11657729074376312,
368
+ "grad_norm": 33.427490234375,
369
+ "learning_rate": 4.883422709256237e-05,
370
+ "loss": 0.6204,
371
+ "step": 500
372
+ },
373
+ {
374
+ "epoch": 0.11890883655863838,
375
+ "grad_norm": 28.030242919921875,
376
+ "learning_rate": 4.881091163441362e-05,
377
+ "loss": 0.6666,
378
+ "step": 510
379
+ },
380
+ {
381
+ "epoch": 0.12124038237351364,
382
+ "grad_norm": 26.319486618041992,
383
+ "learning_rate": 4.878759617626487e-05,
384
+ "loss": 0.6586,
385
+ "step": 520
386
+ },
387
+ {
388
+ "epoch": 0.1235719281883889,
389
+ "grad_norm": 25.426727294921875,
390
+ "learning_rate": 4.8764280718116114e-05,
391
+ "loss": 0.7229,
392
+ "step": 530
393
+ },
394
+ {
395
+ "epoch": 0.12590347400326415,
396
+ "grad_norm": 27.011367797851562,
397
+ "learning_rate": 4.874096525996736e-05,
398
+ "loss": 0.8982,
399
+ "step": 540
400
+ },
401
+ {
402
+ "epoch": 0.12823501981813942,
403
+ "grad_norm": 18.395326614379883,
404
+ "learning_rate": 4.871764980181861e-05,
405
+ "loss": 0.7205,
406
+ "step": 550
407
+ },
408
+ {
409
+ "epoch": 0.1305665656330147,
410
+ "grad_norm": 21.085630416870117,
411
+ "learning_rate": 4.8694334343669854e-05,
412
+ "loss": 0.582,
413
+ "step": 560
414
+ },
415
+ {
416
+ "epoch": 0.13289811144788996,
417
+ "grad_norm": 38.923683166503906,
418
+ "learning_rate": 4.86710188855211e-05,
419
+ "loss": 0.5496,
420
+ "step": 570
421
+ },
422
+ {
423
+ "epoch": 0.1352296572627652,
424
+ "grad_norm": 39.22763442993164,
425
+ "learning_rate": 4.864770342737235e-05,
426
+ "loss": 0.734,
427
+ "step": 580
428
+ },
429
+ {
430
+ "epoch": 0.13756120307764047,
431
+ "grad_norm": 22.916170120239258,
432
+ "learning_rate": 4.8624387969223595e-05,
433
+ "loss": 0.6928,
434
+ "step": 590
435
+ },
436
+ {
437
+ "epoch": 0.13989274889251574,
438
+ "grad_norm": 19.733055114746094,
439
+ "learning_rate": 4.860107251107485e-05,
440
+ "loss": 0.4986,
441
+ "step": 600
442
+ },
443
+ {
444
+ "epoch": 0.13989274889251574,
445
+ "eval_accuracy": 0.7456931911402789,
446
+ "eval_f1": 0.7266139292840452,
447
+ "eval_loss": 0.7722646594047546,
448
+ "eval_precision": 0.7451348277162813,
449
+ "eval_recall": 0.7211806530410576,
450
+ "eval_runtime": 32.3956,
451
+ "eval_samples_per_second": 37.629,
452
+ "eval_steps_per_second": 2.377,
453
+ "step": 600
454
+ },
455
+ {
456
+ "epoch": 0.142224294707391,
457
+ "grad_norm": 17.900259017944336,
458
+ "learning_rate": 4.857775705292609e-05,
459
+ "loss": 0.5705,
460
+ "step": 610
461
+ },
462
+ {
463
+ "epoch": 0.14455584052226625,
464
+ "grad_norm": 26.365203857421875,
465
+ "learning_rate": 4.8554441594777336e-05,
466
+ "loss": 0.5932,
467
+ "step": 620
468
+ },
469
+ {
470
+ "epoch": 0.14688738633714152,
471
+ "grad_norm": 20.65036392211914,
472
+ "learning_rate": 4.853112613662859e-05,
473
+ "loss": 0.6246,
474
+ "step": 630
475
+ },
476
+ {
477
+ "epoch": 0.1492189321520168,
478
+ "grad_norm": 20.070476531982422,
479
+ "learning_rate": 4.850781067847984e-05,
480
+ "loss": 0.7621,
481
+ "step": 640
482
+ },
483
+ {
484
+ "epoch": 0.15155047796689206,
485
+ "grad_norm": 27.528751373291016,
486
+ "learning_rate": 4.8484495220331084e-05,
487
+ "loss": 0.7121,
488
+ "step": 650
489
+ },
490
+ {
491
+ "epoch": 0.15388202378176732,
492
+ "grad_norm": 30.218090057373047,
493
+ "learning_rate": 4.846117976218233e-05,
494
+ "loss": 0.7557,
495
+ "step": 660
496
+ },
497
+ {
498
+ "epoch": 0.15621356959664257,
499
+ "grad_norm": 32.3998908996582,
500
+ "learning_rate": 4.843786430403357e-05,
501
+ "loss": 0.5539,
502
+ "step": 670
503
+ },
504
+ {
505
+ "epoch": 0.15854511541151783,
506
+ "grad_norm": 26.95191192626953,
507
+ "learning_rate": 4.8414548845884825e-05,
508
+ "loss": 0.5303,
509
+ "step": 680
510
+ },
511
+ {
512
+ "epoch": 0.1608766612263931,
513
+ "grad_norm": 30.945283889770508,
514
+ "learning_rate": 4.8391233387736076e-05,
515
+ "loss": 0.6001,
516
+ "step": 690
517
+ },
518
+ {
519
+ "epoch": 0.16320820704126837,
520
+ "grad_norm": 29.30241584777832,
521
+ "learning_rate": 4.836791792958732e-05,
522
+ "loss": 0.7291,
523
+ "step": 700
524
+ },
525
+ {
526
+ "epoch": 0.1655397528561436,
527
+ "grad_norm": 13.888816833496094,
528
+ "learning_rate": 4.8344602471438565e-05,
529
+ "loss": 0.8428,
530
+ "step": 710
531
+ },
532
+ {
533
+ "epoch": 0.16787129867101888,
534
+ "grad_norm": 29.725255966186523,
535
+ "learning_rate": 4.832128701328981e-05,
536
+ "loss": 0.6883,
537
+ "step": 720
538
+ },
539
+ {
540
+ "epoch": 0.17020284448589415,
541
+ "grad_norm": 42.3590202331543,
542
+ "learning_rate": 4.829797155514106e-05,
543
+ "loss": 0.6275,
544
+ "step": 730
545
+ },
546
+ {
547
+ "epoch": 0.17253439030076942,
548
+ "grad_norm": 23.562644958496094,
549
+ "learning_rate": 4.827465609699231e-05,
550
+ "loss": 0.5752,
551
+ "step": 740
552
+ },
553
+ {
554
+ "epoch": 0.17486593611564466,
555
+ "grad_norm": 32.83530044555664,
556
+ "learning_rate": 4.825134063884356e-05,
557
+ "loss": 0.6953,
558
+ "step": 750
559
+ },
560
+ {
561
+ "epoch": 0.17719748193051993,
562
+ "grad_norm": 12.841109275817871,
563
+ "learning_rate": 4.82280251806948e-05,
564
+ "loss": 0.4848,
565
+ "step": 760
566
+ },
567
+ {
568
+ "epoch": 0.1795290277453952,
569
+ "grad_norm": 22.86924171447754,
570
+ "learning_rate": 4.820470972254605e-05,
571
+ "loss": 0.6314,
572
+ "step": 770
573
+ },
574
+ {
575
+ "epoch": 0.18186057356027047,
576
+ "grad_norm": 16.436222076416016,
577
+ "learning_rate": 4.81813942643973e-05,
578
+ "loss": 0.6568,
579
+ "step": 780
580
+ },
581
+ {
582
+ "epoch": 0.18419211937514574,
583
+ "grad_norm": 13.749951362609863,
584
+ "learning_rate": 4.815807880624854e-05,
585
+ "loss": 0.7607,
586
+ "step": 790
587
+ },
588
+ {
589
+ "epoch": 0.18652366519002098,
590
+ "grad_norm": 42.645729064941406,
591
+ "learning_rate": 4.8134763348099795e-05,
592
+ "loss": 0.536,
593
+ "step": 800
594
+ },
595
+ {
596
+ "epoch": 0.18885521100489625,
597
+ "grad_norm": 25.09123420715332,
598
+ "learning_rate": 4.811144788995104e-05,
599
+ "loss": 0.6258,
600
+ "step": 810
601
+ },
602
+ {
603
+ "epoch": 0.19118675681977151,
604
+ "grad_norm": 24.370229721069336,
605
+ "learning_rate": 4.8088132431802284e-05,
606
+ "loss": 0.4913,
607
+ "step": 820
608
+ },
609
+ {
610
+ "epoch": 0.19351830263464678,
611
+ "grad_norm": 34.05779266357422,
612
+ "learning_rate": 4.8064816973653536e-05,
613
+ "loss": 0.8139,
614
+ "step": 830
615
+ },
616
+ {
617
+ "epoch": 0.19584984844952202,
618
+ "grad_norm": 24.232662200927734,
619
+ "learning_rate": 4.804150151550478e-05,
620
+ "loss": 0.7322,
621
+ "step": 840
622
+ },
623
+ {
624
+ "epoch": 0.1981813942643973,
625
+ "grad_norm": 20.707740783691406,
626
+ "learning_rate": 4.801818605735603e-05,
627
+ "loss": 0.591,
628
+ "step": 850
629
+ },
630
+ {
631
+ "epoch": 0.20051294007927256,
632
+ "grad_norm": 26.865257263183594,
633
+ "learning_rate": 4.7994870599207277e-05,
634
+ "loss": 0.6098,
635
+ "step": 860
636
+ },
637
+ {
638
+ "epoch": 0.20284448589414783,
639
+ "grad_norm": 10.35026741027832,
640
+ "learning_rate": 4.797155514105852e-05,
641
+ "loss": 0.6383,
642
+ "step": 870
643
+ },
644
+ {
645
+ "epoch": 0.20517603170902307,
646
+ "grad_norm": 23.788137435913086,
647
+ "learning_rate": 4.794823968290977e-05,
648
+ "loss": 0.7854,
649
+ "step": 880
650
+ },
651
+ {
652
+ "epoch": 0.20750757752389834,
653
+ "grad_norm": 21.079648971557617,
654
+ "learning_rate": 4.792492422476102e-05,
655
+ "loss": 0.6371,
656
+ "step": 890
657
+ },
658
+ {
659
+ "epoch": 0.2098391233387736,
660
+ "grad_norm": 34.78284454345703,
661
+ "learning_rate": 4.790160876661227e-05,
662
+ "loss": 0.6078,
663
+ "step": 900
664
+ },
665
+ {
666
+ "epoch": 0.2098391233387736,
667
+ "eval_accuracy": 0.689909762100082,
668
+ "eval_f1": 0.6883721016902948,
669
+ "eval_loss": 0.8121763467788696,
670
+ "eval_precision": 0.7020681280584337,
671
+ "eval_recall": 0.7085581473429932,
672
+ "eval_runtime": 32.2791,
673
+ "eval_samples_per_second": 37.764,
674
+ "eval_steps_per_second": 2.385,
675
+ "step": 900
676
+ },
677
+ {
678
+ "epoch": 0.21217066915364888,
679
+ "grad_norm": 38.722511291503906,
680
+ "learning_rate": 4.7878293308463514e-05,
681
+ "loss": 0.6371,
682
+ "step": 910
683
+ },
684
+ {
685
+ "epoch": 0.21450221496852412,
686
+ "grad_norm": 30.822816848754883,
687
+ "learning_rate": 4.785497785031476e-05,
688
+ "loss": 0.6244,
689
+ "step": 920
690
+ },
691
+ {
692
+ "epoch": 0.2168337607833994,
693
+ "grad_norm": 46.684818267822266,
694
+ "learning_rate": 4.783166239216601e-05,
695
+ "loss": 0.7515,
696
+ "step": 930
697
+ },
698
+ {
699
+ "epoch": 0.21916530659827466,
700
+ "grad_norm": 23.10223960876465,
701
+ "learning_rate": 4.7808346934017254e-05,
702
+ "loss": 0.5434,
703
+ "step": 940
704
+ },
705
+ {
706
+ "epoch": 0.22149685241314993,
707
+ "grad_norm": 20.43950080871582,
708
+ "learning_rate": 4.77850314758685e-05,
709
+ "loss": 0.5672,
710
+ "step": 950
711
+ },
712
+ {
713
+ "epoch": 0.2238283982280252,
714
+ "grad_norm": 33.358795166015625,
715
+ "learning_rate": 4.776171601771975e-05,
716
+ "loss": 0.6576,
717
+ "step": 960
718
+ },
719
+ {
720
+ "epoch": 0.22615994404290043,
721
+ "grad_norm": 25.824260711669922,
722
+ "learning_rate": 4.7738400559571e-05,
723
+ "loss": 0.6646,
724
+ "step": 970
725
+ },
726
+ {
727
+ "epoch": 0.2284914898577757,
728
+ "grad_norm": 21.079469680786133,
729
+ "learning_rate": 4.771508510142225e-05,
730
+ "loss": 0.5052,
731
+ "step": 980
732
+ },
733
+ {
734
+ "epoch": 0.23082303567265097,
735
+ "grad_norm": 15.477420806884766,
736
+ "learning_rate": 4.769176964327349e-05,
737
+ "loss": 0.6392,
738
+ "step": 990
739
+ },
740
+ {
741
+ "epoch": 0.23315458148752624,
742
+ "grad_norm": 21.481847763061523,
743
+ "learning_rate": 4.7668454185124736e-05,
744
+ "loss": 0.6549,
745
+ "step": 1000
746
+ },
747
+ {
748
+ "epoch": 0.23548612730240148,
749
+ "grad_norm": 14.648496627807617,
750
+ "learning_rate": 4.764513872697599e-05,
751
+ "loss": 0.5125,
752
+ "step": 1010
753
+ },
754
+ {
755
+ "epoch": 0.23781767311727675,
756
+ "grad_norm": 17.860349655151367,
757
+ "learning_rate": 4.762182326882724e-05,
758
+ "loss": 0.5947,
759
+ "step": 1020
760
+ },
761
+ {
762
+ "epoch": 0.24014921893215202,
763
+ "grad_norm": 30.999217987060547,
764
+ "learning_rate": 4.7598507810678484e-05,
765
+ "loss": 0.5108,
766
+ "step": 1030
767
+ },
768
+ {
769
+ "epoch": 0.2424807647470273,
770
+ "grad_norm": 33.350311279296875,
771
+ "learning_rate": 4.757519235252973e-05,
772
+ "loss": 0.5957,
773
+ "step": 1040
774
+ },
775
+ {
776
+ "epoch": 0.24481231056190253,
777
+ "grad_norm": 50.07561111450195,
778
+ "learning_rate": 4.755187689438097e-05,
779
+ "loss": 0.6289,
780
+ "step": 1050
781
+ },
782
+ {
783
+ "epoch": 0.2471438563767778,
784
+ "grad_norm": 20.572126388549805,
785
+ "learning_rate": 4.7528561436232225e-05,
786
+ "loss": 0.6101,
787
+ "step": 1060
788
+ },
789
+ {
790
+ "epoch": 0.24947540219165307,
791
+ "grad_norm": 31.299867630004883,
792
+ "learning_rate": 4.7505245978083476e-05,
793
+ "loss": 0.7346,
794
+ "step": 1070
795
+ },
796
+ {
797
+ "epoch": 0.2518069480065283,
798
+ "grad_norm": 22.430063247680664,
799
+ "learning_rate": 4.748193051993472e-05,
800
+ "loss": 0.5229,
801
+ "step": 1080
802
+ },
803
+ {
804
+ "epoch": 0.2541384938214036,
805
+ "grad_norm": 27.95315933227539,
806
+ "learning_rate": 4.7458615061785966e-05,
807
+ "loss": 0.6457,
808
+ "step": 1090
809
+ },
810
+ {
811
+ "epoch": 0.25647003963627885,
812
+ "grad_norm": 20.998676300048828,
813
+ "learning_rate": 4.743529960363721e-05,
814
+ "loss": 0.6852,
815
+ "step": 1100
816
+ },
817
+ {
818
+ "epoch": 0.2588015854511541,
819
+ "grad_norm": 28.259180068969727,
820
+ "learning_rate": 4.741198414548846e-05,
821
+ "loss": 0.6709,
822
+ "step": 1110
823
+ },
824
+ {
825
+ "epoch": 0.2611331312660294,
826
+ "grad_norm": 29.109024047851562,
827
+ "learning_rate": 4.738866868733971e-05,
828
+ "loss": 0.5709,
829
+ "step": 1120
830
+ },
831
+ {
832
+ "epoch": 0.26346467708090465,
833
+ "grad_norm": 25.32686996459961,
834
+ "learning_rate": 4.736535322919096e-05,
835
+ "loss": 0.5139,
836
+ "step": 1130
837
+ },
838
+ {
839
+ "epoch": 0.2657962228957799,
840
+ "grad_norm": 19.918743133544922,
841
+ "learning_rate": 4.73420377710422e-05,
842
+ "loss": 0.6274,
843
+ "step": 1140
844
+ },
845
+ {
846
+ "epoch": 0.2681277687106552,
847
+ "grad_norm": 27.803632736206055,
848
+ "learning_rate": 4.731872231289345e-05,
849
+ "loss": 0.7746,
850
+ "step": 1150
851
+ },
852
+ {
853
+ "epoch": 0.2704593145255304,
854
+ "grad_norm": 51.257896423339844,
855
+ "learning_rate": 4.72954068547447e-05,
856
+ "loss": 0.6581,
857
+ "step": 1160
858
+ },
859
+ {
860
+ "epoch": 0.27279086034040567,
861
+ "grad_norm": 25.976425170898438,
862
+ "learning_rate": 4.7272091396595943e-05,
863
+ "loss": 0.5674,
864
+ "step": 1170
865
+ },
866
+ {
867
+ "epoch": 0.27512240615528094,
868
+ "grad_norm": 20.14984703063965,
869
+ "learning_rate": 4.7248775938447195e-05,
870
+ "loss": 0.5609,
871
+ "step": 1180
872
+ },
873
+ {
874
+ "epoch": 0.2774539519701562,
875
+ "grad_norm": 21.2273006439209,
876
+ "learning_rate": 4.722546048029844e-05,
877
+ "loss": 0.5842,
878
+ "step": 1190
879
+ },
880
+ {
881
+ "epoch": 0.2797854977850315,
882
+ "grad_norm": 31.50432014465332,
883
+ "learning_rate": 4.7202145022149684e-05,
884
+ "loss": 0.5867,
885
+ "step": 1200
886
+ },
887
+ {
888
+ "epoch": 0.2797854977850315,
889
+ "eval_accuracy": 0.7227235438884332,
890
+ "eval_f1": 0.7223497656011426,
891
+ "eval_loss": 0.7796285152435303,
892
+ "eval_precision": 0.7239042036307864,
893
+ "eval_recall": 0.7433241953688237,
894
+ "eval_runtime": 32.4272,
895
+ "eval_samples_per_second": 37.592,
896
+ "eval_steps_per_second": 2.375,
897
+ "step": 1200
898
+ },
899
+ {
900
+ "epoch": 0.28211704359990675,
901
+ "grad_norm": 32.188232421875,
902
+ "learning_rate": 4.7178829564000936e-05,
903
+ "loss": 0.6986,
904
+ "step": 1210
905
+ },
906
+ {
907
+ "epoch": 0.284448589414782,
908
+ "grad_norm": 21.2509708404541,
909
+ "learning_rate": 4.715551410585218e-05,
910
+ "loss": 0.5578,
911
+ "step": 1220
912
+ },
913
+ {
914
+ "epoch": 0.2867801352296573,
915
+ "grad_norm": 36.59361267089844,
916
+ "learning_rate": 4.713219864770343e-05,
917
+ "loss": 0.6035,
918
+ "step": 1230
919
+ },
920
+ {
921
+ "epoch": 0.2891116810445325,
922
+ "grad_norm": 23.820602416992188,
923
+ "learning_rate": 4.7108883189554677e-05,
924
+ "loss": 0.672,
925
+ "step": 1240
926
+ },
927
+ {
928
+ "epoch": 0.29144322685940777,
929
+ "grad_norm": 9.917643547058105,
930
+ "learning_rate": 4.708556773140592e-05,
931
+ "loss": 0.5623,
932
+ "step": 1250
933
+ },
934
+ {
935
+ "epoch": 0.29377477267428304,
936
+ "grad_norm": 23.47327423095703,
937
+ "learning_rate": 4.706225227325717e-05,
938
+ "loss": 0.5947,
939
+ "step": 1260
940
+ },
941
+ {
942
+ "epoch": 0.2961063184891583,
943
+ "grad_norm": 20.891555786132812,
944
+ "learning_rate": 4.703893681510842e-05,
945
+ "loss": 0.5065,
946
+ "step": 1270
947
+ },
948
+ {
949
+ "epoch": 0.2984378643040336,
950
+ "grad_norm": 20.379684448242188,
951
+ "learning_rate": 4.701562135695967e-05,
952
+ "loss": 0.4707,
953
+ "step": 1280
954
+ },
955
+ {
956
+ "epoch": 0.30076941011890884,
957
+ "grad_norm": 23.66413688659668,
958
+ "learning_rate": 4.6992305898810914e-05,
959
+ "loss": 0.7354,
960
+ "step": 1290
961
+ },
962
+ {
963
+ "epoch": 0.3031009559337841,
964
+ "grad_norm": 82.15457916259766,
965
+ "learning_rate": 4.6968990440662165e-05,
966
+ "loss": 0.6615,
967
+ "step": 1300
968
+ },
969
+ {
970
+ "epoch": 0.3054325017486594,
971
+ "grad_norm": 43.44639587402344,
972
+ "learning_rate": 4.694567498251341e-05,
973
+ "loss": 0.7217,
974
+ "step": 1310
975
+ },
976
+ {
977
+ "epoch": 0.30776404756353465,
978
+ "grad_norm": 27.2445125579834,
979
+ "learning_rate": 4.6922359524364654e-05,
980
+ "loss": 0.7379,
981
+ "step": 1320
982
+ },
983
+ {
984
+ "epoch": 0.31009559337840986,
985
+ "grad_norm": 23.97974395751953,
986
+ "learning_rate": 4.68990440662159e-05,
987
+ "loss": 0.6117,
988
+ "step": 1330
989
+ },
990
+ {
991
+ "epoch": 0.31242713919328513,
992
+ "grad_norm": 20.4930362701416,
993
+ "learning_rate": 4.687572860806715e-05,
994
+ "loss": 0.6047,
995
+ "step": 1340
996
+ },
997
+ {
998
+ "epoch": 0.3147586850081604,
999
+ "grad_norm": 36.909305572509766,
1000
+ "learning_rate": 4.68524131499184e-05,
1001
+ "loss": 0.5695,
1002
+ "step": 1350
1003
+ },
1004
+ {
1005
+ "epoch": 0.31709023082303567,
1006
+ "grad_norm": 13.219598770141602,
1007
+ "learning_rate": 4.682909769176965e-05,
1008
+ "loss": 0.61,
1009
+ "step": 1360
1010
+ },
1011
+ {
1012
+ "epoch": 0.31942177663791094,
1013
+ "grad_norm": 37.49195861816406,
1014
+ "learning_rate": 4.680578223362089e-05,
1015
+ "loss": 0.6959,
1016
+ "step": 1370
1017
+ },
1018
+ {
1019
+ "epoch": 0.3217533224527862,
1020
+ "grad_norm": 21.94476890563965,
1021
+ "learning_rate": 4.6782466775472136e-05,
1022
+ "loss": 0.5361,
1023
+ "step": 1380
1024
+ },
1025
+ {
1026
+ "epoch": 0.3240848682676615,
1027
+ "grad_norm": 15.76740837097168,
1028
+ "learning_rate": 4.675915131732339e-05,
1029
+ "loss": 0.5799,
1030
+ "step": 1390
1031
+ },
1032
+ {
1033
+ "epoch": 0.32641641408253674,
1034
+ "grad_norm": 16.694778442382812,
1035
+ "learning_rate": 4.673583585917464e-05,
1036
+ "loss": 0.5195,
1037
+ "step": 1400
1038
+ },
1039
+ {
1040
+ "epoch": 0.32874795989741196,
1041
+ "grad_norm": 17.327856063842773,
1042
+ "learning_rate": 4.6712520401025884e-05,
1043
+ "loss": 0.4577,
1044
+ "step": 1410
1045
+ },
1046
+ {
1047
+ "epoch": 0.3310795057122872,
1048
+ "grad_norm": 19.089357376098633,
1049
+ "learning_rate": 4.668920494287713e-05,
1050
+ "loss": 0.5473,
1051
+ "step": 1420
1052
+ },
1053
+ {
1054
+ "epoch": 0.3334110515271625,
1055
+ "grad_norm": 20.266950607299805,
1056
+ "learning_rate": 4.666588948472837e-05,
1057
+ "loss": 0.5861,
1058
+ "step": 1430
1059
+ },
1060
+ {
1061
+ "epoch": 0.33574259734203776,
1062
+ "grad_norm": 14.822595596313477,
1063
+ "learning_rate": 4.6642574026579625e-05,
1064
+ "loss": 0.4603,
1065
+ "step": 1440
1066
+ },
1067
+ {
1068
+ "epoch": 0.33807414315691303,
1069
+ "grad_norm": 14.292266845703125,
1070
+ "learning_rate": 4.6619258568430876e-05,
1071
+ "loss": 0.5209,
1072
+ "step": 1450
1073
+ },
1074
+ {
1075
+ "epoch": 0.3404056889717883,
1076
+ "grad_norm": 15.99500560760498,
1077
+ "learning_rate": 4.659594311028212e-05,
1078
+ "loss": 0.5721,
1079
+ "step": 1460
1080
+ },
1081
+ {
1082
+ "epoch": 0.34273723478666357,
1083
+ "grad_norm": 15.458304405212402,
1084
+ "learning_rate": 4.6572627652133366e-05,
1085
+ "loss": 0.5798,
1086
+ "step": 1470
1087
+ },
1088
+ {
1089
+ "epoch": 0.34506878060153884,
1090
+ "grad_norm": 22.426408767700195,
1091
+ "learning_rate": 4.654931219398461e-05,
1092
+ "loss": 0.6674,
1093
+ "step": 1480
1094
+ },
1095
+ {
1096
+ "epoch": 0.3474003264164141,
1097
+ "grad_norm": 16.9567928314209,
1098
+ "learning_rate": 4.652599673583586e-05,
1099
+ "loss": 0.6049,
1100
+ "step": 1490
1101
+ },
1102
+ {
1103
+ "epoch": 0.3497318722312893,
1104
+ "grad_norm": 39.44313430786133,
1105
+ "learning_rate": 4.650268127768711e-05,
1106
+ "loss": 0.5684,
1107
+ "step": 1500
1108
+ },
1109
+ {
1110
+ "epoch": 0.3497318722312893,
1111
+ "eval_accuracy": 0.7506152584085316,
1112
+ "eval_f1": 0.7356563013468664,
1113
+ "eval_loss": 0.7205380797386169,
1114
+ "eval_precision": 0.7489548577706214,
1115
+ "eval_recall": 0.7325100738137515,
1116
+ "eval_runtime": 32.4911,
1117
+ "eval_samples_per_second": 37.518,
1118
+ "eval_steps_per_second": 2.37,
1119
+ "step": 1500
1120
+ },
1121
+ {
1122
+ "epoch": 0.3520634180461646,
1123
+ "grad_norm": 27.17556381225586,
1124
+ "learning_rate": 4.647936581953836e-05,
1125
+ "loss": 0.5555,
1126
+ "step": 1510
1127
+ },
1128
+ {
1129
+ "epoch": 0.35439496386103986,
1130
+ "grad_norm": 21.439729690551758,
1131
+ "learning_rate": 4.64560503613896e-05,
1132
+ "loss": 0.6018,
1133
+ "step": 1520
1134
+ },
1135
+ {
1136
+ "epoch": 0.3567265096759151,
1137
+ "grad_norm": 27.142850875854492,
1138
+ "learning_rate": 4.643273490324085e-05,
1139
+ "loss": 0.6183,
1140
+ "step": 1530
1141
+ },
1142
+ {
1143
+ "epoch": 0.3590580554907904,
1144
+ "grad_norm": 26.709306716918945,
1145
+ "learning_rate": 4.64094194450921e-05,
1146
+ "loss": 0.5238,
1147
+ "step": 1540
1148
+ },
1149
+ {
1150
+ "epoch": 0.36138960130566566,
1151
+ "grad_norm": 18.24578857421875,
1152
+ "learning_rate": 4.6386103986943343e-05,
1153
+ "loss": 0.6221,
1154
+ "step": 1550
1155
+ },
1156
+ {
1157
+ "epoch": 0.36372114712054093,
1158
+ "grad_norm": 16.884159088134766,
1159
+ "learning_rate": 4.6362788528794595e-05,
1160
+ "loss": 0.577,
1161
+ "step": 1560
1162
+ },
1163
+ {
1164
+ "epoch": 0.3660526929354162,
1165
+ "grad_norm": 27.92196273803711,
1166
+ "learning_rate": 4.633947307064584e-05,
1167
+ "loss": 0.4804,
1168
+ "step": 1570
1169
+ },
1170
+ {
1171
+ "epoch": 0.36838423875029147,
1172
+ "grad_norm": 19.397260665893555,
1173
+ "learning_rate": 4.6316157612497084e-05,
1174
+ "loss": 0.5586,
1175
+ "step": 1580
1176
+ },
1177
+ {
1178
+ "epoch": 0.3707157845651667,
1179
+ "grad_norm": 20.426605224609375,
1180
+ "learning_rate": 4.6292842154348336e-05,
1181
+ "loss": 0.7078,
1182
+ "step": 1590
1183
+ },
1184
+ {
1185
+ "epoch": 0.37304733038004195,
1186
+ "grad_norm": 16.057165145874023,
1187
+ "learning_rate": 4.626952669619958e-05,
1188
+ "loss": 0.4367,
1189
+ "step": 1600
1190
+ },
1191
+ {
1192
+ "epoch": 0.3753788761949172,
1193
+ "grad_norm": 15.59145450592041,
1194
+ "learning_rate": 4.624621123805083e-05,
1195
+ "loss": 0.4379,
1196
+ "step": 1610
1197
+ },
1198
+ {
1199
+ "epoch": 0.3777104220097925,
1200
+ "grad_norm": 11.662853240966797,
1201
+ "learning_rate": 4.622289577990208e-05,
1202
+ "loss": 0.4041,
1203
+ "step": 1620
1204
+ },
1205
+ {
1206
+ "epoch": 0.38004196782466776,
1207
+ "grad_norm": 27.15912628173828,
1208
+ "learning_rate": 4.619958032175333e-05,
1209
+ "loss": 0.5678,
1210
+ "step": 1630
1211
+ },
1212
+ {
1213
+ "epoch": 0.38237351363954303,
1214
+ "grad_norm": 18.558469772338867,
1215
+ "learning_rate": 4.617626486360457e-05,
1216
+ "loss": 0.5907,
1217
+ "step": 1640
1218
+ },
1219
+ {
1220
+ "epoch": 0.3847050594544183,
1221
+ "grad_norm": 32.28955078125,
1222
+ "learning_rate": 4.615294940545582e-05,
1223
+ "loss": 0.592,
1224
+ "step": 1650
1225
+ },
1226
+ {
1227
+ "epoch": 0.38703660526929357,
1228
+ "grad_norm": 19.484052658081055,
1229
+ "learning_rate": 4.612963394730707e-05,
1230
+ "loss": 0.5517,
1231
+ "step": 1660
1232
+ },
1233
+ {
1234
+ "epoch": 0.3893681510841688,
1235
+ "grad_norm": 19.991775512695312,
1236
+ "learning_rate": 4.6106318489158314e-05,
1237
+ "loss": 0.4574,
1238
+ "step": 1670
1239
+ },
1240
+ {
1241
+ "epoch": 0.39169969689904405,
1242
+ "grad_norm": 19.2491455078125,
1243
+ "learning_rate": 4.6083003031009565e-05,
1244
+ "loss": 0.5324,
1245
+ "step": 1680
1246
+ },
1247
+ {
1248
+ "epoch": 0.3940312427139193,
1249
+ "grad_norm": 26.1087646484375,
1250
+ "learning_rate": 4.605968757286081e-05,
1251
+ "loss": 0.5405,
1252
+ "step": 1690
1253
+ },
1254
+ {
1255
+ "epoch": 0.3963627885287946,
1256
+ "grad_norm": 28.05010986328125,
1257
+ "learning_rate": 4.6036372114712055e-05,
1258
+ "loss": 0.6015,
1259
+ "step": 1700
1260
+ },
1261
+ {
1262
+ "epoch": 0.39869433434366985,
1263
+ "grad_norm": 24.019983291625977,
1264
+ "learning_rate": 4.60130566565633e-05,
1265
+ "loss": 0.4885,
1266
+ "step": 1710
1267
+ },
1268
+ {
1269
+ "epoch": 0.4010258801585451,
1270
+ "grad_norm": 43.11894607543945,
1271
+ "learning_rate": 4.598974119841455e-05,
1272
+ "loss": 0.6539,
1273
+ "step": 1720
1274
+ },
1275
+ {
1276
+ "epoch": 0.4033574259734204,
1277
+ "grad_norm": 23.700422286987305,
1278
+ "learning_rate": 4.59664257402658e-05,
1279
+ "loss": 0.4439,
1280
+ "step": 1730
1281
+ },
1282
+ {
1283
+ "epoch": 0.40568897178829566,
1284
+ "grad_norm": 29.97321319580078,
1285
+ "learning_rate": 4.594311028211705e-05,
1286
+ "loss": 0.493,
1287
+ "step": 1740
1288
+ },
1289
+ {
1290
+ "epoch": 0.40802051760317093,
1291
+ "grad_norm": 32.946022033691406,
1292
+ "learning_rate": 4.591979482396829e-05,
1293
+ "loss": 0.6301,
1294
+ "step": 1750
1295
+ },
1296
+ {
1297
+ "epoch": 0.41035206341804614,
1298
+ "grad_norm": 16.01514434814453,
1299
+ "learning_rate": 4.5896479365819536e-05,
1300
+ "loss": 0.4617,
1301
+ "step": 1760
1302
+ },
1303
+ {
1304
+ "epoch": 0.4126836092329214,
1305
+ "grad_norm": 21.685338973999023,
1306
+ "learning_rate": 4.587316390767079e-05,
1307
+ "loss": 0.6289,
1308
+ "step": 1770
1309
+ },
1310
+ {
1311
+ "epoch": 0.4150151550477967,
1312
+ "grad_norm": 28.99067497253418,
1313
+ "learning_rate": 4.584984844952204e-05,
1314
+ "loss": 0.4477,
1315
+ "step": 1780
1316
+ },
1317
+ {
1318
+ "epoch": 0.41734670086267195,
1319
+ "grad_norm": 35.17900085449219,
1320
+ "learning_rate": 4.5826532991373284e-05,
1321
+ "loss": 0.4637,
1322
+ "step": 1790
1323
+ },
1324
+ {
1325
+ "epoch": 0.4196782466775472,
1326
+ "grad_norm": 33.74941635131836,
1327
+ "learning_rate": 4.580321753322453e-05,
1328
+ "loss": 0.6002,
1329
+ "step": 1800
1330
+ },
1331
+ {
1332
+ "epoch": 0.4196782466775472,
1333
+ "eval_accuracy": 0.7506152584085316,
1334
+ "eval_f1": 0.7449892374013476,
1335
+ "eval_loss": 0.7239476442337036,
1336
+ "eval_precision": 0.7453346607126952,
1337
+ "eval_recall": 0.7541687656017055,
1338
+ "eval_runtime": 32.6118,
1339
+ "eval_samples_per_second": 37.379,
1340
+ "eval_steps_per_second": 2.361,
1341
+ "step": 1800
1342
+ },
1343
+ {
1344
+ "epoch": 0.4220097924924225,
1345
+ "grad_norm": 13.531204223632812,
1346
+ "learning_rate": 4.577990207507577e-05,
1347
+ "loss": 0.5473,
1348
+ "step": 1810
1349
+ },
1350
+ {
1351
+ "epoch": 0.42434133830729776,
1352
+ "grad_norm": 16.84659194946289,
1353
+ "learning_rate": 4.5756586616927025e-05,
1354
+ "loss": 0.5308,
1355
+ "step": 1820
1356
+ },
1357
+ {
1358
+ "epoch": 0.426672884122173,
1359
+ "grad_norm": 34.70216369628906,
1360
+ "learning_rate": 4.5733271158778276e-05,
1361
+ "loss": 0.7112,
1362
+ "step": 1830
1363
+ },
1364
+ {
1365
+ "epoch": 0.42900442993704824,
1366
+ "grad_norm": 18.915586471557617,
1367
+ "learning_rate": 4.570995570062952e-05,
1368
+ "loss": 0.6053,
1369
+ "step": 1840
1370
+ },
1371
+ {
1372
+ "epoch": 0.4313359757519235,
1373
+ "grad_norm": 19.790071487426758,
1374
+ "learning_rate": 4.5686640242480766e-05,
1375
+ "loss": 0.4516,
1376
+ "step": 1850
1377
+ },
1378
+ {
1379
+ "epoch": 0.4336675215667988,
1380
+ "grad_norm": 19.730384826660156,
1381
+ "learning_rate": 4.566332478433201e-05,
1382
+ "loss": 0.6088,
1383
+ "step": 1860
1384
+ },
1385
+ {
1386
+ "epoch": 0.43599906738167404,
1387
+ "grad_norm": 31.787572860717773,
1388
+ "learning_rate": 4.564000932618326e-05,
1389
+ "loss": 0.5709,
1390
+ "step": 1870
1391
+ },
1392
+ {
1393
+ "epoch": 0.4383306131965493,
1394
+ "grad_norm": 26.529708862304688,
1395
+ "learning_rate": 4.561669386803451e-05,
1396
+ "loss": 0.5072,
1397
+ "step": 1880
1398
+ },
1399
+ {
1400
+ "epoch": 0.4406621590114246,
1401
+ "grad_norm": 29.785123825073242,
1402
+ "learning_rate": 4.559337840988576e-05,
1403
+ "loss": 0.4786,
1404
+ "step": 1890
1405
+ },
1406
+ {
1407
+ "epoch": 0.44299370482629985,
1408
+ "grad_norm": 18.451383590698242,
1409
+ "learning_rate": 4.5570062951737e-05,
1410
+ "loss": 0.5377,
1411
+ "step": 1900
1412
+ },
1413
+ {
1414
+ "epoch": 0.4453252506411751,
1415
+ "grad_norm": 24.651517868041992,
1416
+ "learning_rate": 4.554674749358825e-05,
1417
+ "loss": 0.4759,
1418
+ "step": 1910
1419
+ },
1420
+ {
1421
+ "epoch": 0.4476567964560504,
1422
+ "grad_norm": 23.738956451416016,
1423
+ "learning_rate": 4.55234320354395e-05,
1424
+ "loss": 0.6059,
1425
+ "step": 1920
1426
+ },
1427
+ {
1428
+ "epoch": 0.4499883422709256,
1429
+ "grad_norm": 15.957860946655273,
1430
+ "learning_rate": 4.5500116577290743e-05,
1431
+ "loss": 0.5788,
1432
+ "step": 1930
1433
+ },
1434
+ {
1435
+ "epoch": 0.45231988808580087,
1436
+ "grad_norm": 18.671892166137695,
1437
+ "learning_rate": 4.5476801119141995e-05,
1438
+ "loss": 0.42,
1439
+ "step": 1940
1440
+ },
1441
+ {
1442
+ "epoch": 0.45465143390067614,
1443
+ "grad_norm": 20.396814346313477,
1444
+ "learning_rate": 4.545348566099324e-05,
1445
+ "loss": 0.5062,
1446
+ "step": 1950
1447
+ },
1448
+ {
1449
+ "epoch": 0.4569829797155514,
1450
+ "grad_norm": 35.40294647216797,
1451
+ "learning_rate": 4.5430170202844484e-05,
1452
+ "loss": 0.6339,
1453
+ "step": 1960
1454
+ },
1455
+ {
1456
+ "epoch": 0.4593145255304267,
1457
+ "grad_norm": 20.99814224243164,
1458
+ "learning_rate": 4.5406854744695736e-05,
1459
+ "loss": 0.4737,
1460
+ "step": 1970
1461
+ },
1462
+ {
1463
+ "epoch": 0.46164607134530194,
1464
+ "grad_norm": 19.0653133392334,
1465
+ "learning_rate": 4.538353928654698e-05,
1466
+ "loss": 0.4303,
1467
+ "step": 1980
1468
+ },
1469
+ {
1470
+ "epoch": 0.4639776171601772,
1471
+ "grad_norm": 25.659717559814453,
1472
+ "learning_rate": 4.536022382839823e-05,
1473
+ "loss": 0.4544,
1474
+ "step": 1990
1475
+ },
1476
+ {
1477
+ "epoch": 0.4663091629750525,
1478
+ "grad_norm": 15.122028350830078,
1479
+ "learning_rate": 4.533690837024948e-05,
1480
+ "loss": 0.4343,
1481
+ "step": 2000
1482
+ },
1483
+ {
1484
+ "epoch": 0.4686407087899277,
1485
+ "grad_norm": 18.79733657836914,
1486
+ "learning_rate": 4.531359291210073e-05,
1487
+ "loss": 0.598,
1488
+ "step": 2010
1489
+ },
1490
+ {
1491
+ "epoch": 0.47097225460480296,
1492
+ "grad_norm": 21.690399169921875,
1493
+ "learning_rate": 4.529027745395197e-05,
1494
+ "loss": 0.5553,
1495
+ "step": 2020
1496
+ },
1497
+ {
1498
+ "epoch": 0.47330380041967823,
1499
+ "grad_norm": 19.833171844482422,
1500
+ "learning_rate": 4.526696199580322e-05,
1501
+ "loss": 0.4684,
1502
+ "step": 2030
1503
+ },
1504
+ {
1505
+ "epoch": 0.4756353462345535,
1506
+ "grad_norm": 31.109315872192383,
1507
+ "learning_rate": 4.524364653765447e-05,
1508
+ "loss": 0.5953,
1509
+ "step": 2040
1510
+ },
1511
+ {
1512
+ "epoch": 0.47796689204942877,
1513
+ "grad_norm": 14.755363464355469,
1514
+ "learning_rate": 4.5220331079505714e-05,
1515
+ "loss": 0.4521,
1516
+ "step": 2050
1517
+ },
1518
+ {
1519
+ "epoch": 0.48029843786430404,
1520
+ "grad_norm": 19.60972785949707,
1521
+ "learning_rate": 4.5197015621356965e-05,
1522
+ "loss": 0.4349,
1523
+ "step": 2060
1524
+ },
1525
+ {
1526
+ "epoch": 0.4826299836791793,
1527
+ "grad_norm": 20.63113784790039,
1528
+ "learning_rate": 4.517370016320821e-05,
1529
+ "loss": 0.4893,
1530
+ "step": 2070
1531
+ },
1532
+ {
1533
+ "epoch": 0.4849615294940546,
1534
+ "grad_norm": 21.99651336669922,
1535
+ "learning_rate": 4.5150384705059455e-05,
1536
+ "loss": 0.535,
1537
+ "step": 2080
1538
+ },
1539
+ {
1540
+ "epoch": 0.48729307530892985,
1541
+ "grad_norm": 13.244401931762695,
1542
+ "learning_rate": 4.51270692469107e-05,
1543
+ "loss": 0.4573,
1544
+ "step": 2090
1545
+ },
1546
+ {
1547
+ "epoch": 0.48962462112380506,
1548
+ "grad_norm": 22.323959350585938,
1549
+ "learning_rate": 4.510375378876195e-05,
1550
+ "loss": 0.4974,
1551
+ "step": 2100
1552
+ },
1553
+ {
1554
+ "epoch": 0.48962462112380506,
1555
+ "eval_accuracy": 0.7497949138638228,
1556
+ "eval_f1": 0.7429285315686787,
1557
+ "eval_loss": 0.7164492011070251,
1558
+ "eval_precision": 0.7399478118312398,
1559
+ "eval_recall": 0.751867958660305,
1560
+ "eval_runtime": 32.6276,
1561
+ "eval_samples_per_second": 37.361,
1562
+ "eval_steps_per_second": 2.36,
1563
+ "step": 2100
1564
+ },
1565
+ {
1566
+ "epoch": 0.49195616693868033,
1567
+ "grad_norm": 14.91236400604248,
1568
+ "learning_rate": 4.50804383306132e-05,
1569
+ "loss": 0.4868,
1570
+ "step": 2110
1571
+ },
1572
+ {
1573
+ "epoch": 0.4942877127535556,
1574
+ "grad_norm": 14.522492408752441,
1575
+ "learning_rate": 4.505712287246445e-05,
1576
+ "loss": 0.517,
1577
+ "step": 2120
1578
+ },
1579
+ {
1580
+ "epoch": 0.49661925856843087,
1581
+ "grad_norm": 14.661904335021973,
1582
+ "learning_rate": 4.503380741431569e-05,
1583
+ "loss": 0.6969,
1584
+ "step": 2130
1585
+ },
1586
+ {
1587
+ "epoch": 0.49895080438330613,
1588
+ "grad_norm": 17.774005889892578,
1589
+ "learning_rate": 4.5010491956166936e-05,
1590
+ "loss": 0.3392,
1591
+ "step": 2140
1592
+ },
1593
+ {
1594
+ "epoch": 0.5012823501981813,
1595
+ "grad_norm": 20.338176727294922,
1596
+ "learning_rate": 4.498717649801819e-05,
1597
+ "loss": 0.5478,
1598
+ "step": 2150
1599
+ },
1600
+ {
1601
+ "epoch": 0.5036138960130566,
1602
+ "grad_norm": 23.17992401123047,
1603
+ "learning_rate": 4.496386103986944e-05,
1604
+ "loss": 0.4363,
1605
+ "step": 2160
1606
+ },
1607
+ {
1608
+ "epoch": 0.5059454418279319,
1609
+ "grad_norm": 26.9781494140625,
1610
+ "learning_rate": 4.4940545581720684e-05,
1611
+ "loss": 0.4991,
1612
+ "step": 2170
1613
+ },
1614
+ {
1615
+ "epoch": 0.5082769876428072,
1616
+ "grad_norm": 13.74269962310791,
1617
+ "learning_rate": 4.491723012357193e-05,
1618
+ "loss": 0.4789,
1619
+ "step": 2180
1620
+ },
1621
+ {
1622
+ "epoch": 0.5106085334576824,
1623
+ "grad_norm": 9.351542472839355,
1624
+ "learning_rate": 4.489391466542317e-05,
1625
+ "loss": 0.6222,
1626
+ "step": 2190
1627
+ },
1628
+ {
1629
+ "epoch": 0.5129400792725577,
1630
+ "grad_norm": 29.69098472595215,
1631
+ "learning_rate": 4.4870599207274425e-05,
1632
+ "loss": 0.5182,
1633
+ "step": 2200
1634
+ },
1635
+ {
1636
+ "epoch": 0.515271625087433,
1637
+ "grad_norm": 34.87522506713867,
1638
+ "learning_rate": 4.4847283749125676e-05,
1639
+ "loss": 0.4833,
1640
+ "step": 2210
1641
+ },
1642
+ {
1643
+ "epoch": 0.5176031709023082,
1644
+ "grad_norm": 16.882413864135742,
1645
+ "learning_rate": 4.482396829097692e-05,
1646
+ "loss": 0.4985,
1647
+ "step": 2220
1648
+ },
1649
+ {
1650
+ "epoch": 0.5199347167171835,
1651
+ "grad_norm": 18.16925621032715,
1652
+ "learning_rate": 4.4800652832828166e-05,
1653
+ "loss": 0.5125,
1654
+ "step": 2230
1655
+ },
1656
+ {
1657
+ "epoch": 0.5222662625320588,
1658
+ "grad_norm": 25.316865921020508,
1659
+ "learning_rate": 4.477733737467941e-05,
1660
+ "loss": 0.6061,
1661
+ "step": 2240
1662
+ },
1663
+ {
1664
+ "epoch": 0.524597808346934,
1665
+ "grad_norm": 24.0291690826416,
1666
+ "learning_rate": 4.475402191653066e-05,
1667
+ "loss": 0.5563,
1668
+ "step": 2250
1669
+ },
1670
+ {
1671
+ "epoch": 0.5269293541618093,
1672
+ "grad_norm": 18.830142974853516,
1673
+ "learning_rate": 4.473070645838191e-05,
1674
+ "loss": 0.34,
1675
+ "step": 2260
1676
+ },
1677
+ {
1678
+ "epoch": 0.5292608999766846,
1679
+ "grad_norm": 24.81058692932129,
1680
+ "learning_rate": 4.470739100023316e-05,
1681
+ "loss": 0.4322,
1682
+ "step": 2270
1683
+ },
1684
+ {
1685
+ "epoch": 0.5315924457915598,
1686
+ "grad_norm": 25.785091400146484,
1687
+ "learning_rate": 4.46840755420844e-05,
1688
+ "loss": 0.4726,
1689
+ "step": 2280
1690
+ },
1691
+ {
1692
+ "epoch": 0.5339239916064351,
1693
+ "grad_norm": 14.79159927368164,
1694
+ "learning_rate": 4.466076008393565e-05,
1695
+ "loss": 0.3366,
1696
+ "step": 2290
1697
+ },
1698
+ {
1699
+ "epoch": 0.5362555374213104,
1700
+ "grad_norm": 34.41261672973633,
1701
+ "learning_rate": 4.46374446257869e-05,
1702
+ "loss": 0.5926,
1703
+ "step": 2300
1704
+ },
1705
+ {
1706
+ "epoch": 0.5385870832361855,
1707
+ "grad_norm": 34.747901916503906,
1708
+ "learning_rate": 4.4614129167638144e-05,
1709
+ "loss": 0.6057,
1710
+ "step": 2310
1711
+ },
1712
+ {
1713
+ "epoch": 0.5409186290510608,
1714
+ "grad_norm": 17.471677780151367,
1715
+ "learning_rate": 4.4590813709489395e-05,
1716
+ "loss": 0.5399,
1717
+ "step": 2320
1718
+ },
1719
+ {
1720
+ "epoch": 0.5432501748659361,
1721
+ "grad_norm": 29.014802932739258,
1722
+ "learning_rate": 4.456749825134064e-05,
1723
+ "loss": 0.4637,
1724
+ "step": 2330
1725
+ },
1726
+ {
1727
+ "epoch": 0.5455817206808113,
1728
+ "grad_norm": 12.530820846557617,
1729
+ "learning_rate": 4.454418279319189e-05,
1730
+ "loss": 0.4172,
1731
+ "step": 2340
1732
+ },
1733
+ {
1734
+ "epoch": 0.5479132664956866,
1735
+ "grad_norm": 15.449395179748535,
1736
+ "learning_rate": 4.4520867335043136e-05,
1737
+ "loss": 0.5294,
1738
+ "step": 2350
1739
+ },
1740
+ {
1741
+ "epoch": 0.5502448123105619,
1742
+ "grad_norm": 26.869712829589844,
1743
+ "learning_rate": 4.449755187689438e-05,
1744
+ "loss": 0.5169,
1745
+ "step": 2360
1746
+ },
1747
+ {
1748
+ "epoch": 0.5525763581254372,
1749
+ "grad_norm": 17.471458435058594,
1750
+ "learning_rate": 4.447423641874563e-05,
1751
+ "loss": 0.4523,
1752
+ "step": 2370
1753
+ },
1754
+ {
1755
+ "epoch": 0.5549079039403124,
1756
+ "grad_norm": 24.529001235961914,
1757
+ "learning_rate": 4.445092096059688e-05,
1758
+ "loss": 0.4501,
1759
+ "step": 2380
1760
+ },
1761
+ {
1762
+ "epoch": 0.5572394497551877,
1763
+ "grad_norm": 22.41488265991211,
1764
+ "learning_rate": 4.442760550244813e-05,
1765
+ "loss": 0.5475,
1766
+ "step": 2390
1767
+ },
1768
+ {
1769
+ "epoch": 0.559570995570063,
1770
+ "grad_norm": 27.631166458129883,
1771
+ "learning_rate": 4.440429004429937e-05,
1772
+ "loss": 0.5527,
1773
+ "step": 2400
1774
+ },
1775
+ {
1776
+ "epoch": 0.559570995570063,
1777
+ "eval_accuracy": 0.7506152584085316,
1778
+ "eval_f1": 0.7474469925712124,
1779
+ "eval_loss": 0.7103798985481262,
1780
+ "eval_precision": 0.7429756390197679,
1781
+ "eval_recall": 0.7637649710650173,
1782
+ "eval_runtime": 32.5095,
1783
+ "eval_samples_per_second": 37.497,
1784
+ "eval_steps_per_second": 2.369,
1785
+ "step": 2400
1786
+ },
1787
+ {
1788
+ "epoch": 0.5619025413849382,
1789
+ "grad_norm": 25.045551300048828,
1790
+ "learning_rate": 4.438097458615062e-05,
1791
+ "loss": 0.641,
1792
+ "step": 2410
1793
+ },
1794
+ {
1795
+ "epoch": 0.5642340871998135,
1796
+ "grad_norm": 21.757932662963867,
1797
+ "learning_rate": 4.435765912800187e-05,
1798
+ "loss": 0.4971,
1799
+ "step": 2420
1800
+ },
1801
+ {
1802
+ "epoch": 0.5665656330146888,
1803
+ "grad_norm": 21.797353744506836,
1804
+ "learning_rate": 4.4334343669853114e-05,
1805
+ "loss": 0.4863,
1806
+ "step": 2430
1807
+ },
1808
+ {
1809
+ "epoch": 0.568897178829564,
1810
+ "grad_norm": 24.75421905517578,
1811
+ "learning_rate": 4.4311028211704365e-05,
1812
+ "loss": 0.49,
1813
+ "step": 2440
1814
+ },
1815
+ {
1816
+ "epoch": 0.5712287246444393,
1817
+ "grad_norm": 29.258378982543945,
1818
+ "learning_rate": 4.428771275355561e-05,
1819
+ "loss": 0.4736,
1820
+ "step": 2450
1821
+ },
1822
+ {
1823
+ "epoch": 0.5735602704593146,
1824
+ "grad_norm": 36.19465255737305,
1825
+ "learning_rate": 4.4264397295406855e-05,
1826
+ "loss": 0.4717,
1827
+ "step": 2460
1828
+ },
1829
+ {
1830
+ "epoch": 0.5758918162741898,
1831
+ "grad_norm": 25.283084869384766,
1832
+ "learning_rate": 4.42410818372581e-05,
1833
+ "loss": 0.5374,
1834
+ "step": 2470
1835
+ },
1836
+ {
1837
+ "epoch": 0.578223362089065,
1838
+ "grad_norm": 26.333541870117188,
1839
+ "learning_rate": 4.421776637910936e-05,
1840
+ "loss": 0.3847,
1841
+ "step": 2480
1842
+ },
1843
+ {
1844
+ "epoch": 0.5805549079039403,
1845
+ "grad_norm": 21.764862060546875,
1846
+ "learning_rate": 4.41944509209606e-05,
1847
+ "loss": 0.4232,
1848
+ "step": 2490
1849
+ },
1850
+ {
1851
+ "epoch": 0.5828864537188155,
1852
+ "grad_norm": 11.467122077941895,
1853
+ "learning_rate": 4.417113546281185e-05,
1854
+ "loss": 0.6221,
1855
+ "step": 2500
1856
+ },
1857
+ {
1858
+ "epoch": 0.5852179995336908,
1859
+ "grad_norm": 16.913673400878906,
1860
+ "learning_rate": 4.414782000466309e-05,
1861
+ "loss": 0.4062,
1862
+ "step": 2510
1863
+ },
1864
+ {
1865
+ "epoch": 0.5875495453485661,
1866
+ "grad_norm": 25.194719314575195,
1867
+ "learning_rate": 4.4124504546514336e-05,
1868
+ "loss": 0.4734,
1869
+ "step": 2520
1870
+ },
1871
+ {
1872
+ "epoch": 0.5898810911634413,
1873
+ "grad_norm": 16.23316764831543,
1874
+ "learning_rate": 4.410118908836559e-05,
1875
+ "loss": 0.413,
1876
+ "step": 2530
1877
+ },
1878
+ {
1879
+ "epoch": 0.5922126369783166,
1880
+ "grad_norm": 29.319387435913086,
1881
+ "learning_rate": 4.407787363021684e-05,
1882
+ "loss": 0.4903,
1883
+ "step": 2540
1884
+ },
1885
+ {
1886
+ "epoch": 0.5945441827931919,
1887
+ "grad_norm": 55.968284606933594,
1888
+ "learning_rate": 4.4054558172068084e-05,
1889
+ "loss": 0.5513,
1890
+ "step": 2550
1891
+ },
1892
+ {
1893
+ "epoch": 0.5968757286080671,
1894
+ "grad_norm": 19.242820739746094,
1895
+ "learning_rate": 4.403124271391933e-05,
1896
+ "loss": 0.4908,
1897
+ "step": 2560
1898
+ },
1899
+ {
1900
+ "epoch": 0.5992072744229424,
1901
+ "grad_norm": 23.568754196166992,
1902
+ "learning_rate": 4.400792725577057e-05,
1903
+ "loss": 0.585,
1904
+ "step": 2570
1905
+ },
1906
+ {
1907
+ "epoch": 0.6015388202378177,
1908
+ "grad_norm": 19.30316925048828,
1909
+ "learning_rate": 4.3984611797621825e-05,
1910
+ "loss": 0.5568,
1911
+ "step": 2580
1912
+ },
1913
+ {
1914
+ "epoch": 0.603870366052693,
1915
+ "grad_norm": 11.688234329223633,
1916
+ "learning_rate": 4.3961296339473076e-05,
1917
+ "loss": 0.4393,
1918
+ "step": 2590
1919
+ },
1920
+ {
1921
+ "epoch": 0.6062019118675682,
1922
+ "grad_norm": 18.595117568969727,
1923
+ "learning_rate": 4.393798088132432e-05,
1924
+ "loss": 0.3502,
1925
+ "step": 2600
1926
+ },
1927
+ {
1928
+ "epoch": 0.6085334576824435,
1929
+ "grad_norm": 30.775352478027344,
1930
+ "learning_rate": 4.3914665423175566e-05,
1931
+ "loss": 0.4952,
1932
+ "step": 2610
1933
+ },
1934
+ {
1935
+ "epoch": 0.6108650034973188,
1936
+ "grad_norm": 9.629733085632324,
1937
+ "learning_rate": 4.389134996502681e-05,
1938
+ "loss": 0.3984,
1939
+ "step": 2620
1940
+ },
1941
+ {
1942
+ "epoch": 0.613196549312194,
1943
+ "grad_norm": 27.071420669555664,
1944
+ "learning_rate": 4.386803450687806e-05,
1945
+ "loss": 0.5048,
1946
+ "step": 2630
1947
+ },
1948
+ {
1949
+ "epoch": 0.6155280951270693,
1950
+ "grad_norm": 18.72870445251465,
1951
+ "learning_rate": 4.384471904872931e-05,
1952
+ "loss": 0.5675,
1953
+ "step": 2640
1954
+ },
1955
+ {
1956
+ "epoch": 0.6178596409419445,
1957
+ "grad_norm": 16.282094955444336,
1958
+ "learning_rate": 4.382140359058056e-05,
1959
+ "loss": 0.3591,
1960
+ "step": 2650
1961
+ },
1962
+ {
1963
+ "epoch": 0.6201911867568197,
1964
+ "grad_norm": 17.249792098999023,
1965
+ "learning_rate": 4.37980881324318e-05,
1966
+ "loss": 0.4584,
1967
+ "step": 2660
1968
+ },
1969
+ {
1970
+ "epoch": 0.622522732571695,
1971
+ "grad_norm": 21.42504119873047,
1972
+ "learning_rate": 4.3774772674283054e-05,
1973
+ "loss": 0.4607,
1974
+ "step": 2670
1975
+ },
1976
+ {
1977
+ "epoch": 0.6248542783865703,
1978
+ "grad_norm": 30.91826820373535,
1979
+ "learning_rate": 4.37514572161343e-05,
1980
+ "loss": 0.6725,
1981
+ "step": 2680
1982
+ },
1983
+ {
1984
+ "epoch": 0.6271858242014455,
1985
+ "grad_norm": 20.925262451171875,
1986
+ "learning_rate": 4.3728141757985544e-05,
1987
+ "loss": 0.4768,
1988
+ "step": 2690
1989
+ },
1990
+ {
1991
+ "epoch": 0.6295173700163208,
1992
+ "grad_norm": 25.807174682617188,
1993
+ "learning_rate": 4.3704826299836795e-05,
1994
+ "loss": 0.4127,
1995
+ "step": 2700
1996
+ },
1997
+ {
1998
+ "epoch": 0.6295173700163208,
1999
+ "eval_accuracy": 0.7678424938474159,
2000
+ "eval_f1": 0.7584708782486864,
2001
+ "eval_loss": 0.6823632121086121,
2002
+ "eval_precision": 0.7601462178390429,
2003
+ "eval_recall": 0.7648942677055709,
2004
+ "eval_runtime": 32.4267,
2005
+ "eval_samples_per_second": 37.592,
2006
+ "eval_steps_per_second": 2.375,
2007
+ "step": 2700
2008
+ },
2009
+ {
2010
+ "epoch": 0.6318489158311961,
2011
+ "grad_norm": 20.336694717407227,
2012
+ "learning_rate": 4.368151084168804e-05,
2013
+ "loss": 0.4772,
2014
+ "step": 2710
2015
+ },
2016
+ {
2017
+ "epoch": 0.6341804616460713,
2018
+ "grad_norm": 15.894454956054688,
2019
+ "learning_rate": 4.365819538353929e-05,
2020
+ "loss": 0.5338,
2021
+ "step": 2720
2022
+ },
2023
+ {
2024
+ "epoch": 0.6365120074609466,
2025
+ "grad_norm": 45.088111877441406,
2026
+ "learning_rate": 4.3634879925390536e-05,
2027
+ "loss": 0.6168,
2028
+ "step": 2730
2029
+ },
2030
+ {
2031
+ "epoch": 0.6388435532758219,
2032
+ "grad_norm": 31.453920364379883,
2033
+ "learning_rate": 4.361156446724178e-05,
2034
+ "loss": 0.4662,
2035
+ "step": 2740
2036
+ },
2037
+ {
2038
+ "epoch": 0.6411750990906971,
2039
+ "grad_norm": 11.898534774780273,
2040
+ "learning_rate": 4.358824900909303e-05,
2041
+ "loss": 0.5345,
2042
+ "step": 2750
2043
+ },
2044
+ {
2045
+ "epoch": 0.6435066449055724,
2046
+ "grad_norm": 21.230201721191406,
2047
+ "learning_rate": 4.356493355094428e-05,
2048
+ "loss": 0.4006,
2049
+ "step": 2760
2050
+ },
2051
+ {
2052
+ "epoch": 0.6458381907204477,
2053
+ "grad_norm": 25.514484405517578,
2054
+ "learning_rate": 4.354161809279553e-05,
2055
+ "loss": 0.5164,
2056
+ "step": 2770
2057
+ },
2058
+ {
2059
+ "epoch": 0.648169736535323,
2060
+ "grad_norm": 20.121109008789062,
2061
+ "learning_rate": 4.351830263464677e-05,
2062
+ "loss": 0.4885,
2063
+ "step": 2780
2064
+ },
2065
+ {
2066
+ "epoch": 0.6505012823501982,
2067
+ "grad_norm": 11.797569274902344,
2068
+ "learning_rate": 4.349498717649802e-05,
2069
+ "loss": 0.5272,
2070
+ "step": 2790
2071
+ },
2072
+ {
2073
+ "epoch": 0.6528328281650735,
2074
+ "grad_norm": 22.636089324951172,
2075
+ "learning_rate": 4.347167171834927e-05,
2076
+ "loss": 0.5199,
2077
+ "step": 2800
2078
+ },
2079
+ {
2080
+ "epoch": 0.6551643739799488,
2081
+ "grad_norm": 29.251462936401367,
2082
+ "learning_rate": 4.3448356260200514e-05,
2083
+ "loss": 0.3558,
2084
+ "step": 2810
2085
+ },
2086
+ {
2087
+ "epoch": 0.6574959197948239,
2088
+ "grad_norm": 14.990754127502441,
2089
+ "learning_rate": 4.3425040802051765e-05,
2090
+ "loss": 0.5055,
2091
+ "step": 2820
2092
+ },
2093
+ {
2094
+ "epoch": 0.6598274656096992,
2095
+ "grad_norm": 15.994630813598633,
2096
+ "learning_rate": 4.340172534390301e-05,
2097
+ "loss": 0.3577,
2098
+ "step": 2830
2099
+ },
2100
+ {
2101
+ "epoch": 0.6621590114245745,
2102
+ "grad_norm": 25.580074310302734,
2103
+ "learning_rate": 4.3378409885754255e-05,
2104
+ "loss": 0.464,
2105
+ "step": 2840
2106
+ },
2107
+ {
2108
+ "epoch": 0.6644905572394497,
2109
+ "grad_norm": 19.915939331054688,
2110
+ "learning_rate": 4.33550944276055e-05,
2111
+ "loss": 0.3557,
2112
+ "step": 2850
2113
+ },
2114
+ {
2115
+ "epoch": 0.666822103054325,
2116
+ "grad_norm": 17.42690658569336,
2117
+ "learning_rate": 4.333177896945676e-05,
2118
+ "loss": 0.5423,
2119
+ "step": 2860
2120
+ },
2121
+ {
2122
+ "epoch": 0.6691536488692003,
2123
+ "grad_norm": 16.17222785949707,
2124
+ "learning_rate": 4.3308463511308e-05,
2125
+ "loss": 0.3552,
2126
+ "step": 2870
2127
+ },
2128
+ {
2129
+ "epoch": 0.6714851946840755,
2130
+ "grad_norm": 23.892414093017578,
2131
+ "learning_rate": 4.328514805315925e-05,
2132
+ "loss": 0.4097,
2133
+ "step": 2880
2134
+ },
2135
+ {
2136
+ "epoch": 0.6738167404989508,
2137
+ "grad_norm": 23.955047607421875,
2138
+ "learning_rate": 4.326183259501049e-05,
2139
+ "loss": 0.6225,
2140
+ "step": 2890
2141
+ },
2142
+ {
2143
+ "epoch": 0.6761482863138261,
2144
+ "grad_norm": 19.446603775024414,
2145
+ "learning_rate": 4.3238517136861736e-05,
2146
+ "loss": 0.5303,
2147
+ "step": 2900
2148
+ },
2149
+ {
2150
+ "epoch": 0.6784798321287013,
2151
+ "grad_norm": 15.906410217285156,
2152
+ "learning_rate": 4.321520167871299e-05,
2153
+ "loss": 0.4539,
2154
+ "step": 2910
2155
+ },
2156
+ {
2157
+ "epoch": 0.6808113779435766,
2158
+ "grad_norm": 30.294095993041992,
2159
+ "learning_rate": 4.319188622056424e-05,
2160
+ "loss": 0.6016,
2161
+ "step": 2920
2162
+ },
2163
+ {
2164
+ "epoch": 0.6831429237584519,
2165
+ "grad_norm": 22.50743865966797,
2166
+ "learning_rate": 4.3168570762415484e-05,
2167
+ "loss": 0.4718,
2168
+ "step": 2930
2169
+ },
2170
+ {
2171
+ "epoch": 0.6854744695733271,
2172
+ "grad_norm": 11.781279563903809,
2173
+ "learning_rate": 4.314525530426673e-05,
2174
+ "loss": 0.413,
2175
+ "step": 2940
2176
+ },
2177
+ {
2178
+ "epoch": 0.6878060153882024,
2179
+ "grad_norm": 10.89158821105957,
2180
+ "learning_rate": 4.3121939846117973e-05,
2181
+ "loss": 0.507,
2182
+ "step": 2950
2183
+ },
2184
+ {
2185
+ "epoch": 0.6901375612030777,
2186
+ "grad_norm": 13.030016899108887,
2187
+ "learning_rate": 4.3098624387969225e-05,
2188
+ "loss": 0.4475,
2189
+ "step": 2960
2190
+ },
2191
+ {
2192
+ "epoch": 0.692469107017953,
2193
+ "grad_norm": 15.248382568359375,
2194
+ "learning_rate": 4.3075308929820476e-05,
2195
+ "loss": 0.4741,
2196
+ "step": 2970
2197
+ },
2198
+ {
2199
+ "epoch": 0.6948006528328282,
2200
+ "grad_norm": 32.4050407409668,
2201
+ "learning_rate": 4.305199347167172e-05,
2202
+ "loss": 0.5675,
2203
+ "step": 2980
2204
+ },
2205
+ {
2206
+ "epoch": 0.6971321986477035,
2207
+ "grad_norm": 36.350406646728516,
2208
+ "learning_rate": 4.3028678013522966e-05,
2209
+ "loss": 0.584,
2210
+ "step": 2990
2211
+ },
2212
+ {
2213
+ "epoch": 0.6994637444625786,
2214
+ "grad_norm": 14.917610168457031,
2215
+ "learning_rate": 4.300536255537422e-05,
2216
+ "loss": 0.4201,
2217
+ "step": 3000
2218
+ },
2219
+ {
2220
+ "epoch": 0.6994637444625786,
2221
+ "eval_accuracy": 0.7768662838392125,
2222
+ "eval_f1": 0.7673956246919376,
2223
+ "eval_loss": 0.6402276158332825,
2224
+ "eval_precision": 0.7691001302569485,
2225
+ "eval_recall": 0.7679644214691466,
2226
+ "eval_runtime": 32.6299,
2227
+ "eval_samples_per_second": 37.358,
2228
+ "eval_steps_per_second": 2.36,
2229
+ "step": 3000
2230
+ },
2231
+ {
2232
+ "epoch": 0.7017952902774539,
2233
+ "grad_norm": 28.404804229736328,
2234
+ "learning_rate": 4.298204709722546e-05,
2235
+ "loss": 0.4424,
2236
+ "step": 3010
2237
+ },
2238
+ {
2239
+ "epoch": 0.7041268360923292,
2240
+ "grad_norm": 22.141082763671875,
2241
+ "learning_rate": 4.295873163907671e-05,
2242
+ "loss": 0.5042,
2243
+ "step": 3020
2244
+ },
2245
+ {
2246
+ "epoch": 0.7064583819072044,
2247
+ "grad_norm": 26.650156021118164,
2248
+ "learning_rate": 4.293541618092796e-05,
2249
+ "loss": 0.5509,
2250
+ "step": 3030
2251
+ },
2252
+ {
2253
+ "epoch": 0.7087899277220797,
2254
+ "grad_norm": 17.86048698425293,
2255
+ "learning_rate": 4.29121007227792e-05,
2256
+ "loss": 0.525,
2257
+ "step": 3040
2258
+ },
2259
+ {
2260
+ "epoch": 0.711121473536955,
2261
+ "grad_norm": 31.643362045288086,
2262
+ "learning_rate": 4.2888785264630454e-05,
2263
+ "loss": 0.4592,
2264
+ "step": 3050
2265
+ },
2266
+ {
2267
+ "epoch": 0.7134530193518303,
2268
+ "grad_norm": 25.388368606567383,
2269
+ "learning_rate": 4.28654698064817e-05,
2270
+ "loss": 0.6506,
2271
+ "step": 3060
2272
+ },
2273
+ {
2274
+ "epoch": 0.7157845651667055,
2275
+ "grad_norm": 20.75798225402832,
2276
+ "learning_rate": 4.2842154348332944e-05,
2277
+ "loss": 0.5776,
2278
+ "step": 3070
2279
+ },
2280
+ {
2281
+ "epoch": 0.7181161109815808,
2282
+ "grad_norm": 17.62347412109375,
2283
+ "learning_rate": 4.2818838890184195e-05,
2284
+ "loss": 0.497,
2285
+ "step": 3080
2286
+ },
2287
+ {
2288
+ "epoch": 0.7204476567964561,
2289
+ "grad_norm": 21.391613006591797,
2290
+ "learning_rate": 4.279552343203544e-05,
2291
+ "loss": 0.4536,
2292
+ "step": 3090
2293
+ },
2294
+ {
2295
+ "epoch": 0.7227792026113313,
2296
+ "grad_norm": 19.84242057800293,
2297
+ "learning_rate": 4.277220797388669e-05,
2298
+ "loss": 0.518,
2299
+ "step": 3100
2300
+ },
2301
+ {
2302
+ "epoch": 0.7251107484262066,
2303
+ "grad_norm": 25.691789627075195,
2304
+ "learning_rate": 4.2748892515737936e-05,
2305
+ "loss": 0.4864,
2306
+ "step": 3110
2307
+ },
2308
+ {
2309
+ "epoch": 0.7274422942410819,
2310
+ "grad_norm": 19.61354637145996,
2311
+ "learning_rate": 4.272557705758918e-05,
2312
+ "loss": 0.3578,
2313
+ "step": 3120
2314
+ },
2315
+ {
2316
+ "epoch": 0.7297738400559571,
2317
+ "grad_norm": 20.281843185424805,
2318
+ "learning_rate": 4.270226159944043e-05,
2319
+ "loss": 0.492,
2320
+ "step": 3130
2321
+ },
2322
+ {
2323
+ "epoch": 0.7321053858708324,
2324
+ "grad_norm": 19.12962532043457,
2325
+ "learning_rate": 4.267894614129168e-05,
2326
+ "loss": 0.4072,
2327
+ "step": 3140
2328
+ },
2329
+ {
2330
+ "epoch": 0.7344369316857077,
2331
+ "grad_norm": 22.840578079223633,
2332
+ "learning_rate": 4.265563068314293e-05,
2333
+ "loss": 0.5414,
2334
+ "step": 3150
2335
+ },
2336
+ {
2337
+ "epoch": 0.7367684775005829,
2338
+ "grad_norm": 30.5288028717041,
2339
+ "learning_rate": 4.263231522499417e-05,
2340
+ "loss": 0.518,
2341
+ "step": 3160
2342
+ },
2343
+ {
2344
+ "epoch": 0.7391000233154581,
2345
+ "grad_norm": 15.130803108215332,
2346
+ "learning_rate": 4.260899976684542e-05,
2347
+ "loss": 0.3736,
2348
+ "step": 3170
2349
+ },
2350
+ {
2351
+ "epoch": 0.7414315691303334,
2352
+ "grad_norm": 22.197586059570312,
2353
+ "learning_rate": 4.258568430869667e-05,
2354
+ "loss": 0.3704,
2355
+ "step": 3180
2356
+ },
2357
+ {
2358
+ "epoch": 0.7437631149452086,
2359
+ "grad_norm": 13.625364303588867,
2360
+ "learning_rate": 4.256236885054792e-05,
2361
+ "loss": 0.3927,
2362
+ "step": 3190
2363
+ },
2364
+ {
2365
+ "epoch": 0.7460946607600839,
2366
+ "grad_norm": 23.51502227783203,
2367
+ "learning_rate": 4.2539053392399165e-05,
2368
+ "loss": 0.4915,
2369
+ "step": 3200
2370
+ },
2371
+ {
2372
+ "epoch": 0.7484262065749592,
2373
+ "grad_norm": 19.06190299987793,
2374
+ "learning_rate": 4.251573793425041e-05,
2375
+ "loss": 0.5324,
2376
+ "step": 3210
2377
+ },
2378
+ {
2379
+ "epoch": 0.7507577523898344,
2380
+ "grad_norm": 16.512483596801758,
2381
+ "learning_rate": 4.2492422476101655e-05,
2382
+ "loss": 0.5011,
2383
+ "step": 3220
2384
+ },
2385
+ {
2386
+ "epoch": 0.7530892982047097,
2387
+ "grad_norm": 12.160454750061035,
2388
+ "learning_rate": 4.24691070179529e-05,
2389
+ "loss": 0.5847,
2390
+ "step": 3230
2391
+ },
2392
+ {
2393
+ "epoch": 0.755420844019585,
2394
+ "grad_norm": 14.771639823913574,
2395
+ "learning_rate": 4.244579155980416e-05,
2396
+ "loss": 0.3473,
2397
+ "step": 3240
2398
+ },
2399
+ {
2400
+ "epoch": 0.7577523898344602,
2401
+ "grad_norm": 25.87384605407715,
2402
+ "learning_rate": 4.24224761016554e-05,
2403
+ "loss": 0.4409,
2404
+ "step": 3250
2405
+ },
2406
+ {
2407
+ "epoch": 0.7600839356493355,
2408
+ "grad_norm": 30.41501235961914,
2409
+ "learning_rate": 4.239916064350665e-05,
2410
+ "loss": 0.6514,
2411
+ "step": 3260
2412
+ },
2413
+ {
2414
+ "epoch": 0.7624154814642108,
2415
+ "grad_norm": 20.601119995117188,
2416
+ "learning_rate": 4.237584518535789e-05,
2417
+ "loss": 0.5139,
2418
+ "step": 3270
2419
+ },
2420
+ {
2421
+ "epoch": 0.7647470272790861,
2422
+ "grad_norm": 12.452898979187012,
2423
+ "learning_rate": 4.2352529727209136e-05,
2424
+ "loss": 0.395,
2425
+ "step": 3280
2426
+ },
2427
+ {
2428
+ "epoch": 0.7670785730939613,
2429
+ "grad_norm": 23.974411010742188,
2430
+ "learning_rate": 4.232921426906039e-05,
2431
+ "loss": 0.4344,
2432
+ "step": 3290
2433
+ },
2434
+ {
2435
+ "epoch": 0.7694101189088366,
2436
+ "grad_norm": 27.8565616607666,
2437
+ "learning_rate": 4.230589881091164e-05,
2438
+ "loss": 0.4636,
2439
+ "step": 3300
2440
+ },
2441
+ {
2442
+ "epoch": 0.7694101189088366,
2443
+ "eval_accuracy": 0.7727645611156686,
2444
+ "eval_f1": 0.7628742718759469,
2445
+ "eval_loss": 0.673406720161438,
2446
+ "eval_precision": 0.7584650322424751,
2447
+ "eval_recall": 0.7751981038943103,
2448
+ "eval_runtime": 32.4265,
2449
+ "eval_samples_per_second": 37.593,
2450
+ "eval_steps_per_second": 2.375,
2451
+ "step": 3300
2452
+ },
2453
+ {
2454
+ "epoch": 0.7717416647237119,
2455
+ "grad_norm": 31.938621520996094,
2456
+ "learning_rate": 4.2282583352762884e-05,
2457
+ "loss": 0.5178,
2458
+ "step": 3310
2459
+ },
2460
+ {
2461
+ "epoch": 0.7740732105385871,
2462
+ "grad_norm": 14.094200134277344,
2463
+ "learning_rate": 4.225926789461413e-05,
2464
+ "loss": 0.3979,
2465
+ "step": 3320
2466
+ },
2467
+ {
2468
+ "epoch": 0.7764047563534624,
2469
+ "grad_norm": 14.13912582397461,
2470
+ "learning_rate": 4.2235952436465373e-05,
2471
+ "loss": 0.4894,
2472
+ "step": 3330
2473
+ },
2474
+ {
2475
+ "epoch": 0.7787363021683376,
2476
+ "grad_norm": 16.00527572631836,
2477
+ "learning_rate": 4.2212636978316625e-05,
2478
+ "loss": 0.3421,
2479
+ "step": 3340
2480
+ },
2481
+ {
2482
+ "epoch": 0.7810678479832128,
2483
+ "grad_norm": 14.035831451416016,
2484
+ "learning_rate": 4.2189321520167876e-05,
2485
+ "loss": 0.4204,
2486
+ "step": 3350
2487
+ },
2488
+ {
2489
+ "epoch": 0.7833993937980881,
2490
+ "grad_norm": 17.89393424987793,
2491
+ "learning_rate": 4.216600606201912e-05,
2492
+ "loss": 0.3081,
2493
+ "step": 3360
2494
+ },
2495
+ {
2496
+ "epoch": 0.7857309396129634,
2497
+ "grad_norm": 19.49710464477539,
2498
+ "learning_rate": 4.2142690603870366e-05,
2499
+ "loss": 0.497,
2500
+ "step": 3370
2501
+ },
2502
+ {
2503
+ "epoch": 0.7880624854278386,
2504
+ "grad_norm": 32.836326599121094,
2505
+ "learning_rate": 4.211937514572162e-05,
2506
+ "loss": 0.5676,
2507
+ "step": 3380
2508
+ },
2509
+ {
2510
+ "epoch": 0.7903940312427139,
2511
+ "grad_norm": 21.465435028076172,
2512
+ "learning_rate": 4.209605968757286e-05,
2513
+ "loss": 0.583,
2514
+ "step": 3390
2515
+ },
2516
+ {
2517
+ "epoch": 0.7927255770575892,
2518
+ "grad_norm": 19.0760440826416,
2519
+ "learning_rate": 4.2072744229424113e-05,
2520
+ "loss": 0.4606,
2521
+ "step": 3400
2522
+ },
2523
+ {
2524
+ "epoch": 0.7950571228724644,
2525
+ "grad_norm": 34.77079772949219,
2526
+ "learning_rate": 4.204942877127536e-05,
2527
+ "loss": 0.4716,
2528
+ "step": 3410
2529
+ },
2530
+ {
2531
+ "epoch": 0.7973886686873397,
2532
+ "grad_norm": 12.543126106262207,
2533
+ "learning_rate": 4.20261133131266e-05,
2534
+ "loss": 0.391,
2535
+ "step": 3420
2536
+ },
2537
+ {
2538
+ "epoch": 0.799720214502215,
2539
+ "grad_norm": 15.688311576843262,
2540
+ "learning_rate": 4.2002797854977854e-05,
2541
+ "loss": 0.5113,
2542
+ "step": 3430
2543
+ },
2544
+ {
2545
+ "epoch": 0.8020517603170902,
2546
+ "grad_norm": 11.053609848022461,
2547
+ "learning_rate": 4.19794823968291e-05,
2548
+ "loss": 0.3462,
2549
+ "step": 3440
2550
+ },
2551
+ {
2552
+ "epoch": 0.8043833061319655,
2553
+ "grad_norm": 21.625019073486328,
2554
+ "learning_rate": 4.1956166938680344e-05,
2555
+ "loss": 0.5507,
2556
+ "step": 3450
2557
+ },
2558
+ {
2559
+ "epoch": 0.8067148519468408,
2560
+ "grad_norm": 15.765186309814453,
2561
+ "learning_rate": 4.1932851480531595e-05,
2562
+ "loss": 0.5008,
2563
+ "step": 3460
2564
+ },
2565
+ {
2566
+ "epoch": 0.809046397761716,
2567
+ "grad_norm": 32.54380416870117,
2568
+ "learning_rate": 4.190953602238284e-05,
2569
+ "loss": 0.6183,
2570
+ "step": 3470
2571
+ },
2572
+ {
2573
+ "epoch": 0.8113779435765913,
2574
+ "grad_norm": 19.001272201538086,
2575
+ "learning_rate": 4.188622056423409e-05,
2576
+ "loss": 0.5258,
2577
+ "step": 3480
2578
+ },
2579
+ {
2580
+ "epoch": 0.8137094893914666,
2581
+ "grad_norm": 43.268978118896484,
2582
+ "learning_rate": 4.1862905106085336e-05,
2583
+ "loss": 0.5148,
2584
+ "step": 3490
2585
+ },
2586
+ {
2587
+ "epoch": 0.8160410352063419,
2588
+ "grad_norm": 15.338736534118652,
2589
+ "learning_rate": 4.183958964793658e-05,
2590
+ "loss": 0.4623,
2591
+ "step": 3500
2592
+ },
2593
+ {
2594
+ "epoch": 0.818372581021217,
2595
+ "grad_norm": 21.353567123413086,
2596
+ "learning_rate": 4.181627418978783e-05,
2597
+ "loss": 0.4635,
2598
+ "step": 3510
2599
+ },
2600
+ {
2601
+ "epoch": 0.8207041268360923,
2602
+ "grad_norm": 133.6362762451172,
2603
+ "learning_rate": 4.1792958731639084e-05,
2604
+ "loss": 0.4413,
2605
+ "step": 3520
2606
+ },
2607
+ {
2608
+ "epoch": 0.8230356726509676,
2609
+ "grad_norm": 32.99754333496094,
2610
+ "learning_rate": 4.176964327349033e-05,
2611
+ "loss": 0.4504,
2612
+ "step": 3530
2613
+ },
2614
+ {
2615
+ "epoch": 0.8253672184658428,
2616
+ "grad_norm": 27.58423614501953,
2617
+ "learning_rate": 4.174632781534157e-05,
2618
+ "loss": 0.6231,
2619
+ "step": 3540
2620
+ },
2621
+ {
2622
+ "epoch": 0.8276987642807181,
2623
+ "grad_norm": 25.30926513671875,
2624
+ "learning_rate": 4.172301235719282e-05,
2625
+ "loss": 0.3987,
2626
+ "step": 3550
2627
+ },
2628
+ {
2629
+ "epoch": 0.8300303100955934,
2630
+ "grad_norm": 21.798927307128906,
2631
+ "learning_rate": 4.169969689904407e-05,
2632
+ "loss": 0.4207,
2633
+ "step": 3560
2634
+ },
2635
+ {
2636
+ "epoch": 0.8323618559104686,
2637
+ "grad_norm": 27.713125228881836,
2638
+ "learning_rate": 4.167638144089532e-05,
2639
+ "loss": 0.5021,
2640
+ "step": 3570
2641
+ },
2642
+ {
2643
+ "epoch": 0.8346934017253439,
2644
+ "grad_norm": 12.710470199584961,
2645
+ "learning_rate": 4.1653065982746565e-05,
2646
+ "loss": 0.303,
2647
+ "step": 3580
2648
+ },
2649
+ {
2650
+ "epoch": 0.8370249475402192,
2651
+ "grad_norm": 24.33064079284668,
2652
+ "learning_rate": 4.162975052459781e-05,
2653
+ "loss": 0.4564,
2654
+ "step": 3590
2655
+ },
2656
+ {
2657
+ "epoch": 0.8393564933550944,
2658
+ "grad_norm": 12.85043716430664,
2659
+ "learning_rate": 4.1606435066449055e-05,
2660
+ "loss": 0.4887,
2661
+ "step": 3600
2662
+ },
2663
+ {
2664
+ "epoch": 0.8393564933550944,
2665
+ "eval_accuracy": 0.7637407711238721,
2666
+ "eval_f1": 0.7492356256854388,
2667
+ "eval_loss": 0.6969403624534607,
2668
+ "eval_precision": 0.7486500525258384,
2669
+ "eval_recall": 0.7582037541347775,
2670
+ "eval_runtime": 32.6493,
2671
+ "eval_samples_per_second": 37.336,
2672
+ "eval_steps_per_second": 2.358,
2673
+ "step": 3600
2674
+ },
2675
+ {
2676
+ "epoch": 0.8416880391699697,
2677
+ "grad_norm": 16.10417366027832,
2678
+ "learning_rate": 4.15831196083003e-05,
2679
+ "loss": 0.4708,
2680
+ "step": 3610
2681
+ },
2682
+ {
2683
+ "epoch": 0.844019584984845,
2684
+ "grad_norm": 23.369497299194336,
2685
+ "learning_rate": 4.155980415015156e-05,
2686
+ "loss": 0.5608,
2687
+ "step": 3620
2688
+ },
2689
+ {
2690
+ "epoch": 0.8463511307997202,
2691
+ "grad_norm": 19.515378952026367,
2692
+ "learning_rate": 4.15364886920028e-05,
2693
+ "loss": 0.5755,
2694
+ "step": 3630
2695
+ },
2696
+ {
2697
+ "epoch": 0.8486826766145955,
2698
+ "grad_norm": 11.91996955871582,
2699
+ "learning_rate": 4.151317323385405e-05,
2700
+ "loss": 0.3869,
2701
+ "step": 3640
2702
+ },
2703
+ {
2704
+ "epoch": 0.8510142224294708,
2705
+ "grad_norm": 21.93692398071289,
2706
+ "learning_rate": 4.148985777570529e-05,
2707
+ "loss": 0.484,
2708
+ "step": 3650
2709
+ },
2710
+ {
2711
+ "epoch": 0.853345768244346,
2712
+ "grad_norm": 21.24445343017578,
2713
+ "learning_rate": 4.1466542317556536e-05,
2714
+ "loss": 0.3958,
2715
+ "step": 3660
2716
+ },
2717
+ {
2718
+ "epoch": 0.8556773140592213,
2719
+ "grad_norm": 16.571958541870117,
2720
+ "learning_rate": 4.144322685940779e-05,
2721
+ "loss": 0.331,
2722
+ "step": 3670
2723
+ },
2724
+ {
2725
+ "epoch": 0.8580088598740965,
2726
+ "grad_norm": 32.600013732910156,
2727
+ "learning_rate": 4.141991140125904e-05,
2728
+ "loss": 0.5633,
2729
+ "step": 3680
2730
+ },
2731
+ {
2732
+ "epoch": 0.8603404056889717,
2733
+ "grad_norm": 22.03318977355957,
2734
+ "learning_rate": 4.1396595943110284e-05,
2735
+ "loss": 0.4267,
2736
+ "step": 3690
2737
+ },
2738
+ {
2739
+ "epoch": 0.862671951503847,
2740
+ "grad_norm": 22.175247192382812,
2741
+ "learning_rate": 4.137328048496153e-05,
2742
+ "loss": 0.5786,
2743
+ "step": 3700
2744
+ },
2745
+ {
2746
+ "epoch": 0.8650034973187223,
2747
+ "grad_norm": 16.111539840698242,
2748
+ "learning_rate": 4.134996502681278e-05,
2749
+ "loss": 0.313,
2750
+ "step": 3710
2751
+ },
2752
+ {
2753
+ "epoch": 0.8673350431335975,
2754
+ "grad_norm": 23.84856414794922,
2755
+ "learning_rate": 4.1326649568664025e-05,
2756
+ "loss": 0.5621,
2757
+ "step": 3720
2758
+ },
2759
+ {
2760
+ "epoch": 0.8696665889484728,
2761
+ "grad_norm": 27.550527572631836,
2762
+ "learning_rate": 4.1303334110515276e-05,
2763
+ "loss": 0.3678,
2764
+ "step": 3730
2765
+ },
2766
+ {
2767
+ "epoch": 0.8719981347633481,
2768
+ "grad_norm": 17.500328063964844,
2769
+ "learning_rate": 4.128001865236652e-05,
2770
+ "loss": 0.4118,
2771
+ "step": 3740
2772
+ },
2773
+ {
2774
+ "epoch": 0.8743296805782234,
2775
+ "grad_norm": 20.387914657592773,
2776
+ "learning_rate": 4.1256703194217766e-05,
2777
+ "loss": 0.4329,
2778
+ "step": 3750
2779
+ },
2780
+ {
2781
+ "epoch": 0.8766612263930986,
2782
+ "grad_norm": 28.69219970703125,
2783
+ "learning_rate": 4.123338773606902e-05,
2784
+ "loss": 0.5973,
2785
+ "step": 3760
2786
+ },
2787
+ {
2788
+ "epoch": 0.8789927722079739,
2789
+ "grad_norm": 67.64371490478516,
2790
+ "learning_rate": 4.121007227792026e-05,
2791
+ "loss": 0.439,
2792
+ "step": 3770
2793
+ },
2794
+ {
2795
+ "epoch": 0.8813243180228492,
2796
+ "grad_norm": 11.542470932006836,
2797
+ "learning_rate": 4.1186756819771513e-05,
2798
+ "loss": 0.439,
2799
+ "step": 3780
2800
+ },
2801
+ {
2802
+ "epoch": 0.8836558638377244,
2803
+ "grad_norm": 28.455219268798828,
2804
+ "learning_rate": 4.116344136162276e-05,
2805
+ "loss": 0.5973,
2806
+ "step": 3790
2807
+ },
2808
+ {
2809
+ "epoch": 0.8859874096525997,
2810
+ "grad_norm": 24.25450325012207,
2811
+ "learning_rate": 4.1140125903474e-05,
2812
+ "loss": 0.5056,
2813
+ "step": 3800
2814
+ },
2815
+ {
2816
+ "epoch": 0.888318955467475,
2817
+ "grad_norm": 27.57263946533203,
2818
+ "learning_rate": 4.1116810445325254e-05,
2819
+ "loss": 0.5563,
2820
+ "step": 3810
2821
+ },
2822
+ {
2823
+ "epoch": 0.8906505012823502,
2824
+ "grad_norm": 32.943077087402344,
2825
+ "learning_rate": 4.10934949871765e-05,
2826
+ "loss": 0.5166,
2827
+ "step": 3820
2828
+ },
2829
+ {
2830
+ "epoch": 0.8929820470972255,
2831
+ "grad_norm": 25.220003128051758,
2832
+ "learning_rate": 4.1070179529027744e-05,
2833
+ "loss": 0.4761,
2834
+ "step": 3830
2835
+ },
2836
+ {
2837
+ "epoch": 0.8953135929121008,
2838
+ "grad_norm": 19.925155639648438,
2839
+ "learning_rate": 4.1046864070878995e-05,
2840
+ "loss": 0.3266,
2841
+ "step": 3840
2842
+ },
2843
+ {
2844
+ "epoch": 0.8976451387269759,
2845
+ "grad_norm": 39.80344009399414,
2846
+ "learning_rate": 4.102354861273025e-05,
2847
+ "loss": 0.5011,
2848
+ "step": 3850
2849
+ },
2850
+ {
2851
+ "epoch": 0.8999766845418512,
2852
+ "grad_norm": 23.42641830444336,
2853
+ "learning_rate": 4.100023315458149e-05,
2854
+ "loss": 0.5182,
2855
+ "step": 3860
2856
+ },
2857
+ {
2858
+ "epoch": 0.9023082303567265,
2859
+ "grad_norm": 18.273305892944336,
2860
+ "learning_rate": 4.0976917696432736e-05,
2861
+ "loss": 0.4711,
2862
+ "step": 3870
2863
+ },
2864
+ {
2865
+ "epoch": 0.9046397761716017,
2866
+ "grad_norm": 27.585613250732422,
2867
+ "learning_rate": 4.095360223828398e-05,
2868
+ "loss": 0.4976,
2869
+ "step": 3880
2870
+ },
2871
+ {
2872
+ "epoch": 0.906971321986477,
2873
+ "grad_norm": 10.163019180297852,
2874
+ "learning_rate": 4.093028678013523e-05,
2875
+ "loss": 0.3424,
2876
+ "step": 3890
2877
+ },
2878
+ {
2879
+ "epoch": 0.9093028678013523,
2880
+ "grad_norm": 18.85008430480957,
2881
+ "learning_rate": 4.0906971321986484e-05,
2882
+ "loss": 0.358,
2883
+ "step": 3900
2884
+ },
2885
+ {
2886
+ "epoch": 0.9093028678013523,
2887
+ "eval_accuracy": 0.7456931911402789,
2888
+ "eval_f1": 0.7407595301719996,
2889
+ "eval_loss": 0.776879072189331,
2890
+ "eval_precision": 0.7366901226312517,
2891
+ "eval_recall": 0.7566993445706643,
2892
+ "eval_runtime": 32.6742,
2893
+ "eval_samples_per_second": 37.308,
2894
+ "eval_steps_per_second": 2.357,
2895
+ "step": 3900
2896
+ },
2897
+ {
2898
+ "epoch": 0.9116344136162275,
2899
+ "grad_norm": 32.68353271484375,
2900
+ "learning_rate": 4.088365586383773e-05,
2901
+ "loss": 0.4426,
2902
+ "step": 3910
2903
+ },
2904
+ {
2905
+ "epoch": 0.9139659594311028,
2906
+ "grad_norm": 23.773094177246094,
2907
+ "learning_rate": 4.086034040568897e-05,
2908
+ "loss": 0.6041,
2909
+ "step": 3920
2910
+ },
2911
+ {
2912
+ "epoch": 0.9162975052459781,
2913
+ "grad_norm": 18.2379093170166,
2914
+ "learning_rate": 4.083702494754022e-05,
2915
+ "loss": 0.4279,
2916
+ "step": 3930
2917
+ },
2918
+ {
2919
+ "epoch": 0.9186290510608534,
2920
+ "grad_norm": 20.479825973510742,
2921
+ "learning_rate": 4.081370948939147e-05,
2922
+ "loss": 0.4433,
2923
+ "step": 3940
2924
+ },
2925
+ {
2926
+ "epoch": 0.9209605968757286,
2927
+ "grad_norm": 32.64277648925781,
2928
+ "learning_rate": 4.079039403124272e-05,
2929
+ "loss": 0.4704,
2930
+ "step": 3950
2931
+ },
2932
+ {
2933
+ "epoch": 0.9232921426906039,
2934
+ "grad_norm": 23.21099090576172,
2935
+ "learning_rate": 4.0767078573093965e-05,
2936
+ "loss": 0.4129,
2937
+ "step": 3960
2938
+ },
2939
+ {
2940
+ "epoch": 0.9256236885054792,
2941
+ "grad_norm": 15.052021026611328,
2942
+ "learning_rate": 4.074376311494521e-05,
2943
+ "loss": 0.4739,
2944
+ "step": 3970
2945
+ },
2946
+ {
2947
+ "epoch": 0.9279552343203544,
2948
+ "grad_norm": 14.582944869995117,
2949
+ "learning_rate": 4.0720447656796455e-05,
2950
+ "loss": 0.4743,
2951
+ "step": 3980
2952
+ },
2953
+ {
2954
+ "epoch": 0.9302867801352297,
2955
+ "grad_norm": 20.65665626525879,
2956
+ "learning_rate": 4.06971321986477e-05,
2957
+ "loss": 0.465,
2958
+ "step": 3990
2959
+ },
2960
+ {
2961
+ "epoch": 0.932618325950105,
2962
+ "grad_norm": 20.397233963012695,
2963
+ "learning_rate": 4.067381674049896e-05,
2964
+ "loss": 0.5524,
2965
+ "step": 4000
2966
+ },
2967
+ {
2968
+ "epoch": 0.9349498717649802,
2969
+ "grad_norm": 6.327408313751221,
2970
+ "learning_rate": 4.06505012823502e-05,
2971
+ "loss": 0.3442,
2972
+ "step": 4010
2973
+ },
2974
+ {
2975
+ "epoch": 0.9372814175798554,
2976
+ "grad_norm": 9.921250343322754,
2977
+ "learning_rate": 4.062718582420145e-05,
2978
+ "loss": 0.3566,
2979
+ "step": 4020
2980
+ },
2981
+ {
2982
+ "epoch": 0.9396129633947307,
2983
+ "grad_norm": 17.692302703857422,
2984
+ "learning_rate": 4.060387036605269e-05,
2985
+ "loss": 0.4596,
2986
+ "step": 4030
2987
+ },
2988
+ {
2989
+ "epoch": 0.9419445092096059,
2990
+ "grad_norm": 2.8422834873199463,
2991
+ "learning_rate": 4.058055490790394e-05,
2992
+ "loss": 0.4456,
2993
+ "step": 4040
2994
+ },
2995
+ {
2996
+ "epoch": 0.9442760550244812,
2997
+ "grad_norm": 16.632015228271484,
2998
+ "learning_rate": 4.055723944975519e-05,
2999
+ "loss": 0.517,
3000
+ "step": 4050
3001
+ },
3002
+ {
3003
+ "epoch": 0.9466076008393565,
3004
+ "grad_norm": 23.965824127197266,
3005
+ "learning_rate": 4.053392399160644e-05,
3006
+ "loss": 0.538,
3007
+ "step": 4060
3008
+ },
3009
+ {
3010
+ "epoch": 0.9489391466542317,
3011
+ "grad_norm": 26.93478775024414,
3012
+ "learning_rate": 4.0510608533457684e-05,
3013
+ "loss": 0.6331,
3014
+ "step": 4070
3015
+ },
3016
+ {
3017
+ "epoch": 0.951270692469107,
3018
+ "grad_norm": 24.248111724853516,
3019
+ "learning_rate": 4.048729307530893e-05,
3020
+ "loss": 0.4971,
3021
+ "step": 4080
3022
+ },
3023
+ {
3024
+ "epoch": 0.9536022382839823,
3025
+ "grad_norm": 19.178695678710938,
3026
+ "learning_rate": 4.046397761716018e-05,
3027
+ "loss": 0.4324,
3028
+ "step": 4090
3029
+ },
3030
+ {
3031
+ "epoch": 0.9559337840988575,
3032
+ "grad_norm": 19.033815383911133,
3033
+ "learning_rate": 4.0440662159011425e-05,
3034
+ "loss": 0.4867,
3035
+ "step": 4100
3036
+ },
3037
+ {
3038
+ "epoch": 0.9582653299137328,
3039
+ "grad_norm": 30.779146194458008,
3040
+ "learning_rate": 4.0417346700862676e-05,
3041
+ "loss": 0.5852,
3042
+ "step": 4110
3043
+ },
3044
+ {
3045
+ "epoch": 0.9605968757286081,
3046
+ "grad_norm": 15.432817459106445,
3047
+ "learning_rate": 4.039403124271392e-05,
3048
+ "loss": 0.5479,
3049
+ "step": 4120
3050
+ },
3051
+ {
3052
+ "epoch": 0.9629284215434833,
3053
+ "grad_norm": 20.558475494384766,
3054
+ "learning_rate": 4.0370715784565166e-05,
3055
+ "loss": 0.4594,
3056
+ "step": 4130
3057
+ },
3058
+ {
3059
+ "epoch": 0.9652599673583586,
3060
+ "grad_norm": 12.561017990112305,
3061
+ "learning_rate": 4.034740032641642e-05,
3062
+ "loss": 0.4238,
3063
+ "step": 4140
3064
+ },
3065
+ {
3066
+ "epoch": 0.9675915131732339,
3067
+ "grad_norm": 20.812999725341797,
3068
+ "learning_rate": 4.032408486826766e-05,
3069
+ "loss": 0.5912,
3070
+ "step": 4150
3071
+ },
3072
+ {
3073
+ "epoch": 0.9699230589881092,
3074
+ "grad_norm": 15.587718963623047,
3075
+ "learning_rate": 4.0300769410118914e-05,
3076
+ "loss": 0.3111,
3077
+ "step": 4160
3078
+ },
3079
+ {
3080
+ "epoch": 0.9722546048029844,
3081
+ "grad_norm": 21.68885612487793,
3082
+ "learning_rate": 4.027745395197016e-05,
3083
+ "loss": 0.4421,
3084
+ "step": 4170
3085
+ },
3086
+ {
3087
+ "epoch": 0.9745861506178597,
3088
+ "grad_norm": 8.09349536895752,
3089
+ "learning_rate": 4.02541384938214e-05,
3090
+ "loss": 0.4447,
3091
+ "step": 4180
3092
+ },
3093
+ {
3094
+ "epoch": 0.9769176964327349,
3095
+ "grad_norm": 23.542570114135742,
3096
+ "learning_rate": 4.0230823035672654e-05,
3097
+ "loss": 0.4601,
3098
+ "step": 4190
3099
+ },
3100
+ {
3101
+ "epoch": 0.9792492422476101,
3102
+ "grad_norm": 20.75370216369629,
3103
+ "learning_rate": 4.02075075775239e-05,
3104
+ "loss": 0.4899,
3105
+ "step": 4200
3106
+ },
3107
+ {
3108
+ "epoch": 0.9792492422476101,
3109
+ "eval_accuracy": 0.7809680065627563,
3110
+ "eval_f1": 0.7694587436976446,
3111
+ "eval_loss": 0.6500813961029053,
3112
+ "eval_precision": 0.7664779373382287,
3113
+ "eval_recall": 0.7765403302363741,
3114
+ "eval_runtime": 32.5513,
3115
+ "eval_samples_per_second": 37.449,
3116
+ "eval_steps_per_second": 2.365,
3117
+ "step": 4200
3118
+ }
3119
+ ],
3120
+ "logging_steps": 10,
3121
+ "max_steps": 21445,
3122
+ "num_input_tokens_seen": 0,
3123
+ "num_train_epochs": 5,
3124
+ "save_steps": 600,
3125
+ "total_flos": 1.439676695052288e+17,
3126
+ "train_batch_size": 16,
3127
+ "trial_name": null,
3128
+ "trial_params": null
3129
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2599f10a254425a3a71ed84cbc6a627b9d17b2d427d679e7a86ca66a962ec3e0
3
+ size 4920
vocab.json ADDED
The diff for this file is too large to render. See raw diff