Hugging Face's logo

agentlans
/
GIST-small-c4-en-nvidia_domain

Text Classification
Safetensors
English
bert
sequence-classification
Eval Results (legacy)
Model card Files
xet
 Community
agentlans commited on
Commit
4cf2e49
·
verified ·
1 Parent(s): 63f1ef1

Upload 14 files

Browse files
Files changed (14) hide show
  1. README.md +688 -0
  2. all_results.json +15 -0
  3. config.json +82 -0
  4. eval_results.json +9 -0
  5. model.safetensors +3 -0
  6. predict_results.txt +0 -0
  7. report.md +39 -0
  8. special_tokens_map.json +37 -0
  9. tokenizer.json +0 -0
  10. tokenizer_config.json +58 -0
  11. train_results.json +9 -0
  12. trainer_state.json +3745 -0
  13. training_args.bin +3 -0
  14. vocab.txt +0 -0
README.md ADDED
@@ -0,0 +1,688 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: mit
4
+ base_model:
5
+ - avsolatorio/GIST-small-Embedding-v0
6
+ datasets:
7
+ - agentlans/en-document-classification
8
+ tags:
9
+ - bert
10
+ - text-classification
11
+ - sequence-classification
12
+ metrics:
13
+ - f1
14
+ - loss
15
+ model-index:
16
+ - name: GIST-small-c4-en-nvidia_domain
17
+ results:
18
+ - task:
19
+ type: text-classification
20
+ name: Text Classification
21
+ metrics:
22
+ - type: f1
23
+ value: 0.8484
24
+ name: Evaluation F1
25
+ - type: loss
26
+ value: 0.6198
27
+ name: Evaluation Loss
28
+ ---
29
+ # GIST-small-c4-en-nvidia_domain
30
+
31
+ A fine-tuned version of the **bert** architecture (`BertForSequenceClassification`) optimized for the `text-classification` task.
32
+
33
+ - **Model type:** bert
34
+ - **Problem Type:** single_label_classification
35
+ - **Number of Labels:** 26
36
+ - **Vocabulary Size:** 30522
37
+ - **License:** MIT
38
+
39
+ ## Use
40
+
41
+ To get started with this model in Python using the Hugging Face Transformers library, run the following code:
42
+
43
+ ```python
44
+ from transformers import AutoTokenizer, AutoModelForSequenceClassification
45
+ import torch
46
+
47
+ model_id = "agentlans/GIST-small-c4-en-nvidia_domain"
48
+ tokenizer = AutoTokenizer.from_pretrained(model_id)
49
+ model = AutoModelForSequenceClassification.from_pretrained(model_id)
50
+
51
+ text = "Replace this with your input text."
52
+ inputs = tokenizer(text, return_tensors="pt")
53
+
54
+ with torch.no_grad():
55
+ logits = model(**inputs).logits
56
+
57
+ predicted_class_id = logits.argmax().item()
58
+ predicted_class_name = model.config.id2label[predicted_class_id]
59
+
60
+ print(f"Predicted Class ID: {predicted_class_id}")
61
+ print(f"Predicted Class Name: {predicted_class_name}")
62
+ ```
63
+
64
+ ## Intended Uses & Limitations
65
+
66
+ ### Intended Use
67
+ This model is designed for sequence classification tasks. Below are the specific class labels mapped to their corresponding IDs:
68
+
69
+ | Label ID | Label Name |
70
+ |---|---|
71
+ | 0 | Adult |
72
+ | 1 | Arts_and_Entertainment |
73
+ | 2 | Autos_and_Vehicles |
74
+ | 3 | Beauty_and_Fitness |
75
+ | 4 | Books_and_Literature |
76
+ | 5 | Business_and_Industrial |
77
+ | 6 | Computers_and_Electronics |
78
+ | 7 | Finance |
79
+ | 8 | Food_and_Drink |
80
+ | 9 | Games |
81
+ | 10 | Health |
82
+ | 11 | Hobbies_and_Leisure |
83
+ | 12 | Home_and_Garden |
84
+ | 13 | Internet_and_Telecom |
85
+ | 14 | Jobs_and_Education |
86
+ | 15 | Law_and_Government |
87
+ | 16 | News |
88
+ | 17 | Online_Communities |
89
+ | 18 | People_and_Society |
90
+ | 19 | Pets_and_Animals |
91
+ | 20 | Real_Estate |
92
+ | 21 | Science |
93
+ | 22 | Sensitive_Subjects |
94
+ | 23 | Shopping |
95
+ | 24 | Sports |
96
+ | 25 | Travel_and_Transportation |
97
+
98
+ ## Training Details
99
+
100
+ ### Hyperparameters
101
+ The following hyperparameters were used during fine-tuning:
102
+ - **Learning Rate:** 5e-05
103
+ - **Train Batch Size:** 8
104
+ - **Eval Batch Size:** 8
105
+ - **Optimizer:** OptimizerNames.ADAMW_TORCH_FUSED
106
+ - **Number of Epochs:** 3.0
107
+ - **Mixed Precision:** BF16
108
+
109
+ <details>
110
+ <summary><b>Show Advanced Training Configuration</b></summary>
111
+
112
+ #### Optimization & Regularization
113
+ - **Gradient Accumulation Steps:** 1
114
+ - **Learning Rate Scheduler:** SchedulerType.LINEAR
115
+ - **Warmup Steps:** 0
116
+ - **Warmup Ratio:** None
117
+ - **Weight Decay:** 0.0
118
+ - **Max Gradient Norm:** 1.0
119
+
120
+ #### Hardware & Reproducibility
121
+ - **Number of GPUs:** 1
122
+ - **Seed:** 42
123
+
124
+ </details>
125
+
126
+ ## Training Results & Evaluation
127
+
128
+ During fine-tuning, the model achieved the following results on the evaluation set:
129
+
130
+ | Metric | Value |
131
+ |---|---|
132
+ | **Train Loss** | 0.4761 |
133
+ | **Validation Loss** | 0.6198 |
134
+ | **Validation F1 Score** | 0.8484 |
135
+ | **Total FLOPs** | 3.4625e+16 |
136
+
137
+ For performance on the test set, [click here](report.md).
138
+
139
+ ### Speed Performance
140
+ - **Training Runtime:** 4470.8117 seconds
141
+ - **Train Samples per Second:** 470.078
142
+ - **Evaluation Runtime:** 49.7622 seconds
143
+ - **Eval Samples per Second:** 1759.789
144
+
145
+
146
+ <details>
147
+ <summary><b>Show Detailed Training Logs</b></summary>
148
+
149
+ ### Training Logs History
150
+
151
+ | Step | Epoch | Learning Rate | Training Loss | Validation Loss | Validation F1 |
152
+ |---|---|---|---|---|---|
153
+ | 500 | 0.006 | 4.9905e-05 | 2.4364 | N/A | N/A |
154
+ | 1000 | 0.011 | 4.9810e-05 | 1.5824 | N/A | N/A |
155
+ | 1500 | 0.017 | 4.9715e-05 | 1.2188 | N/A | N/A |
156
+ | 2000 | 0.023 | 4.9620e-05 | 1.0205 | N/A | N/A |
157
+ | 2500 | 0.029 | 4.9524e-05 | 0.9426 | N/A | N/A |
158
+ | 3000 | 0.034 | 4.9429e-05 | 0.9035 | N/A | N/A |
159
+ | 3500 | 0.04 | 4.9334e-05 | 0.8823 | N/A | N/A |
160
+ | 4000 | 0.046 | 4.9239e-05 | 0.854 | N/A | N/A |
161
+ | 4500 | 0.051 | 4.9144e-05 | 0.8577 | N/A | N/A |
162
+ | 5000 | 0.057 | 4.9049e-05 | 0.8022 | N/A | N/A |
163
+ | 5500 | 0.063 | 4.8953e-05 | 0.7564 | N/A | N/A |
164
+ | 6000 | 0.069 | 4.8858e-05 | 0.7987 | N/A | N/A |
165
+ | 6500 | 0.074 | 4.8763e-05 | 0.7842 | N/A | N/A |
166
+ | 7000 | 0.08 | 4.8668e-05 | 0.7837 | N/A | N/A |
167
+ | 7500 | 0.086 | 4.8573e-05 | 0.7572 | N/A | N/A |
168
+ | 8000 | 0.091 | 4.8478e-05 | 0.721 | N/A | N/A |
169
+ | 8500 | 0.097 | 4.8382e-05 | 0.7639 | N/A | N/A |
170
+ | 9000 | 0.103 | 4.8287e-05 | 0.7158 | N/A | N/A |
171
+ | 9500 | 0.108 | 4.8192e-05 | 0.7181 | N/A | N/A |
172
+ | 10000 | 0.114 | 4.8097e-05 | 0.7234 | N/A | N/A |
173
+ | 10500 | 0.12 | 4.8002e-05 | 0.7504 | N/A | N/A |
174
+ | 11000 | 0.126 | 4.7907e-05 | 0.7369 | N/A | N/A |
175
+ | 11500 | 0.131 | 4.7811e-05 | 0.7067 | N/A | N/A |
176
+ | 12000 | 0.137 | 4.7716e-05 | 0.7444 | N/A | N/A |
177
+ | 12500 | 0.143 | 4.7621e-05 | 0.6473 | N/A | N/A |
178
+ | 13000 | 0.148 | 4.7526e-05 | 0.7407 | N/A | N/A |
179
+ | 13500 | 0.154 | 4.7431e-05 | 0.7154 | N/A | N/A |
180
+ | 14000 | 0.16 | 4.7336e-05 | 0.6784 | N/A | N/A |
181
+ | 14500 | 0.166 | 4.7240e-05 | 0.6867 | N/A | N/A |
182
+ | 15000 | 0.171 | 4.7145e-05 | 0.7031 | N/A | N/A |
183
+ | 15500 | 0.177 | 4.7050e-05 | 0.6821 | N/A | N/A |
184
+ | 16000 | 0.183 | 4.6955e-05 | 0.6822 | N/A | N/A |
185
+ | 16500 | 0.188 | 4.6860e-05 | 0.6701 | N/A | N/A |
186
+ | 17000 | 0.194 | 4.6765e-05 | 0.667 | N/A | N/A |
187
+ | 17500 | 0.2 | 4.6669e-05 | 0.6661 | N/A | N/A |
188
+ | 18000 | 0.206 | 4.6574e-05 | 0.6789 | N/A | N/A |
189
+ | 18500 | 0.211 | 4.6479e-05 | 0.6661 | N/A | N/A |
190
+ | 19000 | 0.217 | 4.6384e-05 | 0.6652 | N/A | N/A |
191
+ | 19500 | 0.223 | 4.6289e-05 | 0.6578 | N/A | N/A |
192
+ | 20000 | 0.228 | 4.6194e-05 | 0.6619 | N/A | N/A |
193
+ | 20500 | 0.234 | 4.6098e-05 | 0.6756 | N/A | N/A |
194
+ | 21000 | 0.24 | 4.6003e-05 | 0.6505 | N/A | N/A |
195
+ | 21500 | 0.246 | 4.5908e-05 | 0.6596 | N/A | N/A |
196
+ | 22000 | 0.251 | 4.5813e-05 | 0.6932 | N/A | N/A |
197
+ | 22500 | 0.257 | 4.5718e-05 | 0.6411 | N/A | N/A |
198
+ | 23000 | 0.263 | 4.5623e-05 | 0.6682 | N/A | N/A |
199
+ | 23500 | 0.268 | 4.5527e-05 | 0.6404 | N/A | N/A |
200
+ | 24000 | 0.274 | 4.5432e-05 | 0.6982 | N/A | N/A |
201
+ | 24500 | 0.28 | 4.5337e-05 | 0.6987 | N/A | N/A |
202
+ | 25000 | 0.285 | 4.5242e-05 | 0.662 | N/A | N/A |
203
+ | 25500 | 0.291 | 4.5147e-05 | 0.646 | N/A | N/A |
204
+ | 26000 | 0.297 | 4.5052e-05 | 0.6449 | N/A | N/A |
205
+ | 26500 | 0.303 | 4.4956e-05 | 0.649 | N/A | N/A |
206
+ | 27000 | 0.308 | 4.4861e-05 | 0.6186 | N/A | N/A |
207
+ | 27500 | 0.314 | 4.4766e-05 | 0.6647 | N/A | N/A |
208
+ | 28000 | 0.32 | 4.4671e-05 | 0.629 | N/A | N/A |
209
+ | 28500 | 0.325 | 4.4576e-05 | 0.6494 | N/A | N/A |
210
+ | 29000 | 0.331 | 4.4481e-05 | 0.6634 | N/A | N/A |
211
+ | 29500 | 0.337 | 4.4386e-05 | 0.6355 | N/A | N/A |
212
+ | 30000 | 0.343 | 4.4290e-05 | 0.6396 | N/A | N/A |
213
+ | 30500 | 0.348 | 4.4195e-05 | 0.6298 | N/A | N/A |
214
+ | 31000 | 0.354 | 4.4100e-05 | 0.6511 | N/A | N/A |
215
+ | 31500 | 0.36 | 4.4005e-05 | 0.6584 | N/A | N/A |
216
+ | 32000 | 0.365 | 4.3910e-05 | 0.6333 | N/A | N/A |
217
+ | 32500 | 0.371 | 4.3815e-05 | 0.6386 | N/A | N/A |
218
+ | 33000 | 0.377 | 4.3719e-05 | 0.6214 | N/A | N/A |
219
+ | 33500 | 0.383 | 4.3624e-05 | 0.6369 | N/A | N/A |
220
+ | 34000 | 0.388 | 4.3529e-05 | 0.6079 | N/A | N/A |
221
+ | 34500 | 0.394 | 4.3434e-05 | 0.6216 | N/A | N/A |
222
+ | 35000 | 0.4 | 4.3339e-05 | 0.6337 | N/A | N/A |
223
+ | 35500 | 0.405 | 4.3244e-05 | 0.6448 | N/A | N/A |
224
+ | 36000 | 0.411 | 4.3148e-05 | 0.6016 | N/A | N/A |
225
+ | 36500 | 0.417 | 4.3053e-05 | 0.6222 | N/A | N/A |
226
+ | 37000 | 0.423 | 4.2958e-05 | 0.6441 | N/A | N/A |
227
+ | 37500 | 0.428 | 4.2863e-05 | 0.6217 | N/A | N/A |
228
+ | 38000 | 0.434 | 4.2768e-05 | 0.6147 | N/A | N/A |
229
+ | 38500 | 0.44 | 4.2673e-05 | 0.5851 | N/A | N/A |
230
+ | 39000 | 0.445 | 4.2577e-05 | 0.5924 | N/A | N/A |
231
+ | 39500 | 0.451 | 4.2482e-05 | 0.5917 | N/A | N/A |
232
+ | 40000 | 0.457 | 4.2387e-05 | 0.6073 | N/A | N/A |
233
+ | 40500 | 0.462 | 4.2292e-05 | 0.6634 | N/A | N/A |
234
+ | 41000 | 0.468 | 4.2197e-05 | 0.5875 | N/A | N/A |
235
+ | 41500 | 0.474 | 4.2102e-05 | 0.5966 | N/A | N/A |
236
+ | 42000 | 0.48 | 4.2006e-05 | 0.5889 | N/A | N/A |
237
+ | 42500 | 0.485 | 4.1911e-05 | 0.5983 | N/A | N/A |
238
+ | 43000 | 0.491 | 4.1816e-05 | 0.6497 | N/A | N/A |
239
+ | 43500 | 0.497 | 4.1721e-05 | 0.6242 | N/A | N/A |
240
+ | 44000 | 0.502 | 4.1626e-05 | 0.6023 | N/A | N/A |
241
+ | 44500 | 0.508 | 4.1531e-05 | 0.6103 | N/A | N/A |
242
+ | 45000 | 0.514 | 4.1435e-05 | 0.6323 | N/A | N/A |
243
+ | 45500 | 0.52 | 4.1340e-05 | 0.5973 | N/A | N/A |
244
+ | 46000 | 0.525 | 4.1245e-05 | 0.6047 | N/A | N/A |
245
+ | 46500 | 0.531 | 4.1150e-05 | 0.6199 | N/A | N/A |
246
+ | 47000 | 0.537 | 4.1055e-05 | 0.5927 | N/A | N/A |
247
+ | 47500 | 0.542 | 4.0960e-05 | 0.6302 | N/A | N/A |
248
+ | 48000 | 0.548 | 4.0864e-05 | 0.6211 | N/A | N/A |
249
+ | 48500 | 0.554 | 4.0769e-05 | 0.6093 | N/A | N/A |
250
+ | 49000 | 0.56 | 4.0674e-05 | 0.59 | N/A | N/A |
251
+ | 49500 | 0.565 | 4.0579e-05 | 0.6118 | N/A | N/A |
252
+ | 50000 | 0.571 | 4.0484e-05 | 0.5982 | N/A | N/A |
253
+ | 50500 | 0.577 | 4.0389e-05 | 0.5854 | N/A | N/A |
254
+ | 51000 | 0.582 | 4.0293e-05 | 0.6091 | N/A | N/A |
255
+ | 51500 | 0.588 | 4.0198e-05 | 0.5978 | N/A | N/A |
256
+ | 52000 | 0.594 | 4.0103e-05 | 0.5712 | N/A | N/A |
257
+ | 52500 | 0.6 | 4.0008e-05 | 0.5815 | N/A | N/A |
258
+ | 53000 | 0.605 | 3.9913e-05 | 0.5889 | N/A | N/A |
259
+ | 53500 | 0.611 | 3.9818e-05 | 0.621 | N/A | N/A |
260
+ | 54000 | 0.617 | 3.9722e-05 | 0.6087 | N/A | N/A |
261
+ | 54500 | 0.622 | 3.9627e-05 | 0.6174 | N/A | N/A |
262
+ | 55000 | 0.628 | 3.9532e-05 | 0.6257 | N/A | N/A |
263
+ | 55500 | 0.634 | 3.9437e-05 | 0.6057 | N/A | N/A |
264
+ | 56000 | 0.64 | 3.9342e-05 | 0.6155 | N/A | N/A |
265
+ | 56500 | 0.645 | 3.9247e-05 | 0.59 | N/A | N/A |
266
+ | 57000 | 0.651 | 3.9151e-05 | 0.5982 | N/A | N/A |
267
+ | 57500 | 0.657 | 3.9056e-05 | 0.5643 | N/A | N/A |
268
+ | 58000 | 0.662 | 3.8961e-05 | 0.5806 | N/A | N/A |
269
+ | 58500 | 0.668 | 3.8866e-05 | 0.6077 | N/A | N/A |
270
+ | 59000 | 0.674 | 3.8771e-05 | 0.5918 | N/A | N/A |
271
+ | 59500 | 0.679 | 3.8676e-05 | 0.5728 | N/A | N/A |
272
+ | 60000 | 0.685 | 3.8580e-05 | 0.5944 | N/A | N/A |
273
+ | 60500 | 0.691 | 3.8485e-05 | 0.6117 | N/A | N/A |
274
+ | 61000 | 0.697 | 3.8390e-05 | 0.6168 | N/A | N/A |
275
+ | 61500 | 0.702 | 3.8295e-05 | 0.5898 | N/A | N/A |
276
+ | 62000 | 0.708 | 3.8200e-05 | 0.593 | N/A | N/A |
277
+ | 62500 | 0.714 | 3.8105e-05 | 0.6043 | N/A | N/A |
278
+ | 63000 | 0.719 | 3.8010e-05 | 0.5845 | N/A | N/A |
279
+ | 63500 | 0.725 | 3.7914e-05 | 0.5844 | N/A | N/A |
280
+ | 64000 | 0.731 | 3.7819e-05 | 0.597 | N/A | N/A |
281
+ | 64500 | 0.737 | 3.7724e-05 | 0.5777 | N/A | N/A |
282
+ | 65000 | 0.742 | 3.7629e-05 | 0.6053 | N/A | N/A |
283
+ | 65500 | 0.748 | 3.7534e-05 | 0.5681 | N/A | N/A |
284
+ | 66000 | 0.754 | 3.7439e-05 | 0.5508 | N/A | N/A |
285
+ | 66500 | 0.759 | 3.7343e-05 | 0.6072 | N/A | N/A |
286
+ | 67000 | 0.765 | 3.7248e-05 | 0.5982 | N/A | N/A |
287
+ | 67500 | 0.771 | 3.7153e-05 | 0.5607 | N/A | N/A |
288
+ | 68000 | 0.777 | 3.7058e-05 | 0.5671 | N/A | N/A |
289
+ | 68500 | 0.782 | 3.6963e-05 | 0.5803 | N/A | N/A |
290
+ | 69000 | 0.788 | 3.6868e-05 | 0.5736 | N/A | N/A |
291
+ | 69500 | 0.794 | 3.6772e-05 | 0.5808 | N/A | N/A |
292
+ | 70000 | 0.799 | 3.6677e-05 | 0.602 | N/A | N/A |
293
+ | 70500 | 0.805 | 3.6582e-05 | 0.5485 | N/A | N/A |
294
+ | 71000 | 0.811 | 3.6487e-05 | 0.5601 | N/A | N/A |
295
+ | 71500 | 0.817 | 3.6392e-05 | 0.5605 | N/A | N/A |
296
+ | 72000 | 0.822 | 3.6297e-05 | 0.5832 | N/A | N/A |
297
+ | 72500 | 0.828 | 3.6201e-05 | 0.5888 | N/A | N/A |
298
+ | 73000 | 0.834 | 3.6106e-05 | 0.5582 | N/A | N/A |
299
+ | 73500 | 0.839 | 3.6011e-05 | 0.556 | N/A | N/A |
300
+ | 74000 | 0.845 | 3.5916e-05 | 0.5677 | N/A | N/A |
301
+ | 74500 | 0.851 | 3.5821e-05 | 0.5367 | N/A | N/A |
302
+ | 75000 | 0.856 | 3.5726e-05 | 0.6036 | N/A | N/A |
303
+ | 75500 | 0.862 | 3.5630e-05 | 0.55 | N/A | N/A |
304
+ | 76000 | 0.868 | 3.5535e-05 | 0.5973 | N/A | N/A |
305
+ | 76500 | 0.874 | 3.5440e-05 | 0.5771 | N/A | N/A |
306
+ | 77000 | 0.879 | 3.5345e-05 | 0.584 | N/A | N/A |
307
+ | 77500 | 0.885 | 3.5250e-05 | 0.5859 | N/A | N/A |
308
+ | 78000 | 0.891 | 3.5155e-05 | 0.5655 | N/A | N/A |
309
+ | 78500 | 0.896 | 3.5059e-05 | 0.5797 | N/A | N/A |
310
+ | 79000 | 0.902 | 3.4964e-05 | 0.5833 | N/A | N/A |
311
+ | 79500 | 0.908 | 3.4869e-05 | 0.6077 | N/A | N/A |
312
+ | 80000 | 0.914 | 3.4774e-05 | 0.5375 | N/A | N/A |
313
+ | 80500 | 0.919 | 3.4679e-05 | 0.59 | N/A | N/A |
314
+ | 81000 | 0.925 | 3.4584e-05 | 0.5788 | N/A | N/A |
315
+ | 81500 | 0.931 | 3.4488e-05 | 0.5627 | N/A | N/A |
316
+ | 82000 | 0.936 | 3.4393e-05 | 0.5482 | N/A | N/A |
317
+ | 82500 | 0.942 | 3.4298e-05 | 0.563 | N/A | N/A |
318
+ | 83000 | 0.948 | 3.4203e-05 | 0.5716 | N/A | N/A |
319
+ | 83500 | 0.954 | 3.4108e-05 | 0.5387 | N/A | N/A |
320
+ | 84000 | 0.959 | 3.4013e-05 | 0.5594 | N/A | N/A |
321
+ | 84500 | 0.965 | 3.3917e-05 | 0.5851 | N/A | N/A |
322
+ | 85000 | 0.971 | 3.3822e-05 | 0.5679 | N/A | N/A |
323
+ | 85500 | 0.976 | 3.3727e-05 | 0.558 | N/A | N/A |
324
+ | 86000 | 0.982 | 3.3632e-05 | 0.5623 | N/A | N/A |
325
+ | 86500 | 0.988 | 3.3537e-05 | 0.5722 | N/A | N/A |
326
+ | 87000 | 0.994 | 3.3442e-05 | 0.5448 | N/A | N/A |
327
+ | 87500 | 0.999 | 3.3346e-05 | 0.5505 | N/A | N/A |
328
+ | 87568 | 1.0 | N/A | N/A | 0.5459 | 0.8281 |
329
+ | 88000 | 1.005 | 3.3251e-05 | 0.4624 | N/A | N/A |
330
+ | 88500 | 1.011 | 3.3156e-05 | 0.4202 | N/A | N/A |
331
+ | 89000 | 1.016 | 3.3061e-05 | 0.4523 | N/A | N/A |
332
+ | 89500 | 1.022 | 3.2966e-05 | 0.4476 | N/A | N/A |
333
+ | 90000 | 1.028 | 3.2871e-05 | 0.4306 | N/A | N/A |
334
+ | 90500 | 1.033 | 3.2775e-05 | 0.4403 | N/A | N/A |
335
+ | 91000 | 1.039 | 3.2680e-05 | 0.4608 | N/A | N/A |
336
+ | 91500 | 1.045 | 3.2585e-05 | 0.4822 | N/A | N/A |
337
+ | 92000 | 1.051 | 3.2490e-05 | 0.4565 | N/A | N/A |
338
+ | 92500 | 1.056 | 3.2395e-05 | 0.4392 | N/A | N/A |
339
+ | 93000 | 1.062 | 3.2300e-05 | 0.4473 | N/A | N/A |
340
+ | 93500 | 1.068 | 3.2204e-05 | 0.4403 | N/A | N/A |
341
+ | 94000 | 1.073 | 3.2109e-05 | 0.4815 | N/A | N/A |
342
+ | 94500 | 1.079 | 3.2014e-05 | 0.4299 | N/A | N/A |
343
+ | 95000 | 1.085 | 3.1919e-05 | 0.4421 | N/A | N/A |
344
+ | 95500 | 1.091 | 3.1824e-05 | 0.463 | N/A | N/A |
345
+ | 96000 | 1.096 | 3.1729e-05 | 0.4827 | N/A | N/A |
346
+ | 96500 | 1.102 | 3.1634e-05 | 0.4611 | N/A | N/A |
347
+ | 97000 | 1.108 | 3.1538e-05 | 0.4579 | N/A | N/A |
348
+ | 97500 | 1.113 | 3.1443e-05 | 0.4545 | N/A | N/A |
349
+ | 98000 | 1.119 | 3.1348e-05 | 0.4741 | N/A | N/A |
350
+ | 98500 | 1.125 | 3.1253e-05 | 0.4702 | N/A | N/A |
351
+ | 99000 | 1.131 | 3.1158e-05 | 0.4614 | N/A | N/A |
352
+ | 99500 | 1.136 | 3.1063e-05 | 0.4795 | N/A | N/A |
353
+ | 100000 | 1.142 | 3.0967e-05 | 0.4482 | N/A | N/A |
354
+ | 100500 | 1.148 | 3.0872e-05 | 0.4814 | N/A | N/A |
355
+ | 101000 | 1.153 | 3.0777e-05 | 0.4642 | N/A | N/A |
356
+ | 101500 | 1.159 | 3.0682e-05 | 0.4547 | N/A | N/A |
357
+ | 102000 | 1.165 | 3.0587e-05 | 0.4496 | N/A | N/A |
358
+ | 102500 | 1.171 | 3.0492e-05 | 0.4351 | N/A | N/A |
359
+ | 103000 | 1.176 | 3.0396e-05 | 0.4885 | N/A | N/A |
360
+ | 103500 | 1.182 | 3.0301e-05 | 0.4625 | N/A | N/A |
361
+ | 104000 | 1.188 | 3.0206e-05 | 0.4796 | N/A | N/A |
362
+ | 104500 | 1.193 | 3.0111e-05 | 0.4318 | N/A | N/A |
363
+ | 105000 | 1.199 | 3.0016e-05 | 0.4556 | N/A | N/A |
364
+ | 105500 | 1.205 | 2.9921e-05 | 0.4501 | N/A | N/A |
365
+ | 106000 | 1.21 | 2.9825e-05 | 0.4698 | N/A | N/A |
366
+ | 106500 | 1.216 | 2.9730e-05 | 0.4357 | N/A | N/A |
367
+ | 107000 | 1.222 | 2.9635e-05 | 0.4397 | N/A | N/A |
368
+ | 107500 | 1.228 | 2.9540e-05 | 0.4894 | N/A | N/A |
369
+ | 108000 | 1.233 | 2.9445e-05 | 0.4787 | N/A | N/A |
370
+ | 108500 | 1.239 | 2.9350e-05 | 0.4073 | N/A | N/A |
371
+ | 109000 | 1.245 | 2.9254e-05 | 0.4622 | N/A | N/A |
372
+ | 109500 | 1.25 | 2.9159e-05 | 0.462 | N/A | N/A |
373
+ | 110000 | 1.256 | 2.9064e-05 | 0.4567 | N/A | N/A |
374
+ | 110500 | 1.262 | 2.8969e-05 | 0.4628 | N/A | N/A |
375
+ | 111000 | 1.268 | 2.8874e-05 | 0.4525 | N/A | N/A |
376
+ | 111500 | 1.273 | 2.8779e-05 | 0.459 | N/A | N/A |
377
+ | 112000 | 1.279 | 2.8683e-05 | 0.4393 | N/A | N/A |
378
+ | 112500 | 1.285 | 2.8588e-05 | 0.4483 | N/A | N/A |
379
+ | 113000 | 1.29 | 2.8493e-05 | 0.465 | N/A | N/A |
380
+ | 113500 | 1.296 | 2.8398e-05 | 0.5035 | N/A | N/A |
381
+ | 114000 | 1.302 | 2.8303e-05 | 0.476 | N/A | N/A |
382
+ | 114500 | 1.308 | 2.8208e-05 | 0.4349 | N/A | N/A |
383
+ | 115000 | 1.313 | 2.8112e-05 | 0.4476 | N/A | N/A |
384
+ | 115500 | 1.319 | 2.8017e-05 | 0.4816 | N/A | N/A |
385
+ | 116000 | 1.325 | 2.7922e-05 | 0.4669 | N/A | N/A |
386
+ | 116500 | 1.33 | 2.7827e-05 | 0.4729 | N/A | N/A |
387
+ | 117000 | 1.336 | 2.7732e-05 | 0.4629 | N/A | N/A |
388
+ | 117500 | 1.342 | 2.7637e-05 | 0.46 | N/A | N/A |
389
+ | 118000 | 1.348 | 2.7541e-05 | 0.4514 | N/A | N/A |
390
+ | 118500 | 1.353 | 2.7446e-05 | 0.4483 | N/A | N/A |
391
+ | 119000 | 1.359 | 2.7351e-05 | 0.4536 | N/A | N/A |
392
+ | 119500 | 1.365 | 2.7256e-05 | 0.4647 | N/A | N/A |
393
+ | 120000 | 1.37 | 2.7161e-05 | 0.4732 | N/A | N/A |
394
+ | 120500 | 1.376 | 2.7066e-05 | 0.4579 | N/A | N/A |
395
+ | 121000 | 1.382 | 2.6970e-05 | 0.4642 | N/A | N/A |
396
+ | 121500 | 1.387 | 2.6875e-05 | 0.4481 | N/A | N/A |
397
+ | 122000 | 1.393 | 2.6780e-05 | 0.4426 | N/A | N/A |
398
+ | 122500 | 1.399 | 2.6685e-05 | 0.4638 | N/A | N/A |
399
+ | 123000 | 1.405 | 2.6590e-05 | 0.4539 | N/A | N/A |
400
+ | 123500 | 1.41 | 2.6495e-05 | 0.4553 | N/A | N/A |
401
+ | 124000 | 1.416 | 2.6399e-05 | 0.4667 | N/A | N/A |
402
+ | 124500 | 1.422 | 2.6304e-05 | 0.4461 | N/A | N/A |
403
+ | 125000 | 1.427 | 2.6209e-05 | 0.4519 | N/A | N/A |
404
+ | 125500 | 1.433 | 2.6114e-05 | 0.443 | N/A | N/A |
405
+ | 126000 | 1.439 | 2.6019e-05 | 0.4452 | N/A | N/A |
406
+ | 126500 | 1.445 | 2.5924e-05 | 0.4667 | N/A | N/A |
407
+ | 127000 | 1.45 | 2.5828e-05 | 0.4623 | N/A | N/A |
408
+ | 127500 | 1.456 | 2.5733e-05 | 0.4579 | N/A | N/A |
409
+ | 128000 | 1.462 | 2.5638e-05 | 0.4329 | N/A | N/A |
410
+ | 128500 | 1.467 | 2.5543e-05 | 0.4527 | N/A | N/A |
411
+ | 129000 | 1.473 | 2.5448e-05 | 0.4481 | N/A | N/A |
412
+ | 129500 | 1.479 | 2.5353e-05 | 0.4289 | N/A | N/A |
413
+ | 130000 | 1.485 | 2.5258e-05 | 0.4765 | N/A | N/A |
414
+ | 130500 | 1.49 | 2.5162e-05 | 0.4484 | N/A | N/A |
415
+ | 131000 | 1.496 | 2.5067e-05 | 0.4509 | N/A | N/A |
416
+ | 131500 | 1.502 | 2.4972e-05 | 0.4442 | N/A | N/A |
417
+ | 132000 | 1.507 | 2.4877e-05 | 0.4247 | N/A | N/A |
418
+ | 132500 | 1.513 | 2.4782e-05 | 0.4599 | N/A | N/A |
419
+ | 133000 | 1.519 | 2.4687e-05 | 0.4656 | N/A | N/A |
420
+ | 133500 | 1.525 | 2.4591e-05 | 0.4513 | N/A | N/A |
421
+ | 134000 | 1.53 | 2.4496e-05 | 0.4563 | N/A | N/A |
422
+ | 134500 | 1.536 | 2.4401e-05 | 0.4577 | N/A | N/A |
423
+ | 135000 | 1.542 | 2.4306e-05 | 0.4566 | N/A | N/A |
424
+ | 135500 | 1.547 | 2.4211e-05 | 0.4265 | N/A | N/A |
425
+ | 136000 | 1.553 | 2.4116e-05 | 0.4513 | N/A | N/A |
426
+ | 136500 | 1.559 | 2.4020e-05 | 0.459 | N/A | N/A |
427
+ | 137000 | 1.564 | 2.3925e-05 | 0.453 | N/A | N/A |
428
+ | 137500 | 1.57 | 2.3830e-05 | 0.4705 | N/A | N/A |
429
+ | 138000 | 1.576 | 2.3735e-05 | 0.4651 | N/A | N/A |
430
+ | 138500 | 1.582 | 2.3640e-05 | 0.4488 | N/A | N/A |
431
+ | 139000 | 1.587 | 2.3545e-05 | 0.4701 | N/A | N/A |
432
+ | 139500 | 1.593 | 2.3449e-05 | 0.4726 | N/A | N/A |
433
+ | 140000 | 1.599 | 2.3354e-05 | 0.4262 | N/A | N/A |
434
+ | 140500 | 1.604 | 2.3259e-05 | 0.4632 | N/A | N/A |
435
+ | 141000 | 1.61 | 2.3164e-05 | 0.4321 | N/A | N/A |
436
+ | 141500 | 1.616 | 2.3069e-05 | 0.4637 | N/A | N/A |
437
+ | 142000 | 1.622 | 2.2974e-05 | 0.4313 | N/A | N/A |
438
+ | 142500 | 1.627 | 2.2878e-05 | 0.4651 | N/A | N/A |
439
+ | 143000 | 1.633 | 2.2783e-05 | 0.4544 | N/A | N/A |
440
+ | 143500 | 1.639 | 2.2688e-05 | 0.4618 | N/A | N/A |
441
+ | 144000 | 1.644 | 2.2593e-05 | 0.4382 | N/A | N/A |
442
+ | 144500 | 1.65 | 2.2498e-05 | 0.4521 | N/A | N/A |
443
+ | 145000 | 1.656 | 2.2403e-05 | 0.4295 | N/A | N/A |
444
+ | 145500 | 1.662 | 2.2307e-05 | 0.4273 | N/A | N/A |
445
+ | 146000 | 1.667 | 2.2212e-05 | 0.455 | N/A | N/A |
446
+ | 146500 | 1.673 | 2.2117e-05 | 0.4349 | N/A | N/A |
447
+ | 147000 | 1.679 | 2.2022e-05 | 0.458 | N/A | N/A |
448
+ | 147500 | 1.684 | 2.1927e-05 | 0.4447 | N/A | N/A |
449
+ | 148000 | 1.69 | 2.1832e-05 | 0.4437 | N/A | N/A |
450
+ | 148500 | 1.696 | 2.1736e-05 | 0.4451 | N/A | N/A |
451
+ | 149000 | 1.702 | 2.1641e-05 | 0.4268 | N/A | N/A |
452
+ | 149500 | 1.707 | 2.1546e-05 | 0.4401 | N/A | N/A |
453
+ | 150000 | 1.713 | 2.1451e-05 | 0.4555 | N/A | N/A |
454
+ | 150500 | 1.719 | 2.1356e-05 | 0.4474 | N/A | N/A |
455
+ | 151000 | 1.724 | 2.1261e-05 | 0.4426 | N/A | N/A |
456
+ | 151500 | 1.73 | 2.1165e-05 | 0.4349 | N/A | N/A |
457
+ | 152000 | 1.736 | 2.1070e-05 | 0.4141 | N/A | N/A |
458
+ | 152500 | 1.742 | 2.0975e-05 | 0.4486 | N/A | N/A |
459
+ | 153000 | 1.747 | 2.0880e-05 | 0.4401 | N/A | N/A |
460
+ | 153500 | 1.753 | 2.0785e-05 | 0.451 | N/A | N/A |
461
+ | 154000 | 1.759 | 2.0690e-05 | 0.4362 | N/A | N/A |
462
+ | 154500 | 1.764 | 2.0594e-05 | 0.4408 | N/A | N/A |
463
+ | 155000 | 1.77 | 2.0499e-05 | 0.443 | N/A | N/A |
464
+ | 155500 | 1.776 | 2.0404e-05 | 0.4492 | N/A | N/A |
465
+ | 156000 | 1.781 | 2.0309e-05 | 0.4769 | N/A | N/A |
466
+ | 156500 | 1.787 | 2.0214e-05 | 0.47 | N/A | N/A |
467
+ | 157000 | 1.793 | 2.0119e-05 | 0.4132 | N/A | N/A |
468
+ | 157500 | 1.799 | 2.0023e-05 | 0.4492 | N/A | N/A |
469
+ | 158000 | 1.804 | 1.9928e-05 | 0.4498 | N/A | N/A |
470
+ | 158500 | 1.81 | 1.9833e-05 | 0.4201 | N/A | N/A |
471
+ | 159000 | 1.816 | 1.9738e-05 | 0.4107 | N/A | N/A |
472
+ | 159500 | 1.821 | 1.9643e-05 | 0.4329 | N/A | N/A |
473
+ | 160000 | 1.827 | 1.9548e-05 | 0.4482 | N/A | N/A |
474
+ | 160500 | 1.833 | 1.9453e-05 | 0.4434 | N/A | N/A |
475
+ | 161000 | 1.839 | 1.9357e-05 | 0.4234 | N/A | N/A |
476
+ | 161500 | 1.844 | 1.9262e-05 | 0.4273 | N/A | N/A |
477
+ | 162000 | 1.85 | 1.9167e-05 | 0.429 | N/A | N/A |
478
+ | 162500 | 1.856 | 1.9072e-05 | 0.4321 | N/A | N/A |
479
+ | 163000 | 1.861 | 1.8977e-05 | 0.4512 | N/A | N/A |
480
+ | 163500 | 1.867 | 1.8882e-05 | 0.439 | N/A | N/A |
481
+ | 164000 | 1.873 | 1.8786e-05 | 0.4534 | N/A | N/A |
482
+ | 164500 | 1.879 | 1.8691e-05 | 0.4594 | N/A | N/A |
483
+ | 165000 | 1.884 | 1.8596e-05 | 0.4483 | N/A | N/A |
484
+ | 165500 | 1.89 | 1.8501e-05 | 0.4421 | N/A | N/A |
485
+ | 166000 | 1.896 | 1.8406e-05 | 0.4286 | N/A | N/A |
486
+ | 166500 | 1.901 | 1.8311e-05 | 0.4466 | N/A | N/A |
487
+ | 167000 | 1.907 | 1.8215e-05 | 0.4329 | N/A | N/A |
488
+ | 167500 | 1.913 | 1.8120e-05 | 0.4501 | N/A | N/A |
489
+ | 168000 | 1.919 | 1.8025e-05 | 0.4573 | N/A | N/A |
490
+ | 168500 | 1.924 | 1.7930e-05 | 0.4233 | N/A | N/A |
491
+ | 169000 | 1.93 | 1.7835e-05 | 0.4292 | N/A | N/A |
492
+ | 169500 | 1.936 | 1.7740e-05 | 0.4413 | N/A | N/A |
493
+ | 170000 | 1.941 | 1.7644e-05 | 0.4185 | N/A | N/A |
494
+ | 170500 | 1.947 | 1.7549e-05 | 0.4288 | N/A | N/A |
495
+ | 171000 | 1.953 | 1.7454e-05 | 0.4106 | N/A | N/A |
496
+ | 171500 | 1.958 | 1.7359e-05 | 0.452 | N/A | N/A |
497
+ | 172000 | 1.964 | 1.7264e-05 | 0.4359 | N/A | N/A |
498
+ | 172500 | 1.97 | 1.7169e-05 | 0.4287 | N/A | N/A |
499
+ | 173000 | 1.976 | 1.7073e-05 | 0.4117 | N/A | N/A |
500
+ | 173500 | 1.981 | 1.6978e-05 | 0.4508 | N/A | N/A |
501
+ | 174000 | 1.987 | 1.6883e-05 | 0.4319 | N/A | N/A |
502
+ | 174500 | 1.993 | 1.6788e-05 | 0.437 | N/A | N/A |
503
+ | 175000 | 1.998 | 1.6693e-05 | 0.4289 | N/A | N/A |
504
+ | 175136 | 2.0 | N/A | N/A | 0.5235 | 0.845 |
505
+ | 175500 | 2.004 | 1.6598e-05 | 0.3403 | N/A | N/A |
506
+ | 176000 | 2.01 | 1.6502e-05 | 0.3111 | N/A | N/A |
507
+ | 176500 | 2.016 | 1.6407e-05 | 0.3222 | N/A | N/A |
508
+ | 177000 | 2.021 | 1.6312e-05 | 0.3219 | N/A | N/A |
509
+ | 177500 | 2.027 | 1.6217e-05 | 0.3449 | N/A | N/A |
510
+ | 178000 | 2.033 | 1.6122e-05 | 0.3156 | N/A | N/A |
511
+ | 178500 | 2.038 | 1.6027e-05 | 0.3055 | N/A | N/A |
512
+ | 179000 | 2.044 | 1.5931e-05 | 0.3376 | N/A | N/A |
513
+ | 179500 | 2.05 | 1.5836e-05 | 0.3141 | N/A | N/A |
514
+ | 180000 | 2.056 | 1.5741e-05 | 0.3337 | N/A | N/A |
515
+ | 180500 | 2.061 | 1.5646e-05 | 0.3246 | N/A | N/A |
516
+ | 181000 | 2.067 | 1.5551e-05 | 0.3621 | N/A | N/A |
517
+ | 181500 | 2.073 | 1.5456e-05 | 0.375 | N/A | N/A |
518
+ | 182000 | 2.078 | 1.5360e-05 | 0.3388 | N/A | N/A |
519
+ | 182500 | 2.084 | 1.5265e-05 | 0.3011 | N/A | N/A |
520
+ | 183000 | 2.09 | 1.5170e-05 | 0.3196 | N/A | N/A |
521
+ | 183500 | 2.096 | 1.5075e-05 | 0.332 | N/A | N/A |
522
+ | 184000 | 2.101 | 1.4980e-05 | 0.3342 | N/A | N/A |
523
+ | 184500 | 2.107 | 1.4885e-05 | 0.3636 | N/A | N/A |
524
+ | 185000 | 2.113 | 1.4789e-05 | 0.3371 | N/A | N/A |
525
+ | 185500 | 2.118 | 1.4694e-05 | 0.3659 | N/A | N/A |
526
+ | 186000 | 2.124 | 1.4599e-05 | 0.3335 | N/A | N/A |
527
+ | 186500 | 2.13 | 1.4504e-05 | 0.3319 | N/A | N/A |
528
+ | 187000 | 2.135 | 1.4409e-05 | 0.3308 | N/A | N/A |
529
+ | 187500 | 2.141 | 1.4314e-05 | 0.3291 | N/A | N/A |
530
+ | 188000 | 2.147 | 1.4218e-05 | 0.3543 | N/A | N/A |
531
+ | 188500 | 2.153 | 1.4123e-05 | 0.3118 | N/A | N/A |
532
+ | 189000 | 2.158 | 1.4028e-05 | 0.3649 | N/A | N/A |
533
+ | 189500 | 2.164 | 1.3933e-05 | 0.3308 | N/A | N/A |
534
+ | 190000 | 2.17 | 1.3838e-05 | 0.3369 | N/A | N/A |
535
+ | 190500 | 2.175 | 1.3743e-05 | 0.3398 | N/A | N/A |
536
+ | 191000 | 2.181 | 1.3647e-05 | 0.3591 | N/A | N/A |
537
+ | 191500 | 2.187 | 1.3552e-05 | 0.3187 | N/A | N/A |
538
+ | 192000 | 2.193 | 1.3457e-05 | 0.3373 | N/A | N/A |
539
+ | 192500 | 2.198 | 1.3362e-05 | 0.329 | N/A | N/A |
540
+ | 193000 | 2.204 | 1.3267e-05 | 0.3152 | N/A | N/A |
541
+ | 193500 | 2.21 | 1.3172e-05 | 0.3276 | N/A | N/A |
542
+ | 194000 | 2.215 | 1.3077e-05 | 0.3251 | N/A | N/A |
543
+ | 194500 | 2.221 | 1.2981e-05 | 0.3334 | N/A | N/A |
544
+ | 195000 | 2.227 | 1.2886e-05 | 0.3466 | N/A | N/A |
545
+ | 195500 | 2.233 | 1.2791e-05 | 0.3636 | N/A | N/A |
546
+ | 196000 | 2.238 | 1.2696e-05 | 0.315 | N/A | N/A |
547
+ | 196500 | 2.244 | 1.2601e-05 | 0.3211 | N/A | N/A |
548
+ | 197000 | 2.25 | 1.2506e-05 | 0.3271 | N/A | N/A |
549
+ | 197500 | 2.255 | 1.2410e-05 | 0.3507 | N/A | N/A |
550
+ | 198000 | 2.261 | 1.2315e-05 | 0.3091 | N/A | N/A |
551
+ | 198500 | 2.267 | 1.2220e-05 | 0.3381 | N/A | N/A |
552
+ | 199000 | 2.273 | 1.2125e-05 | 0.343 | N/A | N/A |
553
+ | 199500 | 2.278 | 1.2030e-05 | 0.3212 | N/A | N/A |
554
+ | 200000 | 2.284 | 1.1935e-05 | 0.308 | N/A | N/A |
555
+ | 200500 | 2.29 | 1.1839e-05 | 0.3273 | N/A | N/A |
556
+ | 201000 | 2.295 | 1.1744e-05 | 0.3145 | N/A | N/A |
557
+ | 201500 | 2.301 | 1.1649e-05 | 0.3511 | N/A | N/A |
558
+ | 202000 | 2.307 | 1.1554e-05 | 0.3647 | N/A | N/A |
559
+ | 202500 | 2.312 | 1.1459e-05 | 0.3193 | N/A | N/A |
560
+ | 203000 | 2.318 | 1.1364e-05 | 0.3257 | N/A | N/A |
561
+ | 203500 | 2.324 | 1.1268e-05 | 0.3408 | N/A | N/A |
562
+ | 204000 | 2.33 | 1.1173e-05 | 0.3163 | N/A | N/A |
563
+ | 204500 | 2.335 | 1.1078e-05 | 0.3141 | N/A | N/A |
564
+ | 205000 | 2.341 | 1.0983e-05 | 0.3265 | N/A | N/A |
565
+ | 205500 | 2.347 | 1.0888e-05 | 0.336 | N/A | N/A |
566
+ | 206000 | 2.352 | 1.0793e-05 | 0.3444 | N/A | N/A |
567
+ | 206500 | 2.358 | 1.0697e-05 | 0.3227 | N/A | N/A |
568
+ | 207000 | 2.364 | 1.0602e-05 | 0.3474 | N/A | N/A |
569
+ | 207500 | 2.37 | 1.0507e-05 | 0.3201 | N/A | N/A |
570
+ | 208000 | 2.375 | 1.0412e-05 | 0.3106 | N/A | N/A |
571
+ | 208500 | 2.381 | 1.0317e-05 | 0.3295 | N/A | N/A |
572
+ | 209000 | 2.387 | 1.0222e-05 | 0.3172 | N/A | N/A |
573
+ | 209500 | 2.392 | 1.0126e-05 | 0.3504 | N/A | N/A |
574
+ | 210000 | 2.398 | 1.0031e-05 | 0.3355 | N/A | N/A |
575
+ | 210500 | 2.404 | 9.9361e-06 | 0.359 | N/A | N/A |
576
+ | 211000 | 2.41 | 9.8409e-06 | 0.3262 | N/A | N/A |
577
+ | 211500 | 2.415 | 9.7458e-06 | 0.3049 | N/A | N/A |
578
+ | 212000 | 2.421 | 9.6506e-06 | 0.3363 | N/A | N/A |
579
+ | 212500 | 2.427 | 9.5554e-06 | 0.3094 | N/A | N/A |
580
+ | 213000 | 2.432 | 9.4603e-06 | 0.3472 | N/A | N/A |
581
+ | 213500 | 2.438 | 9.3651e-06 | 0.3314 | N/A | N/A |
582
+ | 214000 | 2.444 | 9.2699e-06 | 0.3238 | N/A | N/A |
583
+ | 214500 | 2.45 | 9.1748e-06 | 0.3827 | N/A | N/A |
584
+ | 215000 | 2.455 | 9.0796e-06 | 0.3254 | N/A | N/A |
585
+ | 215500 | 2.461 | 8.9844e-06 | 0.3342 | N/A | N/A |
586
+ | 216000 | 2.467 | 8.8893e-06 | 0.298 | N/A | N/A |
587
+ | 216500 | 2.472 | 8.7941e-06 | 0.3479 | N/A | N/A |
588
+ | 217000 | 2.478 | 8.6990e-06 | 0.3515 | N/A | N/A |
589
+ | 217500 | 2.484 | 8.6038e-06 | 0.3459 | N/A | N/A |
590
+ | 218000 | 2.489 | 8.5086e-06 | 0.3516 | N/A | N/A |
591
+ | 218500 | 2.495 | 8.4135e-06 | 0.3372 | N/A | N/A |
592
+ | 219000 | 2.501 | 8.3183e-06 | 0.3329 | N/A | N/A |
593
+ | 219500 | 2.507 | 8.2231e-06 | 0.345 | N/A | N/A |
594
+ | 220000 | 2.512 | 8.1280e-06 | 0.3545 | N/A | N/A |
595
+ | 220500 | 2.518 | 8.0328e-06 | 0.3181 | N/A | N/A |
596
+ | 221000 | 2.524 | 7.9376e-06 | 0.3343 | N/A | N/A |
597
+ | 221500 | 2.529 | 7.8425e-06 | 0.3087 | N/A | N/A |
598
+ | 222000 | 2.535 | 7.7473e-06 | 0.3052 | N/A | N/A |
599
+ | 222500 | 2.541 | 7.6521e-06 | 0.3229 | N/A | N/A |
600
+ | 223000 | 2.547 | 7.5570e-06 | 0.3471 | N/A | N/A |
601
+ | 223500 | 2.552 | 7.4618e-06 | 0.3387 | N/A | N/A |
602
+ | 224000 | 2.558 | 7.3667e-06 | 0.3378 | N/A | N/A |
603
+ | 224500 | 2.564 | 7.2715e-06 | 0.3328 | N/A | N/A |
604
+ | 225000 | 2.569 | 7.1763e-06 | 0.3613 | N/A | N/A |
605
+ | 225500 | 2.575 | 7.0812e-06 | 0.3139 | N/A | N/A |
606
+ | 226000 | 2.581 | 6.9860e-06 | 0.3297 | N/A | N/A |
607
+ | 226500 | 2.587 | 6.8908e-06 | 0.3097 | N/A | N/A |
608
+ | 227000 | 2.592 | 6.7957e-06 | 0.3466 | N/A | N/A |
609
+ | 227500 | 2.598 | 6.7005e-06 | 0.3363 | N/A | N/A |
610
+ | 228000 | 2.604 | 6.6053e-06 | 0.2917 | N/A | N/A |
611
+ | 228500 | 2.609 | 6.5102e-06 | 0.3105 | N/A | N/A |
612
+ | 229000 | 2.615 | 6.4150e-06 | 0.3105 | N/A | N/A |
613
+ | 229500 | 2.621 | 6.3199e-06 | 0.3452 | N/A | N/A |
614
+ | 230000 | 2.627 | 6.2247e-06 | 0.3402 | N/A | N/A |
615
+ | 230500 | 2.632 | 6.1295e-06 | 0.3419 | N/A | N/A |
616
+ | 231000 | 2.638 | 6.0344e-06 | 0.3114 | N/A | N/A |
617
+ | 231500 | 2.644 | 5.9392e-06 | 0.3153 | N/A | N/A |
618
+ | 232000 | 2.649 | 5.8440e-06 | 0.323 | N/A | N/A |
619
+ | 232500 | 2.655 | 5.7489e-06 | 0.2695 | N/A | N/A |
620
+ | 233000 | 2.661 | 5.6537e-06 | 0.343 | N/A | N/A |
621
+ | 233500 | 2.666 | 5.5585e-06 | 0.3449 | N/A | N/A |
622
+ | 234000 | 2.672 | 5.4634e-06 | 0.3249 | N/A | N/A |
623
+ | 234500 | 2.678 | 5.3682e-06 | 0.3393 | N/A | N/A |
624
+ | 235000 | 2.684 | 5.2730e-06 | 0.3057 | N/A | N/A |
625
+ | 235500 | 2.689 | 5.1779e-06 | 0.3137 | N/A | N/A |
626
+ | 236000 | 2.695 | 5.0827e-06 | 0.3267 | N/A | N/A |
627
+ | 236500 | 2.701 | 4.9876e-06 | 0.3014 | N/A | N/A |
628
+ | 237000 | 2.706 | 4.8924e-06 | 0.3035 | N/A | N/A |
629
+ | 237500 | 2.712 | 4.7972e-06 | 0.3285 | N/A | N/A |
630
+ | 238000 | 2.718 | 4.7021e-06 | 0.3072 | N/A | N/A |
631
+ | 238500 | 2.724 | 4.6069e-06 | 0.3317 | N/A | N/A |
632
+ | 239000 | 2.729 | 4.5117e-06 | 0.3153 | N/A | N/A |
633
+ | 239500 | 2.735 | 4.4166e-06 | 0.3093 | N/A | N/A |
634
+ | 240000 | 2.741 | 4.3214e-06 | 0.2851 | N/A | N/A |
635
+ | 240500 | 2.746 | 4.2262e-06 | 0.3154 | N/A | N/A |
636
+ | 241000 | 2.752 | 4.1311e-06 | 0.3412 | N/A | N/A |
637
+ | 241500 | 2.758 | 4.0359e-06 | 0.3242 | N/A | N/A |
638
+ | 242000 | 2.764 | 3.9407e-06 | 0.334 | N/A | N/A |
639
+ | 242500 | 2.769 | 3.8456e-06 | 0.3336 | N/A | N/A |
640
+ | 243000 | 2.775 | 3.7504e-06 | 0.3078 | N/A | N/A |
641
+ | 243500 | 2.781 | 3.6553e-06 | 0.3137 | N/A | N/A |
642
+ | 244000 | 2.786 | 3.5601e-06 | 0.3484 | N/A | N/A |
643
+ | 244500 | 2.792 | 3.4649e-06 | 0.3124 | N/A | N/A |
644
+ | 245000 | 2.798 | 3.3698e-06 | 0.305 | N/A | N/A |
645
+ | 245500 | 2.804 | 3.2746e-06 | 0.3246 | N/A | N/A |
646
+ | 246000 | 2.809 | 3.1794e-06 | 0.3143 | N/A | N/A |
647
+ | 246500 | 2.815 | 3.0843e-06 | 0.3062 | N/A | N/A |
648
+ | 247000 | 2.821 | 2.9891e-06 | 0.2947 | N/A | N/A |
649
+ | 247500 | 2.826 | 2.8939e-06 | 0.3125 | N/A | N/A |
650
+ | 248000 | 2.832 | 2.7988e-06 | 0.3114 | N/A | N/A |
651
+ | 248500 | 2.838 | 2.7036e-06 | 0.3206 | N/A | N/A |
652
+ | 249000 | 2.844 | 2.6084e-06 | 0.315 | N/A | N/A |
653
+ | 249500 | 2.849 | 2.5133e-06 | 0.3122 | N/A | N/A |
654
+ | 250000 | 2.855 | 2.4181e-06 | 0.3231 | N/A | N/A |
655
+ | 250500 | 2.861 | 2.3230e-06 | 0.3311 | N/A | N/A |
656
+ | 251000 | 2.866 | 2.2278e-06 | 0.2668 | N/A | N/A |
657
+ | 251500 | 2.872 | 2.1326e-06 | 0.2951 | N/A | N/A |
658
+ | 252000 | 2.878 | 2.0375e-06 | 0.3317 | N/A | N/A |
659
+ | 252500 | 2.883 | 1.9423e-06 | 0.3445 | N/A | N/A |
660
+ | 253000 | 2.889 | 1.8471e-06 | 0.2826 | N/A | N/A |
661
+ | 253500 | 2.895 | 1.7520e-06 | 0.3266 | N/A | N/A |
662
+ | 254000 | 2.901 | 1.6568e-06 | 0.3143 | N/A | N/A |
663
+ | 254500 | 2.906 | 1.5616e-06 | 0.2956 | N/A | N/A |
664
+ | 255000 | 2.912 | 1.4665e-06 | 0.3339 | N/A | N/A |
665
+ | 255500 | 2.918 | 1.3713e-06 | 0.3233 | N/A | N/A |
666
+ | 256000 | 2.923 | 1.2762e-06 | 0.288 | N/A | N/A |
667
+ | 256500 | 2.929 | 1.1810e-06 | 0.3296 | N/A | N/A |
668
+ | 257000 | 2.935 | 1.0858e-06 | 0.3205 | N/A | N/A |
669
+ | 257500 | 2.941 | 9.9066e-07 | 0.2777 | N/A | N/A |
670
+ | 258000 | 2.946 | 8.9549e-07 | 0.3046 | N/A | N/A |
671
+ | 258500 | 2.952 | 8.0033e-07 | 0.3466 | N/A | N/A |
672
+ | 259000 | 2.958 | 7.0517e-07 | 0.2932 | N/A | N/A |
673
+ | 259500 | 2.963 | 6.1000e-07 | 0.344 | N/A | N/A |
674
+ | 260000 | 2.969 | 5.1484e-07 | 0.3009 | N/A | N/A |
675
+ | 260500 | 2.975 | 4.1967e-07 | 0.3004 | N/A | N/A |
676
+ | 261000 | 2.981 | 3.2451e-07 | 0.3348 | N/A | N/A |
677
+ | 261500 | 2.986 | 2.2935e-07 | 0.3198 | N/A | N/A |
678
+ | 262000 | 2.992 | 1.3418e-07 | 0.2931 | N/A | N/A |
679
+ | 262500 | 2.998 | 3.9017e-08 | 0.3016 | N/A | N/A |
680
+ | 262704 | 3.0 | N/A | N/A | 0.6198 | 0.8484 |
681
+
682
+ </details>
683
+
684
+
685
+ ## Framework Versions
686
+
687
+ - **Transformers:** 5.0.0.dev0
688
+ - **PyTorch:** 2.6.0+cu124
all_results.json ADDED
@@ -0,0 +1,15 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "eval_f1": 0.8483668821316216,
4
+ "eval_loss": 0.6198369264602661,
5
+ "eval_runtime": 49.7622,
6
+ "eval_samples": 87571,
7
+ "eval_samples_per_second": 1759.789,
8
+ "eval_steps_per_second": 219.986,
9
+ "total_flos": 3.4624973235879936e+16,
10
+ "train_loss": 0.47607343616087144,
11
+ "train_runtime": 4470.8117,
12
+ "train_samples": 700544,
13
+ "train_samples_per_second": 470.078,
14
+ "train_steps_per_second": 58.76
15
+ }
config.json ADDED
@@ -0,0 +1,82 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "architectures": [
3
+ "BertForSequenceClassification"
4
+ ],
5
+ "attention_probs_dropout_prob": 0.1,
6
+ "classifier_dropout": null,
7
+ "dtype": "float32",
8
+ "finetuning_task": "text-classification",
9
+ "hidden_act": "gelu",
10
+ "hidden_dropout_prob": 0.1,
11
+ "hidden_size": 384,
12
+ "id2label": {
13
+ "0": "Adult",
14
+ "1": "Arts_and_Entertainment",
15
+ "2": "Autos_and_Vehicles",
16
+ "3": "Beauty_and_Fitness",
17
+ "4": "Books_and_Literature",
18
+ "5": "Business_and_Industrial",
19
+ "6": "Computers_and_Electronics",
20
+ "7": "Finance",
21
+ "8": "Food_and_Drink",
22
+ "9": "Games",
23
+ "10": "Health",
24
+ "11": "Hobbies_and_Leisure",
25
+ "12": "Home_and_Garden",
26
+ "13": "Internet_and_Telecom",
27
+ "14": "Jobs_and_Education",
28
+ "15": "Law_and_Government",
29
+ "16": "News",
30
+ "17": "Online_Communities",
31
+ "18": "People_and_Society",
32
+ "19": "Pets_and_Animals",
33
+ "20": "Real_Estate",
34
+ "21": "Science",
35
+ "22": "Sensitive_Subjects",
36
+ "23": "Shopping",
37
+ "24": "Sports",
38
+ "25": "Travel_and_Transportation"
39
+ },
40
+ "initializer_range": 0.02,
41
+ "intermediate_size": 1536,
42
+ "label2id": {
43
+ "Adult": 0,
44
+ "Arts_and_Entertainment": 1,
45
+ "Autos_and_Vehicles": 2,
46
+ "Beauty_and_Fitness": 3,
47
+ "Books_and_Literature": 4,
48
+ "Business_and_Industrial": 5,
49
+ "Computers_and_Electronics": 6,
50
+ "Finance": 7,
51
+ "Food_and_Drink": 8,
52
+ "Games": 9,
53
+ "Health": 10,
54
+ "Hobbies_and_Leisure": 11,
55
+ "Home_and_Garden": 12,
56
+ "Internet_and_Telecom": 13,
57
+ "Jobs_and_Education": 14,
58
+ "Law_and_Government": 15,
59
+ "News": 16,
60
+ "Online_Communities": 17,
61
+ "People_and_Society": 18,
62
+ "Pets_and_Animals": 19,
63
+ "Real_Estate": 20,
64
+ "Science": 21,
65
+ "Sensitive_Subjects": 22,
66
+ "Shopping": 23,
67
+ "Sports": 24,
68
+ "Travel_and_Transportation": 25
69
+ },
70
+ "layer_norm_eps": 1e-12,
71
+ "max_position_embeddings": 512,
72
+ "model_type": "bert",
73
+ "num_attention_heads": 12,
74
+ "num_hidden_layers": 12,
75
+ "pad_token_id": 0,
76
+ "position_embedding_type": "absolute",
77
+ "problem_type": "single_label_classification",
78
+ "transformers_version": "5.0.0.dev0",
79
+ "type_vocab_size": 2,
80
+ "use_cache": false,
81
+ "vocab_size": 30522
82
+ }
eval_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "eval_f1": 0.8483668821316216,
4
+ "eval_loss": 0.6198369264602661,
5
+ "eval_runtime": 49.7622,
6
+ "eval_samples": 87571,
7
+ "eval_samples_per_second": 1759.789,
8
+ "eval_steps_per_second": 219.986
9
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11393fe7db6af533dcd65cd6c015aa776e46e58273096c88105741a7c92bf25c
3
+ size 133503336
predict_results.txt ADDED
The diff for this file is too large to render. See raw diff
 
report.md ADDED
@@ -0,0 +1,39 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Model Performance Report
2
+
3
+ **Overall Accuracy:** 85.12%
4
+
5
+ Note: Zeros in the following table indicate lack of test samples for those classes.
6
+
7
+ ### Per-Class Performance
8
+ | Class | Precision | Recall (Accuracy) | F1-Score | Support |
9
+ | :--- | :--- | :--- | :--- | :--- |
10
+ | Adult | 0.81 | 0.75 | 0.78 | 190.0 |
11
+ | Arts_and_Entertainment | 0.88 | 0.87 | 0.88 | 7737.0 |
12
+ | Autos_and_Vehicles | 0.90 | 0.90 | 0.90 | 2806.0 |
13
+ | Beauty_and_Fitness | 0.87 | 0.85 | 0.86 | 2564.0 |
14
+ | Books_and_Literature | 0.84 | 0.84 | 0.84 | 2115.0 |
15
+ | Business_and_Industrial | 0.82 | 0.82 | 0.82 | 7049.0 |
16
+ | Computers_and_Electronics | 0.86 | 0.88 | 0.87 | 5711.0 |
17
+ | Finance | 0.85 | 0.88 | 0.86 | 2369.0 |
18
+ | Food_and_Drink | 0.89 | 0.91 | 0.90 | 5020.0 |
19
+ | Games | 0.89 | 0.85 | 0.87 | 2264.0 |
20
+ | Health | 0.88 | 0.90 | 0.89 | 5424.0 |
21
+ | Hobbies_and_Leisure | 0.78 | 0.76 | 0.77 | 3244.0 |
22
+ | Home_and_Garden | 0.87 | 0.89 | 0.88 | 4569.0 |
23
+ | Internet_and_Telecom | 0.82 | 0.81 | 0.81 | 2668.0 |
24
+ | Jobs_and_Education | 0.85 | 0.84 | 0.85 | 4478.0 |
25
+ | Law_and_Government | 0.83 | 0.82 | 0.83 | 2331.0 |
26
+ | News | 0.79 | 0.74 | 0.76 | 3167.0 |
27
+ | Online_Communities | 0.76 | 0.68 | 0.72 | 898.0 |
28
+ | People_and_Society | 0.79 | 0.81 | 0.80 | 5354.0 |
29
+ | Pets_and_Animals | 0.85 | 0.86 | 0.85 | 1457.0 |
30
+ | Real_Estate | 0.91 | 0.91 | 0.91 | 2216.0 |
31
+ | Science | 0.83 | 0.79 | 0.81 | 1632.0 |
32
+ | Sensitive_Subjects | 0.82 | 0.83 | 0.83 | 2297.0 |
33
+ | Shopping | 0.79 | 0.80 | 0.80 | 2422.0 |
34
+ | Sports | 0.91 | 0.92 | 0.91 | 4024.0 |
35
+ | Travel_and_Transportation | 0.86 | 0.88 | 0.87 | 3560.0 |
36
+
37
+ ### Summary Statistics
38
+ - **Macro Avg F1:** 0.84
39
+ - **Weighted Avg F1:** 0.85
special_tokens_map.json ADDED
@@ -0,0 +1,37 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "cls_token": {
3
+ "content": "[CLS]",
4
+ "lstrip": false,
5
+ "normalized": false,
6
+ "rstrip": false,
7
+ "single_word": false
8
+ },
9
+ "mask_token": {
10
+ "content": "[MASK]",
11
+ "lstrip": false,
12
+ "normalized": false,
13
+ "rstrip": false,
14
+ "single_word": false
15
+ },
16
+ "pad_token": {
17
+ "content": "[PAD]",
18
+ "lstrip": false,
19
+ "normalized": false,
20
+ "rstrip": false,
21
+ "single_word": false
22
+ },
23
+ "sep_token": {
24
+ "content": "[SEP]",
25
+ "lstrip": false,
26
+ "normalized": false,
27
+ "rstrip": false,
28
+ "single_word": false
29
+ },
30
+ "unk_token": {
31
+ "content": "[UNK]",
32
+ "lstrip": false,
33
+ "normalized": false,
34
+ "rstrip": false,
35
+ "single_word": false
36
+ }
37
+ }
tokenizer.json ADDED
The diff for this file is too large to render. See raw diff
 
tokenizer_config.json ADDED
@@ -0,0 +1,58 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "added_tokens_decoder": {
3
+ "0": {
4
+ "content": "[PAD]",
5
+ "lstrip": false,
6
+ "normalized": false,
7
+ "rstrip": false,
8
+ "single_word": false,
9
+ "special": true
10
+ },
11
+ "100": {
12
+ "content": "[UNK]",
13
+ "lstrip": false,
14
+ "normalized": false,
15
+ "rstrip": false,
16
+ "single_word": false,
17
+ "special": true
18
+ },
19
+ "101": {
20
+ "content": "[CLS]",
21
+ "lstrip": false,
22
+ "normalized": false,
23
+ "rstrip": false,
24
+ "single_word": false,
25
+ "special": true
26
+ },
27
+ "102": {
28
+ "content": "[SEP]",
29
+ "lstrip": false,
30
+ "normalized": false,
31
+ "rstrip": false,
32
+ "single_word": false,
33
+ "special": true
34
+ },
35
+ "103": {
36
+ "content": "[MASK]",
37
+ "lstrip": false,
38
+ "normalized": false,
39
+ "rstrip": false,
40
+ "single_word": false,
41
+ "special": true
42
+ }
43
+ },
44
+ "clean_up_tokenization_spaces": true,
45
+ "cls_token": "[CLS]",
46
+ "do_basic_tokenize": true,
47
+ "do_lower_case": true,
48
+ "extra_special_tokens": {},
49
+ "mask_token": "[MASK]",
50
+ "model_max_length": 512,
51
+ "never_split": null,
52
+ "pad_token": "[PAD]",
53
+ "sep_token": "[SEP]",
54
+ "strip_accents": null,
55
+ "tokenize_chinese_chars": true,
56
+ "tokenizer_class": "BertTokenizer",
57
+ "unk_token": "[UNK]"
58
+ }
train_results.json ADDED
@@ -0,0 +1,9 @@
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "epoch": 3.0,
3
+ "total_flos": 3.4624973235879936e+16,
4
+ "train_loss": 0.47607343616087144,
5
+ "train_runtime": 4470.8117,
6
+ "train_samples": 700544,
7
+ "train_samples_per_second": 470.078,
8
+ "train_steps_per_second": 58.76
9
+ }
trainer_state.json ADDED
@@ -0,0 +1,3745 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "best_global_step": 262704,
3
+ "best_metric": 0.8483668821316216,
4
+ "best_model_checkpoint": "./GIST-small-c4-en-nvidia_domain/checkpoint-262704",
5
+ "epoch": 3.0,
6
+ "eval_steps": 500,
7
+ "global_step": 262704,
8
+ "is_hyper_param_search": false,
9
+ "is_local_process_zero": true,
10
+ "is_world_process_zero": true,
11
+ "log_history": [
12
+ {
13
+ "epoch": 0.0057098483464279185,
14
+ "grad_norm": 4.074185848236084,
15
+ "learning_rate": 4.990502618917108e-05,
16
+ "loss": 2.4364,
17
+ "step": 500
18
+ },
19
+ {
20
+ "epoch": 0.011419696692855837,
21
+ "grad_norm": 17.425518035888672,
22
+ "learning_rate": 4.980986205006395e-05,
23
+ "loss": 1.5824,
24
+ "step": 1000
25
+ },
26
+ {
27
+ "epoch": 0.017129545039283756,
28
+ "grad_norm": 8.760734558105469,
29
+ "learning_rate": 4.971469791095682e-05,
30
+ "loss": 1.2188,
31
+ "step": 1500
32
+ },
33
+ {
34
+ "epoch": 0.022839393385711674,
35
+ "grad_norm": 8.731233596801758,
36
+ "learning_rate": 4.961953377184969e-05,
37
+ "loss": 1.0205,
38
+ "step": 2000
39
+ },
40
+ {
41
+ "epoch": 0.028549241732139595,
42
+ "grad_norm": 12.212467193603516,
43
+ "learning_rate": 4.9524369632742554e-05,
44
+ "loss": 0.9426,
45
+ "step": 2500
46
+ },
47
+ {
48
+ "epoch": 0.03425909007856751,
49
+ "grad_norm": 10.077597618103027,
50
+ "learning_rate": 4.9429205493635424e-05,
51
+ "loss": 0.9035,
52
+ "step": 3000
53
+ },
54
+ {
55
+ "epoch": 0.03996893842499543,
56
+ "grad_norm": 6.7629852294921875,
57
+ "learning_rate": 4.9334041354528294e-05,
58
+ "loss": 0.8823,
59
+ "step": 3500
60
+ },
61
+ {
62
+ "epoch": 0.04567878677142335,
63
+ "grad_norm": 9.862654685974121,
64
+ "learning_rate": 4.923887721542116e-05,
65
+ "loss": 0.854,
66
+ "step": 4000
67
+ },
68
+ {
69
+ "epoch": 0.05138863511785127,
70
+ "grad_norm": 6.108799457550049,
71
+ "learning_rate": 4.914371307631403e-05,
72
+ "loss": 0.8577,
73
+ "step": 4500
74
+ },
75
+ {
76
+ "epoch": 0.05709848346427919,
77
+ "grad_norm": 9.217949867248535,
78
+ "learning_rate": 4.90485489372069e-05,
79
+ "loss": 0.8022,
80
+ "step": 5000
81
+ },
82
+ {
83
+ "epoch": 0.06280833181070711,
84
+ "grad_norm": 17.267671585083008,
85
+ "learning_rate": 4.895338479809977e-05,
86
+ "loss": 0.7564,
87
+ "step": 5500
88
+ },
89
+ {
90
+ "epoch": 0.06851818015713503,
91
+ "grad_norm": 26.16933822631836,
92
+ "learning_rate": 4.885822065899263e-05,
93
+ "loss": 0.7987,
94
+ "step": 6000
95
+ },
96
+ {
97
+ "epoch": 0.07422802850356294,
98
+ "grad_norm": 15.815842628479004,
99
+ "learning_rate": 4.87630565198855e-05,
100
+ "loss": 0.7842,
101
+ "step": 6500
102
+ },
103
+ {
104
+ "epoch": 0.07993787684999086,
105
+ "grad_norm": 7.934807777404785,
106
+ "learning_rate": 4.866789238077837e-05,
107
+ "loss": 0.7837,
108
+ "step": 7000
109
+ },
110
+ {
111
+ "epoch": 0.08564772519641878,
112
+ "grad_norm": 16.946102142333984,
113
+ "learning_rate": 4.857272824167124e-05,
114
+ "loss": 0.7572,
115
+ "step": 7500
116
+ },
117
+ {
118
+ "epoch": 0.0913575735428467,
119
+ "grad_norm": 30.369613647460938,
120
+ "learning_rate": 4.84775641025641e-05,
121
+ "loss": 0.721,
122
+ "step": 8000
123
+ },
124
+ {
125
+ "epoch": 0.09706742188927463,
126
+ "grad_norm": 17.091686248779297,
127
+ "learning_rate": 4.838239996345697e-05,
128
+ "loss": 0.7639,
129
+ "step": 8500
130
+ },
131
+ {
132
+ "epoch": 0.10277727023570254,
133
+ "grad_norm": 3.585613489151001,
134
+ "learning_rate": 4.828723582434984e-05,
135
+ "loss": 0.7158,
136
+ "step": 9000
137
+ },
138
+ {
139
+ "epoch": 0.10848711858213046,
140
+ "grad_norm": 15.002111434936523,
141
+ "learning_rate": 4.8192071685242705e-05,
142
+ "loss": 0.7181,
143
+ "step": 9500
144
+ },
145
+ {
146
+ "epoch": 0.11419696692855838,
147
+ "grad_norm": 16.9910945892334,
148
+ "learning_rate": 4.8096907546135575e-05,
149
+ "loss": 0.7234,
150
+ "step": 10000
151
+ },
152
+ {
153
+ "epoch": 0.1199068152749863,
154
+ "grad_norm": 13.960442543029785,
155
+ "learning_rate": 4.8001743407028445e-05,
156
+ "loss": 0.7504,
157
+ "step": 10500
158
+ },
159
+ {
160
+ "epoch": 0.12561666362141422,
161
+ "grad_norm": 15.084639549255371,
162
+ "learning_rate": 4.7906579267921314e-05,
163
+ "loss": 0.7369,
164
+ "step": 11000
165
+ },
166
+ {
167
+ "epoch": 0.13132651196784215,
168
+ "grad_norm": 14.265806198120117,
169
+ "learning_rate": 4.781141512881418e-05,
170
+ "loss": 0.7067,
171
+ "step": 11500
172
+ },
173
+ {
174
+ "epoch": 0.13703636031427005,
175
+ "grad_norm": 14.091336250305176,
176
+ "learning_rate": 4.7716250989707054e-05,
177
+ "loss": 0.7444,
178
+ "step": 12000
179
+ },
180
+ {
181
+ "epoch": 0.14274620866069798,
182
+ "grad_norm": 3.2662813663482666,
183
+ "learning_rate": 4.762108685059992e-05,
184
+ "loss": 0.6473,
185
+ "step": 12500
186
+ },
187
+ {
188
+ "epoch": 0.14845605700712589,
189
+ "grad_norm": 13.26012897491455,
190
+ "learning_rate": 4.752592271149279e-05,
191
+ "loss": 0.7407,
192
+ "step": 13000
193
+ },
194
+ {
195
+ "epoch": 0.15416590535355382,
196
+ "grad_norm": 18.407062530517578,
197
+ "learning_rate": 4.743075857238565e-05,
198
+ "loss": 0.7154,
199
+ "step": 13500
200
+ },
201
+ {
202
+ "epoch": 0.15987575369998172,
203
+ "grad_norm": 10.226462364196777,
204
+ "learning_rate": 4.733559443327852e-05,
205
+ "loss": 0.6784,
206
+ "step": 14000
207
+ },
208
+ {
209
+ "epoch": 0.16558560204640965,
210
+ "grad_norm": 16.100492477416992,
211
+ "learning_rate": 4.724043029417139e-05,
212
+ "loss": 0.6867,
213
+ "step": 14500
214
+ },
215
+ {
216
+ "epoch": 0.17129545039283756,
217
+ "grad_norm": 14.93231201171875,
218
+ "learning_rate": 4.714526615506425e-05,
219
+ "loss": 0.7031,
220
+ "step": 15000
221
+ },
222
+ {
223
+ "epoch": 0.1770052987392655,
224
+ "grad_norm": 21.477384567260742,
225
+ "learning_rate": 4.705010201595713e-05,
226
+ "loss": 0.6821,
227
+ "step": 15500
228
+ },
229
+ {
230
+ "epoch": 0.1827151470856934,
231
+ "grad_norm": 3.22827410697937,
232
+ "learning_rate": 4.695493787684999e-05,
233
+ "loss": 0.6822,
234
+ "step": 16000
235
+ },
236
+ {
237
+ "epoch": 0.18842499543212132,
238
+ "grad_norm": 10.463878631591797,
239
+ "learning_rate": 4.685977373774286e-05,
240
+ "loss": 0.6701,
241
+ "step": 16500
242
+ },
243
+ {
244
+ "epoch": 0.19413484377854925,
245
+ "grad_norm": 6.175551414489746,
246
+ "learning_rate": 4.6764609598635725e-05,
247
+ "loss": 0.667,
248
+ "step": 17000
249
+ },
250
+ {
251
+ "epoch": 0.19984469212497716,
252
+ "grad_norm": 7.501705169677734,
253
+ "learning_rate": 4.66694454595286e-05,
254
+ "loss": 0.6661,
255
+ "step": 17500
256
+ },
257
+ {
258
+ "epoch": 0.2055545404714051,
259
+ "grad_norm": 14.41045093536377,
260
+ "learning_rate": 4.6574281320421465e-05,
261
+ "loss": 0.6789,
262
+ "step": 18000
263
+ },
264
+ {
265
+ "epoch": 0.211264388817833,
266
+ "grad_norm": 24.136781692504883,
267
+ "learning_rate": 4.6479117181314335e-05,
268
+ "loss": 0.6661,
269
+ "step": 18500
270
+ },
271
+ {
272
+ "epoch": 0.21697423716426092,
273
+ "grad_norm": 14.338950157165527,
274
+ "learning_rate": 4.6383953042207204e-05,
275
+ "loss": 0.6652,
276
+ "step": 19000
277
+ },
278
+ {
279
+ "epoch": 0.22268408551068883,
280
+ "grad_norm": 14.422845840454102,
281
+ "learning_rate": 4.628878890310007e-05,
282
+ "loss": 0.6578,
283
+ "step": 19500
284
+ },
285
+ {
286
+ "epoch": 0.22839393385711676,
287
+ "grad_norm": 15.376773834228516,
288
+ "learning_rate": 4.619362476399294e-05,
289
+ "loss": 0.6619,
290
+ "step": 20000
291
+ },
292
+ {
293
+ "epoch": 0.23410378220354466,
294
+ "grad_norm": 25.064416885375977,
295
+ "learning_rate": 4.60984606248858e-05,
296
+ "loss": 0.6756,
297
+ "step": 20500
298
+ },
299
+ {
300
+ "epoch": 0.2398136305499726,
301
+ "grad_norm": 27.803922653198242,
302
+ "learning_rate": 4.600329648577868e-05,
303
+ "loss": 0.6505,
304
+ "step": 21000
305
+ },
306
+ {
307
+ "epoch": 0.2455234788964005,
308
+ "grad_norm": 11.432965278625488,
309
+ "learning_rate": 4.590813234667154e-05,
310
+ "loss": 0.6596,
311
+ "step": 21500
312
+ },
313
+ {
314
+ "epoch": 0.25123332724282843,
315
+ "grad_norm": 23.65805435180664,
316
+ "learning_rate": 4.581296820756441e-05,
317
+ "loss": 0.6932,
318
+ "step": 22000
319
+ },
320
+ {
321
+ "epoch": 0.25694317558925633,
322
+ "grad_norm": 13.047815322875977,
323
+ "learning_rate": 4.571780406845727e-05,
324
+ "loss": 0.6411,
325
+ "step": 22500
326
+ },
327
+ {
328
+ "epoch": 0.2626530239356843,
329
+ "grad_norm": 10.878809928894043,
330
+ "learning_rate": 4.562263992935015e-05,
331
+ "loss": 0.6682,
332
+ "step": 23000
333
+ },
334
+ {
335
+ "epoch": 0.2683628722821122,
336
+ "grad_norm": 11.281234741210938,
337
+ "learning_rate": 4.552747579024301e-05,
338
+ "loss": 0.6404,
339
+ "step": 23500
340
+ },
341
+ {
342
+ "epoch": 0.2740727206285401,
343
+ "grad_norm": 12.26717758178711,
344
+ "learning_rate": 4.543231165113588e-05,
345
+ "loss": 0.6982,
346
+ "step": 24000
347
+ },
348
+ {
349
+ "epoch": 0.279782568974968,
350
+ "grad_norm": 8.030463218688965,
351
+ "learning_rate": 4.533714751202875e-05,
352
+ "loss": 0.6987,
353
+ "step": 24500
354
+ },
355
+ {
356
+ "epoch": 0.28549241732139596,
357
+ "grad_norm": 16.24574851989746,
358
+ "learning_rate": 4.5241983372921615e-05,
359
+ "loss": 0.662,
360
+ "step": 25000
361
+ },
362
+ {
363
+ "epoch": 0.29120226566782387,
364
+ "grad_norm": 9.144447326660156,
365
+ "learning_rate": 4.5146819233814485e-05,
366
+ "loss": 0.646,
367
+ "step": 25500
368
+ },
369
+ {
370
+ "epoch": 0.29691211401425177,
371
+ "grad_norm": 17.31451416015625,
372
+ "learning_rate": 4.505165509470735e-05,
373
+ "loss": 0.6449,
374
+ "step": 26000
375
+ },
376
+ {
377
+ "epoch": 0.3026219623606797,
378
+ "grad_norm": 17.22359848022461,
379
+ "learning_rate": 4.4956490955600225e-05,
380
+ "loss": 0.649,
381
+ "step": 26500
382
+ },
383
+ {
384
+ "epoch": 0.30833181070710763,
385
+ "grad_norm": 18.975936889648438,
386
+ "learning_rate": 4.486132681649309e-05,
387
+ "loss": 0.6186,
388
+ "step": 27000
389
+ },
390
+ {
391
+ "epoch": 0.31404165905353554,
392
+ "grad_norm": 10.402185440063477,
393
+ "learning_rate": 4.476616267738596e-05,
394
+ "loss": 0.6647,
395
+ "step": 27500
396
+ },
397
+ {
398
+ "epoch": 0.31975150739996344,
399
+ "grad_norm": 22.229700088500977,
400
+ "learning_rate": 4.467099853827883e-05,
401
+ "loss": 0.629,
402
+ "step": 28000
403
+ },
404
+ {
405
+ "epoch": 0.3254613557463914,
406
+ "grad_norm": 4.392402172088623,
407
+ "learning_rate": 4.45758343991717e-05,
408
+ "loss": 0.6494,
409
+ "step": 28500
410
+ },
411
+ {
412
+ "epoch": 0.3311712040928193,
413
+ "grad_norm": 20.67599105834961,
414
+ "learning_rate": 4.448067026006456e-05,
415
+ "loss": 0.6634,
416
+ "step": 29000
417
+ },
418
+ {
419
+ "epoch": 0.3368810524392472,
420
+ "grad_norm": 5.712689399719238,
421
+ "learning_rate": 4.438550612095743e-05,
422
+ "loss": 0.6355,
423
+ "step": 29500
424
+ },
425
+ {
426
+ "epoch": 0.3425909007856751,
427
+ "grad_norm": 18.034873962402344,
428
+ "learning_rate": 4.42903419818503e-05,
429
+ "loss": 0.6396,
430
+ "step": 30000
431
+ },
432
+ {
433
+ "epoch": 0.34830074913210307,
434
+ "grad_norm": 17.62325096130371,
435
+ "learning_rate": 4.419517784274316e-05,
436
+ "loss": 0.6298,
437
+ "step": 30500
438
+ },
439
+ {
440
+ "epoch": 0.354010597478531,
441
+ "grad_norm": 23.936737060546875,
442
+ "learning_rate": 4.410001370363603e-05,
443
+ "loss": 0.6511,
444
+ "step": 31000
445
+ },
446
+ {
447
+ "epoch": 0.3597204458249589,
448
+ "grad_norm": 9.145143508911133,
449
+ "learning_rate": 4.40048495645289e-05,
450
+ "loss": 0.6584,
451
+ "step": 31500
452
+ },
453
+ {
454
+ "epoch": 0.3654302941713868,
455
+ "grad_norm": 18.153148651123047,
456
+ "learning_rate": 4.390968542542177e-05,
457
+ "loss": 0.6333,
458
+ "step": 32000
459
+ },
460
+ {
461
+ "epoch": 0.37114014251781474,
462
+ "grad_norm": 10.10322380065918,
463
+ "learning_rate": 4.3814521286314635e-05,
464
+ "loss": 0.6386,
465
+ "step": 32500
466
+ },
467
+ {
468
+ "epoch": 0.37684999086424265,
469
+ "grad_norm": 17.958829879760742,
470
+ "learning_rate": 4.3719357147207505e-05,
471
+ "loss": 0.6214,
472
+ "step": 33000
473
+ },
474
+ {
475
+ "epoch": 0.38255983921067055,
476
+ "grad_norm": 12.072795867919922,
477
+ "learning_rate": 4.3624193008100375e-05,
478
+ "loss": 0.6369,
479
+ "step": 33500
480
+ },
481
+ {
482
+ "epoch": 0.3882696875570985,
483
+ "grad_norm": 4.726241588592529,
484
+ "learning_rate": 4.3529028868993245e-05,
485
+ "loss": 0.6079,
486
+ "step": 34000
487
+ },
488
+ {
489
+ "epoch": 0.3939795359035264,
490
+ "grad_norm": 11.250266075134277,
491
+ "learning_rate": 4.343386472988611e-05,
492
+ "loss": 0.6216,
493
+ "step": 34500
494
+ },
495
+ {
496
+ "epoch": 0.3996893842499543,
497
+ "grad_norm": 6.232990741729736,
498
+ "learning_rate": 4.333870059077898e-05,
499
+ "loss": 0.6337,
500
+ "step": 35000
501
+ },
502
+ {
503
+ "epoch": 0.4053992325963822,
504
+ "grad_norm": 14.738117218017578,
505
+ "learning_rate": 4.324353645167185e-05,
506
+ "loss": 0.6448,
507
+ "step": 35500
508
+ },
509
+ {
510
+ "epoch": 0.4111090809428102,
511
+ "grad_norm": 1.5411653518676758,
512
+ "learning_rate": 4.314837231256471e-05,
513
+ "loss": 0.6016,
514
+ "step": 36000
515
+ },
516
+ {
517
+ "epoch": 0.4168189292892381,
518
+ "grad_norm": 9.895695686340332,
519
+ "learning_rate": 4.305320817345758e-05,
520
+ "loss": 0.6222,
521
+ "step": 36500
522
+ },
523
+ {
524
+ "epoch": 0.422528777635666,
525
+ "grad_norm": 11.866761207580566,
526
+ "learning_rate": 4.295804403435045e-05,
527
+ "loss": 0.6441,
528
+ "step": 37000
529
+ },
530
+ {
531
+ "epoch": 0.4282386259820939,
532
+ "grad_norm": 10.158306121826172,
533
+ "learning_rate": 4.286287989524332e-05,
534
+ "loss": 0.6217,
535
+ "step": 37500
536
+ },
537
+ {
538
+ "epoch": 0.43394847432852185,
539
+ "grad_norm": 13.547343254089355,
540
+ "learning_rate": 4.276771575613618e-05,
541
+ "loss": 0.6147,
542
+ "step": 38000
543
+ },
544
+ {
545
+ "epoch": 0.43965832267494975,
546
+ "grad_norm": 4.396725177764893,
547
+ "learning_rate": 4.267255161702905e-05,
548
+ "loss": 0.5851,
549
+ "step": 38500
550
+ },
551
+ {
552
+ "epoch": 0.44536817102137766,
553
+ "grad_norm": 9.115561485290527,
554
+ "learning_rate": 4.257738747792192e-05,
555
+ "loss": 0.5924,
556
+ "step": 39000
557
+ },
558
+ {
559
+ "epoch": 0.4510780193678056,
560
+ "grad_norm": 20.561851501464844,
561
+ "learning_rate": 4.248222333881479e-05,
562
+ "loss": 0.5917,
563
+ "step": 39500
564
+ },
565
+ {
566
+ "epoch": 0.4567878677142335,
567
+ "grad_norm": 23.267698287963867,
568
+ "learning_rate": 4.2387059199707656e-05,
569
+ "loss": 0.6073,
570
+ "step": 40000
571
+ },
572
+ {
573
+ "epoch": 0.4624977160606614,
574
+ "grad_norm": 6.264415740966797,
575
+ "learning_rate": 4.2291895060600525e-05,
576
+ "loss": 0.6634,
577
+ "step": 40500
578
+ },
579
+ {
580
+ "epoch": 0.4682075644070893,
581
+ "grad_norm": 19.040050506591797,
582
+ "learning_rate": 4.2196730921493395e-05,
583
+ "loss": 0.5875,
584
+ "step": 41000
585
+ },
586
+ {
587
+ "epoch": 0.4739174127535173,
588
+ "grad_norm": 15.092577934265137,
589
+ "learning_rate": 4.210156678238626e-05,
590
+ "loss": 0.5966,
591
+ "step": 41500
592
+ },
593
+ {
594
+ "epoch": 0.4796272610999452,
595
+ "grad_norm": 16.646717071533203,
596
+ "learning_rate": 4.200640264327913e-05,
597
+ "loss": 0.5889,
598
+ "step": 42000
599
+ },
600
+ {
601
+ "epoch": 0.4853371094463731,
602
+ "grad_norm": 6.897945880889893,
603
+ "learning_rate": 4.1911238504172e-05,
604
+ "loss": 0.5983,
605
+ "step": 42500
606
+ },
607
+ {
608
+ "epoch": 0.491046957792801,
609
+ "grad_norm": 16.127426147460938,
610
+ "learning_rate": 4.181607436506487e-05,
611
+ "loss": 0.6497,
612
+ "step": 43000
613
+ },
614
+ {
615
+ "epoch": 0.49675680613922896,
616
+ "grad_norm": 14.017200469970703,
617
+ "learning_rate": 4.172091022595773e-05,
618
+ "loss": 0.6242,
619
+ "step": 43500
620
+ },
621
+ {
622
+ "epoch": 0.5024666544856569,
623
+ "grad_norm": 17.338048934936523,
624
+ "learning_rate": 4.16257460868506e-05,
625
+ "loss": 0.6023,
626
+ "step": 44000
627
+ },
628
+ {
629
+ "epoch": 0.5081765028320848,
630
+ "grad_norm": 10.358681678771973,
631
+ "learning_rate": 4.153058194774347e-05,
632
+ "loss": 0.6103,
633
+ "step": 44500
634
+ },
635
+ {
636
+ "epoch": 0.5138863511785127,
637
+ "grad_norm": 20.74810218811035,
638
+ "learning_rate": 4.143541780863634e-05,
639
+ "loss": 0.6323,
640
+ "step": 45000
641
+ },
642
+ {
643
+ "epoch": 0.5195961995249406,
644
+ "grad_norm": 19.062522888183594,
645
+ "learning_rate": 4.13402536695292e-05,
646
+ "loss": 0.5973,
647
+ "step": 45500
648
+ },
649
+ {
650
+ "epoch": 0.5253060478713686,
651
+ "grad_norm": 17.16405487060547,
652
+ "learning_rate": 4.124508953042207e-05,
653
+ "loss": 0.6047,
654
+ "step": 46000
655
+ },
656
+ {
657
+ "epoch": 0.5310158962177964,
658
+ "grad_norm": 19.041616439819336,
659
+ "learning_rate": 4.114992539131494e-05,
660
+ "loss": 0.6199,
661
+ "step": 46500
662
+ },
663
+ {
664
+ "epoch": 0.5367257445642244,
665
+ "grad_norm": 7.590620517730713,
666
+ "learning_rate": 4.1054761252207806e-05,
667
+ "loss": 0.5927,
668
+ "step": 47000
669
+ },
670
+ {
671
+ "epoch": 0.5424355929106522,
672
+ "grad_norm": 19.31036949157715,
673
+ "learning_rate": 4.0959597113100676e-05,
674
+ "loss": 0.6302,
675
+ "step": 47500
676
+ },
677
+ {
678
+ "epoch": 0.5481454412570802,
679
+ "grad_norm": 23.210494995117188,
680
+ "learning_rate": 4.0864432973993546e-05,
681
+ "loss": 0.6211,
682
+ "step": 48000
683
+ },
684
+ {
685
+ "epoch": 0.5538552896035082,
686
+ "grad_norm": 14.992992401123047,
687
+ "learning_rate": 4.0769268834886415e-05,
688
+ "loss": 0.6093,
689
+ "step": 48500
690
+ },
691
+ {
692
+ "epoch": 0.559565137949936,
693
+ "grad_norm": 18.56623077392578,
694
+ "learning_rate": 4.067410469577928e-05,
695
+ "loss": 0.59,
696
+ "step": 49000
697
+ },
698
+ {
699
+ "epoch": 0.565274986296364,
700
+ "grad_norm": 17.202821731567383,
701
+ "learning_rate": 4.057894055667215e-05,
702
+ "loss": 0.6118,
703
+ "step": 49500
704
+ },
705
+ {
706
+ "epoch": 0.5709848346427919,
707
+ "grad_norm": 12.740659713745117,
708
+ "learning_rate": 4.048377641756502e-05,
709
+ "loss": 0.5982,
710
+ "step": 50000
711
+ },
712
+ {
713
+ "epoch": 0.5766946829892198,
714
+ "grad_norm": 8.383631706237793,
715
+ "learning_rate": 4.038861227845789e-05,
716
+ "loss": 0.5854,
717
+ "step": 50500
718
+ },
719
+ {
720
+ "epoch": 0.5824045313356477,
721
+ "grad_norm": 11.272398948669434,
722
+ "learning_rate": 4.029344813935075e-05,
723
+ "loss": 0.6091,
724
+ "step": 51000
725
+ },
726
+ {
727
+ "epoch": 0.5881143796820757,
728
+ "grad_norm": 5.307059288024902,
729
+ "learning_rate": 4.019828400024363e-05,
730
+ "loss": 0.5978,
731
+ "step": 51500
732
+ },
733
+ {
734
+ "epoch": 0.5938242280285035,
735
+ "grad_norm": 2.1819450855255127,
736
+ "learning_rate": 4.010311986113649e-05,
737
+ "loss": 0.5712,
738
+ "step": 52000
739
+ },
740
+ {
741
+ "epoch": 0.5995340763749315,
742
+ "grad_norm": 25.56458282470703,
743
+ "learning_rate": 4.0007955722029354e-05,
744
+ "loss": 0.5815,
745
+ "step": 52500
746
+ },
747
+ {
748
+ "epoch": 0.6052439247213593,
749
+ "grad_norm": 17.28989028930664,
750
+ "learning_rate": 3.9912791582922223e-05,
751
+ "loss": 0.5889,
752
+ "step": 53000
753
+ },
754
+ {
755
+ "epoch": 0.6109537730677873,
756
+ "grad_norm": 14.627861022949219,
757
+ "learning_rate": 3.981762744381509e-05,
758
+ "loss": 0.621,
759
+ "step": 53500
760
+ },
761
+ {
762
+ "epoch": 0.6166636214142153,
763
+ "grad_norm": 13.195589065551758,
764
+ "learning_rate": 3.972246330470796e-05,
765
+ "loss": 0.6087,
766
+ "step": 54000
767
+ },
768
+ {
769
+ "epoch": 0.6223734697606431,
770
+ "grad_norm": 20.853633880615234,
771
+ "learning_rate": 3.9627299165600826e-05,
772
+ "loss": 0.6174,
773
+ "step": 54500
774
+ },
775
+ {
776
+ "epoch": 0.6280833181070711,
777
+ "grad_norm": 7.540297985076904,
778
+ "learning_rate": 3.95321350264937e-05,
779
+ "loss": 0.6257,
780
+ "step": 55000
781
+ },
782
+ {
783
+ "epoch": 0.633793166453499,
784
+ "grad_norm": 14.432859420776367,
785
+ "learning_rate": 3.9436970887386566e-05,
786
+ "loss": 0.6057,
787
+ "step": 55500
788
+ },
789
+ {
790
+ "epoch": 0.6395030147999269,
791
+ "grad_norm": 1.4152778387069702,
792
+ "learning_rate": 3.9341806748279436e-05,
793
+ "loss": 0.6155,
794
+ "step": 56000
795
+ },
796
+ {
797
+ "epoch": 0.6452128631463548,
798
+ "grad_norm": 8.29656982421875,
799
+ "learning_rate": 3.92466426091723e-05,
800
+ "loss": 0.59,
801
+ "step": 56500
802
+ },
803
+ {
804
+ "epoch": 0.6509227114927828,
805
+ "grad_norm": 15.09579086303711,
806
+ "learning_rate": 3.9151478470065175e-05,
807
+ "loss": 0.5982,
808
+ "step": 57000
809
+ },
810
+ {
811
+ "epoch": 0.6566325598392106,
812
+ "grad_norm": 14.4094877243042,
813
+ "learning_rate": 3.905631433095804e-05,
814
+ "loss": 0.5643,
815
+ "step": 57500
816
+ },
817
+ {
818
+ "epoch": 0.6623424081856386,
819
+ "grad_norm": 10.77921199798584,
820
+ "learning_rate": 3.89611501918509e-05,
821
+ "loss": 0.5806,
822
+ "step": 58000
823
+ },
824
+ {
825
+ "epoch": 0.6680522565320665,
826
+ "grad_norm": 14.724946975708008,
827
+ "learning_rate": 3.886598605274378e-05,
828
+ "loss": 0.6077,
829
+ "step": 58500
830
+ },
831
+ {
832
+ "epoch": 0.6737621048784944,
833
+ "grad_norm": 7.7026286125183105,
834
+ "learning_rate": 3.877082191363664e-05,
835
+ "loss": 0.5918,
836
+ "step": 59000
837
+ },
838
+ {
839
+ "epoch": 0.6794719532249224,
840
+ "grad_norm": 14.552539825439453,
841
+ "learning_rate": 3.867565777452951e-05,
842
+ "loss": 0.5728,
843
+ "step": 59500
844
+ },
845
+ {
846
+ "epoch": 0.6851818015713502,
847
+ "grad_norm": 14.78132152557373,
848
+ "learning_rate": 3.8580493635422374e-05,
849
+ "loss": 0.5944,
850
+ "step": 60000
851
+ },
852
+ {
853
+ "epoch": 0.6908916499177782,
854
+ "grad_norm": 9.253613471984863,
855
+ "learning_rate": 3.848532949631525e-05,
856
+ "loss": 0.6117,
857
+ "step": 60500
858
+ },
859
+ {
860
+ "epoch": 0.6966014982642061,
861
+ "grad_norm": 2.052332878112793,
862
+ "learning_rate": 3.8390165357208114e-05,
863
+ "loss": 0.6168,
864
+ "step": 61000
865
+ },
866
+ {
867
+ "epoch": 0.702311346610634,
868
+ "grad_norm": 9.2500581741333,
869
+ "learning_rate": 3.829500121810098e-05,
870
+ "loss": 0.5898,
871
+ "step": 61500
872
+ },
873
+ {
874
+ "epoch": 0.708021194957062,
875
+ "grad_norm": 9.299861907958984,
876
+ "learning_rate": 3.8199837078993846e-05,
877
+ "loss": 0.593,
878
+ "step": 62000
879
+ },
880
+ {
881
+ "epoch": 0.7137310433034899,
882
+ "grad_norm": 18.009780883789062,
883
+ "learning_rate": 3.810467293988672e-05,
884
+ "loss": 0.6043,
885
+ "step": 62500
886
+ },
887
+ {
888
+ "epoch": 0.7194408916499178,
889
+ "grad_norm": 0.5127468109130859,
890
+ "learning_rate": 3.8009508800779586e-05,
891
+ "loss": 0.5845,
892
+ "step": 63000
893
+ },
894
+ {
895
+ "epoch": 0.7251507399963457,
896
+ "grad_norm": 17.418270111083984,
897
+ "learning_rate": 3.791434466167245e-05,
898
+ "loss": 0.5844,
899
+ "step": 63500
900
+ },
901
+ {
902
+ "epoch": 0.7308605883427736,
903
+ "grad_norm": 11.822376251220703,
904
+ "learning_rate": 3.7819180522565326e-05,
905
+ "loss": 0.597,
906
+ "step": 64000
907
+ },
908
+ {
909
+ "epoch": 0.7365704366892015,
910
+ "grad_norm": 13.598128318786621,
911
+ "learning_rate": 3.772401638345819e-05,
912
+ "loss": 0.5777,
913
+ "step": 64500
914
+ },
915
+ {
916
+ "epoch": 0.7422802850356295,
917
+ "grad_norm": 18.015153884887695,
918
+ "learning_rate": 3.762885224435106e-05,
919
+ "loss": 0.6053,
920
+ "step": 65000
921
+ },
922
+ {
923
+ "epoch": 0.7479901333820573,
924
+ "grad_norm": 13.639507293701172,
925
+ "learning_rate": 3.753368810524392e-05,
926
+ "loss": 0.5681,
927
+ "step": 65500
928
+ },
929
+ {
930
+ "epoch": 0.7536999817284853,
931
+ "grad_norm": 15.982161521911621,
932
+ "learning_rate": 3.74385239661368e-05,
933
+ "loss": 0.5508,
934
+ "step": 66000
935
+ },
936
+ {
937
+ "epoch": 0.7594098300749133,
938
+ "grad_norm": 13.359079360961914,
939
+ "learning_rate": 3.734335982702966e-05,
940
+ "loss": 0.6072,
941
+ "step": 66500
942
+ },
943
+ {
944
+ "epoch": 0.7651196784213411,
945
+ "grad_norm": 12.770344734191895,
946
+ "learning_rate": 3.724819568792253e-05,
947
+ "loss": 0.5982,
948
+ "step": 67000
949
+ },
950
+ {
951
+ "epoch": 0.7708295267677691,
952
+ "grad_norm": 21.434030532836914,
953
+ "learning_rate": 3.71530315488154e-05,
954
+ "loss": 0.5607,
955
+ "step": 67500
956
+ },
957
+ {
958
+ "epoch": 0.776539375114197,
959
+ "grad_norm": 11.095213890075684,
960
+ "learning_rate": 3.705786740970827e-05,
961
+ "loss": 0.5671,
962
+ "step": 68000
963
+ },
964
+ {
965
+ "epoch": 0.7822492234606249,
966
+ "grad_norm": 8.150908470153809,
967
+ "learning_rate": 3.6962703270601134e-05,
968
+ "loss": 0.5803,
969
+ "step": 68500
970
+ },
971
+ {
972
+ "epoch": 0.7879590718070528,
973
+ "grad_norm": 22.225507736206055,
974
+ "learning_rate": 3.6867539131494e-05,
975
+ "loss": 0.5736,
976
+ "step": 69000
977
+ },
978
+ {
979
+ "epoch": 0.7936689201534807,
980
+ "grad_norm": 7.903335094451904,
981
+ "learning_rate": 3.6772374992386873e-05,
982
+ "loss": 0.5808,
983
+ "step": 69500
984
+ },
985
+ {
986
+ "epoch": 0.7993787684999086,
987
+ "grad_norm": 2.3839080333709717,
988
+ "learning_rate": 3.6677210853279736e-05,
989
+ "loss": 0.602,
990
+ "step": 70000
991
+ },
992
+ {
993
+ "epoch": 0.8050886168463366,
994
+ "grad_norm": 15.942743301391602,
995
+ "learning_rate": 3.6582046714172606e-05,
996
+ "loss": 0.5485,
997
+ "step": 70500
998
+ },
999
+ {
1000
+ "epoch": 0.8107984651927644,
1001
+ "grad_norm": 12.962651252746582,
1002
+ "learning_rate": 3.6486882575065476e-05,
1003
+ "loss": 0.5601,
1004
+ "step": 71000
1005
+ },
1006
+ {
1007
+ "epoch": 0.8165083135391924,
1008
+ "grad_norm": 10.290393829345703,
1009
+ "learning_rate": 3.6391718435958346e-05,
1010
+ "loss": 0.5605,
1011
+ "step": 71500
1012
+ },
1013
+ {
1014
+ "epoch": 0.8222181618856204,
1015
+ "grad_norm": 18.875320434570312,
1016
+ "learning_rate": 3.629655429685121e-05,
1017
+ "loss": 0.5832,
1018
+ "step": 72000
1019
+ },
1020
+ {
1021
+ "epoch": 0.8279280102320482,
1022
+ "grad_norm": 22.831157684326172,
1023
+ "learning_rate": 3.620139015774408e-05,
1024
+ "loss": 0.5888,
1025
+ "step": 72500
1026
+ },
1027
+ {
1028
+ "epoch": 0.8336378585784762,
1029
+ "grad_norm": 13.854305267333984,
1030
+ "learning_rate": 3.610622601863695e-05,
1031
+ "loss": 0.5582,
1032
+ "step": 73000
1033
+ },
1034
+ {
1035
+ "epoch": 0.8393477069249041,
1036
+ "grad_norm": 16.568824768066406,
1037
+ "learning_rate": 3.601106187952982e-05,
1038
+ "loss": 0.556,
1039
+ "step": 73500
1040
+ },
1041
+ {
1042
+ "epoch": 0.845057555271332,
1043
+ "grad_norm": 16.641237258911133,
1044
+ "learning_rate": 3.591589774042268e-05,
1045
+ "loss": 0.5677,
1046
+ "step": 74000
1047
+ },
1048
+ {
1049
+ "epoch": 0.8507674036177599,
1050
+ "grad_norm": 11.521105766296387,
1051
+ "learning_rate": 3.582073360131555e-05,
1052
+ "loss": 0.5367,
1053
+ "step": 74500
1054
+ },
1055
+ {
1056
+ "epoch": 0.8564772519641878,
1057
+ "grad_norm": 7.507530689239502,
1058
+ "learning_rate": 3.572556946220842e-05,
1059
+ "loss": 0.6036,
1060
+ "step": 75000
1061
+ },
1062
+ {
1063
+ "epoch": 0.8621871003106157,
1064
+ "grad_norm": 30.147275924682617,
1065
+ "learning_rate": 3.5630405323101284e-05,
1066
+ "loss": 0.55,
1067
+ "step": 75500
1068
+ },
1069
+ {
1070
+ "epoch": 0.8678969486570437,
1071
+ "grad_norm": 4.555859088897705,
1072
+ "learning_rate": 3.5535241183994154e-05,
1073
+ "loss": 0.5973,
1074
+ "step": 76000
1075
+ },
1076
+ {
1077
+ "epoch": 0.8736067970034715,
1078
+ "grad_norm": 9.240984916687012,
1079
+ "learning_rate": 3.5440077044887024e-05,
1080
+ "loss": 0.5771,
1081
+ "step": 76500
1082
+ },
1083
+ {
1084
+ "epoch": 0.8793166453498995,
1085
+ "grad_norm": 8.154085159301758,
1086
+ "learning_rate": 3.5344912905779894e-05,
1087
+ "loss": 0.584,
1088
+ "step": 77000
1089
+ },
1090
+ {
1091
+ "epoch": 0.8850264936963275,
1092
+ "grad_norm": 7.670762062072754,
1093
+ "learning_rate": 3.524974876667276e-05,
1094
+ "loss": 0.5859,
1095
+ "step": 77500
1096
+ },
1097
+ {
1098
+ "epoch": 0.8907363420427553,
1099
+ "grad_norm": 12.381573677062988,
1100
+ "learning_rate": 3.5154584627565626e-05,
1101
+ "loss": 0.5655,
1102
+ "step": 78000
1103
+ },
1104
+ {
1105
+ "epoch": 0.8964461903891833,
1106
+ "grad_norm": 17.665035247802734,
1107
+ "learning_rate": 3.5059420488458496e-05,
1108
+ "loss": 0.5797,
1109
+ "step": 78500
1110
+ },
1111
+ {
1112
+ "epoch": 0.9021560387356112,
1113
+ "grad_norm": 9.356094360351562,
1114
+ "learning_rate": 3.4964256349351366e-05,
1115
+ "loss": 0.5833,
1116
+ "step": 79000
1117
+ },
1118
+ {
1119
+ "epoch": 0.9078658870820391,
1120
+ "grad_norm": 2.7480316162109375,
1121
+ "learning_rate": 3.486909221024423e-05,
1122
+ "loss": 0.6077,
1123
+ "step": 79500
1124
+ },
1125
+ {
1126
+ "epoch": 0.913575735428467,
1127
+ "grad_norm": 1.355102300643921,
1128
+ "learning_rate": 3.47739280711371e-05,
1129
+ "loss": 0.5375,
1130
+ "step": 80000
1131
+ },
1132
+ {
1133
+ "epoch": 0.9192855837748949,
1134
+ "grad_norm": 11.675610542297363,
1135
+ "learning_rate": 3.467876393202997e-05,
1136
+ "loss": 0.59,
1137
+ "step": 80500
1138
+ },
1139
+ {
1140
+ "epoch": 0.9249954321213228,
1141
+ "grad_norm": 13.663498878479004,
1142
+ "learning_rate": 3.458359979292283e-05,
1143
+ "loss": 0.5788,
1144
+ "step": 81000
1145
+ },
1146
+ {
1147
+ "epoch": 0.9307052804677508,
1148
+ "grad_norm": 9.415632247924805,
1149
+ "learning_rate": 3.44884356538157e-05,
1150
+ "loss": 0.5627,
1151
+ "step": 81500
1152
+ },
1153
+ {
1154
+ "epoch": 0.9364151288141787,
1155
+ "grad_norm": 17.89898109436035,
1156
+ "learning_rate": 3.439327151470857e-05,
1157
+ "loss": 0.5482,
1158
+ "step": 82000
1159
+ },
1160
+ {
1161
+ "epoch": 0.9421249771606066,
1162
+ "grad_norm": 13.109817504882812,
1163
+ "learning_rate": 3.429810737560144e-05,
1164
+ "loss": 0.563,
1165
+ "step": 82500
1166
+ },
1167
+ {
1168
+ "epoch": 0.9478348255070346,
1169
+ "grad_norm": 9.118353843688965,
1170
+ "learning_rate": 3.4202943236494304e-05,
1171
+ "loss": 0.5716,
1172
+ "step": 83000
1173
+ },
1174
+ {
1175
+ "epoch": 0.9535446738534624,
1176
+ "grad_norm": 19.87708854675293,
1177
+ "learning_rate": 3.4107779097387174e-05,
1178
+ "loss": 0.5387,
1179
+ "step": 83500
1180
+ },
1181
+ {
1182
+ "epoch": 0.9592545221998904,
1183
+ "grad_norm": 13.256304740905762,
1184
+ "learning_rate": 3.4012614958280044e-05,
1185
+ "loss": 0.5594,
1186
+ "step": 84000
1187
+ },
1188
+ {
1189
+ "epoch": 0.9649643705463183,
1190
+ "grad_norm": 8.930333137512207,
1191
+ "learning_rate": 3.3917450819172914e-05,
1192
+ "loss": 0.5851,
1193
+ "step": 84500
1194
+ },
1195
+ {
1196
+ "epoch": 0.9706742188927462,
1197
+ "grad_norm": 6.046392440795898,
1198
+ "learning_rate": 3.382228668006578e-05,
1199
+ "loss": 0.5679,
1200
+ "step": 85000
1201
+ },
1202
+ {
1203
+ "epoch": 0.9763840672391741,
1204
+ "grad_norm": 15.195645332336426,
1205
+ "learning_rate": 3.372712254095865e-05,
1206
+ "loss": 0.558,
1207
+ "step": 85500
1208
+ },
1209
+ {
1210
+ "epoch": 0.982093915585602,
1211
+ "grad_norm": 9.737853050231934,
1212
+ "learning_rate": 3.3631958401851517e-05,
1213
+ "loss": 0.5623,
1214
+ "step": 86000
1215
+ },
1216
+ {
1217
+ "epoch": 0.98780376393203,
1218
+ "grad_norm": 16.18001365661621,
1219
+ "learning_rate": 3.353679426274438e-05,
1220
+ "loss": 0.5722,
1221
+ "step": 86500
1222
+ },
1223
+ {
1224
+ "epoch": 0.9935136122784579,
1225
+ "grad_norm": 12.769728660583496,
1226
+ "learning_rate": 3.344163012363725e-05,
1227
+ "loss": 0.5448,
1228
+ "step": 87000
1229
+ },
1230
+ {
1231
+ "epoch": 0.9992234606248858,
1232
+ "grad_norm": 7.3773393630981445,
1233
+ "learning_rate": 3.334646598453012e-05,
1234
+ "loss": 0.5505,
1235
+ "step": 87500
1236
+ },
1237
+ {
1238
+ "epoch": 1.0,
1239
+ "eval_f1": 0.8281263748212603,
1240
+ "eval_loss": 0.5458744764328003,
1241
+ "eval_runtime": 49.589,
1242
+ "eval_samples_per_second": 1765.938,
1243
+ "eval_steps_per_second": 220.755,
1244
+ "step": 87568
1245
+ },
1246
+ {
1247
+ "epoch": 1.0049333089713137,
1248
+ "grad_norm": 20.385189056396484,
1249
+ "learning_rate": 3.325130184542299e-05,
1250
+ "loss": 0.4624,
1251
+ "step": 88000
1252
+ },
1253
+ {
1254
+ "epoch": 1.0106431573177417,
1255
+ "grad_norm": 19.231708526611328,
1256
+ "learning_rate": 3.315613770631585e-05,
1257
+ "loss": 0.4202,
1258
+ "step": 88500
1259
+ },
1260
+ {
1261
+ "epoch": 1.0163530056641696,
1262
+ "grad_norm": 17.267953872680664,
1263
+ "learning_rate": 3.306097356720872e-05,
1264
+ "loss": 0.4523,
1265
+ "step": 89000
1266
+ },
1267
+ {
1268
+ "epoch": 1.0220628540105974,
1269
+ "grad_norm": 12.748749732971191,
1270
+ "learning_rate": 3.296580942810159e-05,
1271
+ "loss": 0.4476,
1272
+ "step": 89500
1273
+ },
1274
+ {
1275
+ "epoch": 1.0277727023570253,
1276
+ "grad_norm": 11.158267974853516,
1277
+ "learning_rate": 3.287064528899446e-05,
1278
+ "loss": 0.4306,
1279
+ "step": 90000
1280
+ },
1281
+ {
1282
+ "epoch": 1.0334825507034533,
1283
+ "grad_norm": 1.1574430465698242,
1284
+ "learning_rate": 3.2775481149887325e-05,
1285
+ "loss": 0.4403,
1286
+ "step": 90500
1287
+ },
1288
+ {
1289
+ "epoch": 1.0391923990498813,
1290
+ "grad_norm": 13.545823097229004,
1291
+ "learning_rate": 3.2680317010780194e-05,
1292
+ "loss": 0.4608,
1293
+ "step": 91000
1294
+ },
1295
+ {
1296
+ "epoch": 1.0449022473963092,
1297
+ "grad_norm": 12.51796817779541,
1298
+ "learning_rate": 3.2585152871673064e-05,
1299
+ "loss": 0.4822,
1300
+ "step": 91500
1301
+ },
1302
+ {
1303
+ "epoch": 1.0506120957427372,
1304
+ "grad_norm": 20.29328727722168,
1305
+ "learning_rate": 3.248998873256593e-05,
1306
+ "loss": 0.4565,
1307
+ "step": 92000
1308
+ },
1309
+ {
1310
+ "epoch": 1.056321944089165,
1311
+ "grad_norm": 13.307441711425781,
1312
+ "learning_rate": 3.23948245934588e-05,
1313
+ "loss": 0.4392,
1314
+ "step": 92500
1315
+ },
1316
+ {
1317
+ "epoch": 1.0620317924355929,
1318
+ "grad_norm": 27.682458877563477,
1319
+ "learning_rate": 3.229966045435167e-05,
1320
+ "loss": 0.4473,
1321
+ "step": 93000
1322
+ },
1323
+ {
1324
+ "epoch": 1.0677416407820208,
1325
+ "grad_norm": 9.936578750610352,
1326
+ "learning_rate": 3.220449631524454e-05,
1327
+ "loss": 0.4403,
1328
+ "step": 93500
1329
+ },
1330
+ {
1331
+ "epoch": 1.0734514891284488,
1332
+ "grad_norm": 10.700662612915039,
1333
+ "learning_rate": 3.21093321761374e-05,
1334
+ "loss": 0.4815,
1335
+ "step": 94000
1336
+ },
1337
+ {
1338
+ "epoch": 1.0791613374748767,
1339
+ "grad_norm": 9.94466495513916,
1340
+ "learning_rate": 3.2014168037030276e-05,
1341
+ "loss": 0.4299,
1342
+ "step": 94500
1343
+ },
1344
+ {
1345
+ "epoch": 1.0848711858213045,
1346
+ "grad_norm": 9.911561965942383,
1347
+ "learning_rate": 3.191900389792314e-05,
1348
+ "loss": 0.4421,
1349
+ "step": 95000
1350
+ },
1351
+ {
1352
+ "epoch": 1.0905810341677324,
1353
+ "grad_norm": 2.236788749694824,
1354
+ "learning_rate": 3.182383975881601e-05,
1355
+ "loss": 0.463,
1356
+ "step": 95500
1357
+ },
1358
+ {
1359
+ "epoch": 1.0962908825141604,
1360
+ "grad_norm": 14.238675117492676,
1361
+ "learning_rate": 3.172867561970887e-05,
1362
+ "loss": 0.4827,
1363
+ "step": 96000
1364
+ },
1365
+ {
1366
+ "epoch": 1.1020007308605884,
1367
+ "grad_norm": 11.250436782836914,
1368
+ "learning_rate": 3.163351148060174e-05,
1369
+ "loss": 0.4611,
1370
+ "step": 96500
1371
+ },
1372
+ {
1373
+ "epoch": 1.1077105792070163,
1374
+ "grad_norm": 1.7372729778289795,
1375
+ "learning_rate": 3.153834734149461e-05,
1376
+ "loss": 0.4579,
1377
+ "step": 97000
1378
+ },
1379
+ {
1380
+ "epoch": 1.1134204275534443,
1381
+ "grad_norm": 11.516298294067383,
1382
+ "learning_rate": 3.1443183202387475e-05,
1383
+ "loss": 0.4545,
1384
+ "step": 97500
1385
+ },
1386
+ {
1387
+ "epoch": 1.119130275899872,
1388
+ "grad_norm": 16.49155616760254,
1389
+ "learning_rate": 3.134801906328035e-05,
1390
+ "loss": 0.4741,
1391
+ "step": 98000
1392
+ },
1393
+ {
1394
+ "epoch": 1.1248401242463,
1395
+ "grad_norm": 13.847528457641602,
1396
+ "learning_rate": 3.1252854924173215e-05,
1397
+ "loss": 0.4702,
1398
+ "step": 98500
1399
+ },
1400
+ {
1401
+ "epoch": 1.130549972592728,
1402
+ "grad_norm": 5.64312744140625,
1403
+ "learning_rate": 3.1157690785066084e-05,
1404
+ "loss": 0.4614,
1405
+ "step": 99000
1406
+ },
1407
+ {
1408
+ "epoch": 1.136259820939156,
1409
+ "grad_norm": 3.2206332683563232,
1410
+ "learning_rate": 3.106252664595895e-05,
1411
+ "loss": 0.4795,
1412
+ "step": 99500
1413
+ },
1414
+ {
1415
+ "epoch": 1.1419696692855839,
1416
+ "grad_norm": 11.113608360290527,
1417
+ "learning_rate": 3.0967362506851824e-05,
1418
+ "loss": 0.4482,
1419
+ "step": 100000
1420
+ },
1421
+ {
1422
+ "epoch": 1.1476795176320116,
1423
+ "grad_norm": 3.0740034580230713,
1424
+ "learning_rate": 3.087219836774469e-05,
1425
+ "loss": 0.4814,
1426
+ "step": 100500
1427
+ },
1428
+ {
1429
+ "epoch": 1.1533893659784396,
1430
+ "grad_norm": 13.320266723632812,
1431
+ "learning_rate": 3.077703422863756e-05,
1432
+ "loss": 0.4642,
1433
+ "step": 101000
1434
+ },
1435
+ {
1436
+ "epoch": 1.1590992143248675,
1437
+ "grad_norm": 15.551789283752441,
1438
+ "learning_rate": 3.068187008953043e-05,
1439
+ "loss": 0.4547,
1440
+ "step": 101500
1441
+ },
1442
+ {
1443
+ "epoch": 1.1648090626712955,
1444
+ "grad_norm": 15.967525482177734,
1445
+ "learning_rate": 3.058670595042329e-05,
1446
+ "loss": 0.4496,
1447
+ "step": 102000
1448
+ },
1449
+ {
1450
+ "epoch": 1.1705189110177234,
1451
+ "grad_norm": 19.051559448242188,
1452
+ "learning_rate": 3.049154181131616e-05,
1453
+ "loss": 0.4351,
1454
+ "step": 102500
1455
+ },
1456
+ {
1457
+ "epoch": 1.1762287593641512,
1458
+ "grad_norm": 21.198657989501953,
1459
+ "learning_rate": 3.0396377672209026e-05,
1460
+ "loss": 0.4885,
1461
+ "step": 103000
1462
+ },
1463
+ {
1464
+ "epoch": 1.1819386077105791,
1465
+ "grad_norm": 23.140445709228516,
1466
+ "learning_rate": 3.0301213533101896e-05,
1467
+ "loss": 0.4625,
1468
+ "step": 103500
1469
+ },
1470
+ {
1471
+ "epoch": 1.187648456057007,
1472
+ "grad_norm": 15.462357521057129,
1473
+ "learning_rate": 3.0206049393994762e-05,
1474
+ "loss": 0.4796,
1475
+ "step": 104000
1476
+ },
1477
+ {
1478
+ "epoch": 1.193358304403435,
1479
+ "grad_norm": 20.97214698791504,
1480
+ "learning_rate": 3.0110885254887632e-05,
1481
+ "loss": 0.4318,
1482
+ "step": 104500
1483
+ },
1484
+ {
1485
+ "epoch": 1.199068152749863,
1486
+ "grad_norm": 9.56124210357666,
1487
+ "learning_rate": 3.00157211157805e-05,
1488
+ "loss": 0.4556,
1489
+ "step": 105000
1490
+ },
1491
+ {
1492
+ "epoch": 1.204778001096291,
1493
+ "grad_norm": 9.697257995605469,
1494
+ "learning_rate": 2.992055697667337e-05,
1495
+ "loss": 0.4501,
1496
+ "step": 105500
1497
+ },
1498
+ {
1499
+ "epoch": 1.210487849442719,
1500
+ "grad_norm": 14.990968704223633,
1501
+ "learning_rate": 2.9825392837566235e-05,
1502
+ "loss": 0.4698,
1503
+ "step": 106000
1504
+ },
1505
+ {
1506
+ "epoch": 1.2161976977891467,
1507
+ "grad_norm": 6.702315330505371,
1508
+ "learning_rate": 2.9730228698459105e-05,
1509
+ "loss": 0.4357,
1510
+ "step": 106500
1511
+ },
1512
+ {
1513
+ "epoch": 1.2219075461355746,
1514
+ "grad_norm": 7.727844715118408,
1515
+ "learning_rate": 2.963506455935197e-05,
1516
+ "loss": 0.4397,
1517
+ "step": 107000
1518
+ },
1519
+ {
1520
+ "epoch": 1.2276173944820026,
1521
+ "grad_norm": 0.8975993990898132,
1522
+ "learning_rate": 2.9539900420244838e-05,
1523
+ "loss": 0.4894,
1524
+ "step": 107500
1525
+ },
1526
+ {
1527
+ "epoch": 1.2333272428284305,
1528
+ "grad_norm": 15.067215919494629,
1529
+ "learning_rate": 2.9444736281137707e-05,
1530
+ "loss": 0.4787,
1531
+ "step": 108000
1532
+ },
1533
+ {
1534
+ "epoch": 1.2390370911748585,
1535
+ "grad_norm": 19.666357040405273,
1536
+ "learning_rate": 2.9349572142030574e-05,
1537
+ "loss": 0.4073,
1538
+ "step": 108500
1539
+ },
1540
+ {
1541
+ "epoch": 1.2447469395212862,
1542
+ "grad_norm": 18.050413131713867,
1543
+ "learning_rate": 2.9254408002923444e-05,
1544
+ "loss": 0.4622,
1545
+ "step": 109000
1546
+ },
1547
+ {
1548
+ "epoch": 1.2504567878677142,
1549
+ "grad_norm": 10.36967945098877,
1550
+ "learning_rate": 2.915924386381631e-05,
1551
+ "loss": 0.462,
1552
+ "step": 109500
1553
+ },
1554
+ {
1555
+ "epoch": 1.2561666362141422,
1556
+ "grad_norm": 26.551021575927734,
1557
+ "learning_rate": 2.906407972470918e-05,
1558
+ "loss": 0.4567,
1559
+ "step": 110000
1560
+ },
1561
+ {
1562
+ "epoch": 1.26187648456057,
1563
+ "grad_norm": 5.2075581550598145,
1564
+ "learning_rate": 2.8968915585602046e-05,
1565
+ "loss": 0.4628,
1566
+ "step": 110500
1567
+ },
1568
+ {
1569
+ "epoch": 1.267586332906998,
1570
+ "grad_norm": 10.996859550476074,
1571
+ "learning_rate": 2.8873751446494916e-05,
1572
+ "loss": 0.4525,
1573
+ "step": 111000
1574
+ },
1575
+ {
1576
+ "epoch": 1.2732961812534258,
1577
+ "grad_norm": 14.10279369354248,
1578
+ "learning_rate": 2.8778587307387783e-05,
1579
+ "loss": 0.459,
1580
+ "step": 111500
1581
+ },
1582
+ {
1583
+ "epoch": 1.2790060295998538,
1584
+ "grad_norm": 20.393449783325195,
1585
+ "learning_rate": 2.8683423168280656e-05,
1586
+ "loss": 0.4393,
1587
+ "step": 112000
1588
+ },
1589
+ {
1590
+ "epoch": 1.2847158779462817,
1591
+ "grad_norm": 18.4956111907959,
1592
+ "learning_rate": 2.858825902917352e-05,
1593
+ "loss": 0.4483,
1594
+ "step": 112500
1595
+ },
1596
+ {
1597
+ "epoch": 1.2904257262927097,
1598
+ "grad_norm": 9.594182968139648,
1599
+ "learning_rate": 2.8493094890066385e-05,
1600
+ "loss": 0.465,
1601
+ "step": 113000
1602
+ },
1603
+ {
1604
+ "epoch": 1.2961355746391376,
1605
+ "grad_norm": 27.38096046447754,
1606
+ "learning_rate": 2.8397930750959255e-05,
1607
+ "loss": 0.5035,
1608
+ "step": 113500
1609
+ },
1610
+ {
1611
+ "epoch": 1.3018454229855654,
1612
+ "grad_norm": 21.957666397094727,
1613
+ "learning_rate": 2.830276661185212e-05,
1614
+ "loss": 0.476,
1615
+ "step": 114000
1616
+ },
1617
+ {
1618
+ "epoch": 1.3075552713319933,
1619
+ "grad_norm": 20.858983993530273,
1620
+ "learning_rate": 2.820760247274499e-05,
1621
+ "loss": 0.4349,
1622
+ "step": 114500
1623
+ },
1624
+ {
1625
+ "epoch": 1.3132651196784213,
1626
+ "grad_norm": 5.113755702972412,
1627
+ "learning_rate": 2.8112438333637858e-05,
1628
+ "loss": 0.4476,
1629
+ "step": 115000
1630
+ },
1631
+ {
1632
+ "epoch": 1.3189749680248493,
1633
+ "grad_norm": 15.773002624511719,
1634
+ "learning_rate": 2.801727419453073e-05,
1635
+ "loss": 0.4816,
1636
+ "step": 115500
1637
+ },
1638
+ {
1639
+ "epoch": 1.3246848163712772,
1640
+ "grad_norm": 11.703451156616211,
1641
+ "learning_rate": 2.7922110055423594e-05,
1642
+ "loss": 0.4669,
1643
+ "step": 116000
1644
+ },
1645
+ {
1646
+ "epoch": 1.3303946647177052,
1647
+ "grad_norm": 11.042645454406738,
1648
+ "learning_rate": 2.7826945916316467e-05,
1649
+ "loss": 0.4729,
1650
+ "step": 116500
1651
+ },
1652
+ {
1653
+ "epoch": 1.3361045130641331,
1654
+ "grad_norm": 37.17727279663086,
1655
+ "learning_rate": 2.773178177720933e-05,
1656
+ "loss": 0.4629,
1657
+ "step": 117000
1658
+ },
1659
+ {
1660
+ "epoch": 1.3418143614105609,
1661
+ "grad_norm": 23.688724517822266,
1662
+ "learning_rate": 2.7636617638102203e-05,
1663
+ "loss": 0.46,
1664
+ "step": 117500
1665
+ },
1666
+ {
1667
+ "epoch": 1.3475242097569888,
1668
+ "grad_norm": 0.31684210896492004,
1669
+ "learning_rate": 2.7541453498995067e-05,
1670
+ "loss": 0.4514,
1671
+ "step": 118000
1672
+ },
1673
+ {
1674
+ "epoch": 1.3532340581034168,
1675
+ "grad_norm": 21.230419158935547,
1676
+ "learning_rate": 2.7446289359887933e-05,
1677
+ "loss": 0.4483,
1678
+ "step": 118500
1679
+ },
1680
+ {
1681
+ "epoch": 1.3589439064498448,
1682
+ "grad_norm": 10.135278701782227,
1683
+ "learning_rate": 2.7351125220780803e-05,
1684
+ "loss": 0.4536,
1685
+ "step": 119000
1686
+ },
1687
+ {
1688
+ "epoch": 1.3646537547962727,
1689
+ "grad_norm": 14.558972358703613,
1690
+ "learning_rate": 2.725596108167367e-05,
1691
+ "loss": 0.4647,
1692
+ "step": 119500
1693
+ },
1694
+ {
1695
+ "epoch": 1.3703636031427004,
1696
+ "grad_norm": 16.328582763671875,
1697
+ "learning_rate": 2.7160796942566542e-05,
1698
+ "loss": 0.4732,
1699
+ "step": 120000
1700
+ },
1701
+ {
1702
+ "epoch": 1.3760734514891284,
1703
+ "grad_norm": 29.477685928344727,
1704
+ "learning_rate": 2.7065632803459405e-05,
1705
+ "loss": 0.4579,
1706
+ "step": 120500
1707
+ },
1708
+ {
1709
+ "epoch": 1.3817832998355564,
1710
+ "grad_norm": 19.727144241333008,
1711
+ "learning_rate": 2.697046866435228e-05,
1712
+ "loss": 0.4642,
1713
+ "step": 121000
1714
+ },
1715
+ {
1716
+ "epoch": 1.3874931481819843,
1717
+ "grad_norm": 23.005985260009766,
1718
+ "learning_rate": 2.6875304525245142e-05,
1719
+ "loss": 0.4481,
1720
+ "step": 121500
1721
+ },
1722
+ {
1723
+ "epoch": 1.3932029965284123,
1724
+ "grad_norm": 17.11031723022461,
1725
+ "learning_rate": 2.6780140386138015e-05,
1726
+ "loss": 0.4426,
1727
+ "step": 122000
1728
+ },
1729
+ {
1730
+ "epoch": 1.39891284487484,
1731
+ "grad_norm": 7.422580242156982,
1732
+ "learning_rate": 2.6684976247030878e-05,
1733
+ "loss": 0.4638,
1734
+ "step": 122500
1735
+ },
1736
+ {
1737
+ "epoch": 1.404622693221268,
1738
+ "grad_norm": 16.7518367767334,
1739
+ "learning_rate": 2.658981210792375e-05,
1740
+ "loss": 0.4539,
1741
+ "step": 123000
1742
+ },
1743
+ {
1744
+ "epoch": 1.410332541567696,
1745
+ "grad_norm": 34.35197830200195,
1746
+ "learning_rate": 2.6494647968816618e-05,
1747
+ "loss": 0.4553,
1748
+ "step": 123500
1749
+ },
1750
+ {
1751
+ "epoch": 1.416042389914124,
1752
+ "grad_norm": 26.23828125,
1753
+ "learning_rate": 2.639948382970948e-05,
1754
+ "loss": 0.4667,
1755
+ "step": 124000
1756
+ },
1757
+ {
1758
+ "epoch": 1.4217522382605519,
1759
+ "grad_norm": 0.9646385908126831,
1760
+ "learning_rate": 2.6304319690602354e-05,
1761
+ "loss": 0.4461,
1762
+ "step": 124500
1763
+ },
1764
+ {
1765
+ "epoch": 1.4274620866069796,
1766
+ "grad_norm": 6.215521812438965,
1767
+ "learning_rate": 2.6209155551495217e-05,
1768
+ "loss": 0.4519,
1769
+ "step": 125000
1770
+ },
1771
+ {
1772
+ "epoch": 1.4331719349534076,
1773
+ "grad_norm": 24.888416290283203,
1774
+ "learning_rate": 2.611399141238809e-05,
1775
+ "loss": 0.443,
1776
+ "step": 125500
1777
+ },
1778
+ {
1779
+ "epoch": 1.4388817832998355,
1780
+ "grad_norm": 24.75632667541504,
1781
+ "learning_rate": 2.6018827273280953e-05,
1782
+ "loss": 0.4452,
1783
+ "step": 126000
1784
+ },
1785
+ {
1786
+ "epoch": 1.4445916316462635,
1787
+ "grad_norm": 22.108076095581055,
1788
+ "learning_rate": 2.5923663134173826e-05,
1789
+ "loss": 0.4667,
1790
+ "step": 126500
1791
+ },
1792
+ {
1793
+ "epoch": 1.4503014799926914,
1794
+ "grad_norm": 21.25762939453125,
1795
+ "learning_rate": 2.5828498995066693e-05,
1796
+ "loss": 0.4623,
1797
+ "step": 127000
1798
+ },
1799
+ {
1800
+ "epoch": 1.4560113283391194,
1801
+ "grad_norm": 13.068248748779297,
1802
+ "learning_rate": 2.5733334855959563e-05,
1803
+ "loss": 0.4579,
1804
+ "step": 127500
1805
+ },
1806
+ {
1807
+ "epoch": 1.4617211766855474,
1808
+ "grad_norm": 20.67061996459961,
1809
+ "learning_rate": 2.563817071685243e-05,
1810
+ "loss": 0.4329,
1811
+ "step": 128000
1812
+ },
1813
+ {
1814
+ "epoch": 1.467431025031975,
1815
+ "grad_norm": 1.0450361967086792,
1816
+ "learning_rate": 2.55430065777453e-05,
1817
+ "loss": 0.4527,
1818
+ "step": 128500
1819
+ },
1820
+ {
1821
+ "epoch": 1.473140873378403,
1822
+ "grad_norm": 6.145308017730713,
1823
+ "learning_rate": 2.5447842438638165e-05,
1824
+ "loss": 0.4481,
1825
+ "step": 129000
1826
+ },
1827
+ {
1828
+ "epoch": 1.478850721724831,
1829
+ "grad_norm": 23.964967727661133,
1830
+ "learning_rate": 2.535267829953103e-05,
1831
+ "loss": 0.4289,
1832
+ "step": 129500
1833
+ },
1834
+ {
1835
+ "epoch": 1.484560570071259,
1836
+ "grad_norm": 15.01579475402832,
1837
+ "learning_rate": 2.52575141604239e-05,
1838
+ "loss": 0.4765,
1839
+ "step": 130000
1840
+ },
1841
+ {
1842
+ "epoch": 1.490270418417687,
1843
+ "grad_norm": 4.484251499176025,
1844
+ "learning_rate": 2.5162350021316765e-05,
1845
+ "loss": 0.4484,
1846
+ "step": 130500
1847
+ },
1848
+ {
1849
+ "epoch": 1.4959802667641147,
1850
+ "grad_norm": 30.078880310058594,
1851
+ "learning_rate": 2.5067185882209638e-05,
1852
+ "loss": 0.4509,
1853
+ "step": 131000
1854
+ },
1855
+ {
1856
+ "epoch": 1.5016901151105426,
1857
+ "grad_norm": 5.399165630340576,
1858
+ "learning_rate": 2.4972021743102504e-05,
1859
+ "loss": 0.4442,
1860
+ "step": 131500
1861
+ },
1862
+ {
1863
+ "epoch": 1.5073999634569706,
1864
+ "grad_norm": 12.937898635864258,
1865
+ "learning_rate": 2.4876857603995374e-05,
1866
+ "loss": 0.4247,
1867
+ "step": 132000
1868
+ },
1869
+ {
1870
+ "epoch": 1.5131098118033985,
1871
+ "grad_norm": 13.136408805847168,
1872
+ "learning_rate": 2.478169346488824e-05,
1873
+ "loss": 0.4599,
1874
+ "step": 132500
1875
+ },
1876
+ {
1877
+ "epoch": 1.5188196601498265,
1878
+ "grad_norm": 9.387063026428223,
1879
+ "learning_rate": 2.4686529325781107e-05,
1880
+ "loss": 0.4656,
1881
+ "step": 133000
1882
+ },
1883
+ {
1884
+ "epoch": 1.5245295084962542,
1885
+ "grad_norm": 31.145822525024414,
1886
+ "learning_rate": 2.4591365186673977e-05,
1887
+ "loss": 0.4513,
1888
+ "step": 133500
1889
+ },
1890
+ {
1891
+ "epoch": 1.5302393568426824,
1892
+ "grad_norm": 3.7741284370422363,
1893
+ "learning_rate": 2.4496201047566843e-05,
1894
+ "loss": 0.4563,
1895
+ "step": 134000
1896
+ },
1897
+ {
1898
+ "epoch": 1.5359492051891102,
1899
+ "grad_norm": 16.326873779296875,
1900
+ "learning_rate": 2.4401036908459713e-05,
1901
+ "loss": 0.4577,
1902
+ "step": 134500
1903
+ },
1904
+ {
1905
+ "epoch": 1.5416590535355381,
1906
+ "grad_norm": 30.151098251342773,
1907
+ "learning_rate": 2.430587276935258e-05,
1908
+ "loss": 0.4566,
1909
+ "step": 135000
1910
+ },
1911
+ {
1912
+ "epoch": 1.547368901881966,
1913
+ "grad_norm": 9.370414733886719,
1914
+ "learning_rate": 2.421070863024545e-05,
1915
+ "loss": 0.4265,
1916
+ "step": 135500
1917
+ },
1918
+ {
1919
+ "epoch": 1.5530787502283938,
1920
+ "grad_norm": 7.822052001953125,
1921
+ "learning_rate": 2.4115544491138316e-05,
1922
+ "loss": 0.4513,
1923
+ "step": 136000
1924
+ },
1925
+ {
1926
+ "epoch": 1.558788598574822,
1927
+ "grad_norm": 2.031712055206299,
1928
+ "learning_rate": 2.4020380352031186e-05,
1929
+ "loss": 0.459,
1930
+ "step": 136500
1931
+ },
1932
+ {
1933
+ "epoch": 1.5644984469212497,
1934
+ "grad_norm": 0.6916196346282959,
1935
+ "learning_rate": 2.3925216212924055e-05,
1936
+ "loss": 0.453,
1937
+ "step": 137000
1938
+ },
1939
+ {
1940
+ "epoch": 1.5702082952676777,
1941
+ "grad_norm": 0.808495283126831,
1942
+ "learning_rate": 2.3830052073816922e-05,
1943
+ "loss": 0.4705,
1944
+ "step": 137500
1945
+ },
1946
+ {
1947
+ "epoch": 1.5759181436141056,
1948
+ "grad_norm": 2.1293437480926514,
1949
+ "learning_rate": 2.3734887934709788e-05,
1950
+ "loss": 0.4651,
1951
+ "step": 138000
1952
+ },
1953
+ {
1954
+ "epoch": 1.5816279919605334,
1955
+ "grad_norm": 0.3520614504814148,
1956
+ "learning_rate": 2.3639723795602655e-05,
1957
+ "loss": 0.4488,
1958
+ "step": 138500
1959
+ },
1960
+ {
1961
+ "epoch": 1.5873378403069616,
1962
+ "grad_norm": 18.988222122192383,
1963
+ "learning_rate": 2.3544559656495524e-05,
1964
+ "loss": 0.4701,
1965
+ "step": 139000
1966
+ },
1967
+ {
1968
+ "epoch": 1.5930476886533893,
1969
+ "grad_norm": 27.34604263305664,
1970
+ "learning_rate": 2.344939551738839e-05,
1971
+ "loss": 0.4726,
1972
+ "step": 139500
1973
+ },
1974
+ {
1975
+ "epoch": 1.5987575369998173,
1976
+ "grad_norm": 7.572998046875,
1977
+ "learning_rate": 2.335423137828126e-05,
1978
+ "loss": 0.4262,
1979
+ "step": 140000
1980
+ },
1981
+ {
1982
+ "epoch": 1.6044673853462452,
1983
+ "grad_norm": 10.09691047668457,
1984
+ "learning_rate": 2.3259067239174127e-05,
1985
+ "loss": 0.4632,
1986
+ "step": 140500
1987
+ },
1988
+ {
1989
+ "epoch": 1.610177233692673,
1990
+ "grad_norm": 20.225969314575195,
1991
+ "learning_rate": 2.3163903100066997e-05,
1992
+ "loss": 0.4321,
1993
+ "step": 141000
1994
+ },
1995
+ {
1996
+ "epoch": 1.6158870820391011,
1997
+ "grad_norm": 7.125200271606445,
1998
+ "learning_rate": 2.3068738960959867e-05,
1999
+ "loss": 0.4637,
2000
+ "step": 141500
2001
+ },
2002
+ {
2003
+ "epoch": 1.6215969303855289,
2004
+ "grad_norm": 12.913328170776367,
2005
+ "learning_rate": 2.2973574821852733e-05,
2006
+ "loss": 0.4313,
2007
+ "step": 142000
2008
+ },
2009
+ {
2010
+ "epoch": 1.6273067787319568,
2011
+ "grad_norm": 18.01166534423828,
2012
+ "learning_rate": 2.2878410682745603e-05,
2013
+ "loss": 0.4651,
2014
+ "step": 142500
2015
+ },
2016
+ {
2017
+ "epoch": 1.6330166270783848,
2018
+ "grad_norm": 9.442788124084473,
2019
+ "learning_rate": 2.2783246543638466e-05,
2020
+ "loss": 0.4544,
2021
+ "step": 143000
2022
+ },
2023
+ {
2024
+ "epoch": 1.6387264754248128,
2025
+ "grad_norm": 2.319159746170044,
2026
+ "learning_rate": 2.2688082404531336e-05,
2027
+ "loss": 0.4618,
2028
+ "step": 143500
2029
+ },
2030
+ {
2031
+ "epoch": 1.6444363237712407,
2032
+ "grad_norm": 3.401170015335083,
2033
+ "learning_rate": 2.2592918265424202e-05,
2034
+ "loss": 0.4382,
2035
+ "step": 144000
2036
+ },
2037
+ {
2038
+ "epoch": 1.6501461721176685,
2039
+ "grad_norm": 19.299753189086914,
2040
+ "learning_rate": 2.2497754126317072e-05,
2041
+ "loss": 0.4521,
2042
+ "step": 144500
2043
+ },
2044
+ {
2045
+ "epoch": 1.6558560204640966,
2046
+ "grad_norm": 6.780418395996094,
2047
+ "learning_rate": 2.2402589987209942e-05,
2048
+ "loss": 0.4295,
2049
+ "step": 145000
2050
+ },
2051
+ {
2052
+ "epoch": 1.6615658688105244,
2053
+ "grad_norm": 2.9192967414855957,
2054
+ "learning_rate": 2.230742584810281e-05,
2055
+ "loss": 0.4273,
2056
+ "step": 145500
2057
+ },
2058
+ {
2059
+ "epoch": 1.6672757171569523,
2060
+ "grad_norm": 0.5326074361801147,
2061
+ "learning_rate": 2.2212261708995678e-05,
2062
+ "loss": 0.455,
2063
+ "step": 146000
2064
+ },
2065
+ {
2066
+ "epoch": 1.6729855655033803,
2067
+ "grad_norm": 11.18569278717041,
2068
+ "learning_rate": 2.2117097569888545e-05,
2069
+ "loss": 0.4349,
2070
+ "step": 146500
2071
+ },
2072
+ {
2073
+ "epoch": 1.678695413849808,
2074
+ "grad_norm": 17.610328674316406,
2075
+ "learning_rate": 2.2021933430781415e-05,
2076
+ "loss": 0.458,
2077
+ "step": 147000
2078
+ },
2079
+ {
2080
+ "epoch": 1.6844052621962362,
2081
+ "grad_norm": 14.5678129196167,
2082
+ "learning_rate": 2.192676929167428e-05,
2083
+ "loss": 0.4447,
2084
+ "step": 147500
2085
+ },
2086
+ {
2087
+ "epoch": 1.690115110542664,
2088
+ "grad_norm": 18.26097297668457,
2089
+ "learning_rate": 2.183160515256715e-05,
2090
+ "loss": 0.4437,
2091
+ "step": 148000
2092
+ },
2093
+ {
2094
+ "epoch": 1.695824958889092,
2095
+ "grad_norm": 6.023367404937744,
2096
+ "learning_rate": 2.1736441013460014e-05,
2097
+ "loss": 0.4451,
2098
+ "step": 148500
2099
+ },
2100
+ {
2101
+ "epoch": 1.7015348072355199,
2102
+ "grad_norm": 22.416635513305664,
2103
+ "learning_rate": 2.1641276874352884e-05,
2104
+ "loss": 0.4268,
2105
+ "step": 149000
2106
+ },
2107
+ {
2108
+ "epoch": 1.7072446555819476,
2109
+ "grad_norm": 17.44038963317871,
2110
+ "learning_rate": 2.1546112735245753e-05,
2111
+ "loss": 0.4401,
2112
+ "step": 149500
2113
+ },
2114
+ {
2115
+ "epoch": 1.7129545039283758,
2116
+ "grad_norm": 5.684586524963379,
2117
+ "learning_rate": 2.145094859613862e-05,
2118
+ "loss": 0.4555,
2119
+ "step": 150000
2120
+ },
2121
+ {
2122
+ "epoch": 1.7186643522748035,
2123
+ "grad_norm": 0.5388054251670837,
2124
+ "learning_rate": 2.135578445703149e-05,
2125
+ "loss": 0.4474,
2126
+ "step": 150500
2127
+ },
2128
+ {
2129
+ "epoch": 1.7243742006212315,
2130
+ "grad_norm": 15.469642639160156,
2131
+ "learning_rate": 2.1260620317924356e-05,
2132
+ "loss": 0.4426,
2133
+ "step": 151000
2134
+ },
2135
+ {
2136
+ "epoch": 1.7300840489676594,
2137
+ "grad_norm": 4.757671356201172,
2138
+ "learning_rate": 2.1165456178817226e-05,
2139
+ "loss": 0.4349,
2140
+ "step": 151500
2141
+ },
2142
+ {
2143
+ "epoch": 1.7357938973140872,
2144
+ "grad_norm": 1.850111722946167,
2145
+ "learning_rate": 2.1070292039710092e-05,
2146
+ "loss": 0.4141,
2147
+ "step": 152000
2148
+ },
2149
+ {
2150
+ "epoch": 1.7415037456605154,
2151
+ "grad_norm": 10.210293769836426,
2152
+ "learning_rate": 2.0975127900602962e-05,
2153
+ "loss": 0.4486,
2154
+ "step": 152500
2155
+ },
2156
+ {
2157
+ "epoch": 1.747213594006943,
2158
+ "grad_norm": 9.413440704345703,
2159
+ "learning_rate": 2.087996376149583e-05,
2160
+ "loss": 0.4401,
2161
+ "step": 153000
2162
+ },
2163
+ {
2164
+ "epoch": 1.752923442353371,
2165
+ "grad_norm": 14.099480628967285,
2166
+ "learning_rate": 2.07847996223887e-05,
2167
+ "loss": 0.451,
2168
+ "step": 153500
2169
+ },
2170
+ {
2171
+ "epoch": 1.758633290699799,
2172
+ "grad_norm": 13.435019493103027,
2173
+ "learning_rate": 2.0689635483281565e-05,
2174
+ "loss": 0.4362,
2175
+ "step": 154000
2176
+ },
2177
+ {
2178
+ "epoch": 1.764343139046227,
2179
+ "grad_norm": 9.267539024353027,
2180
+ "learning_rate": 2.059447134417443e-05,
2181
+ "loss": 0.4408,
2182
+ "step": 154500
2183
+ },
2184
+ {
2185
+ "epoch": 1.770052987392655,
2186
+ "grad_norm": 20.24532699584961,
2187
+ "learning_rate": 2.04993072050673e-05,
2188
+ "loss": 0.443,
2189
+ "step": 155000
2190
+ },
2191
+ {
2192
+ "epoch": 1.7757628357390827,
2193
+ "grad_norm": 11.300270080566406,
2194
+ "learning_rate": 2.0404143065960168e-05,
2195
+ "loss": 0.4492,
2196
+ "step": 155500
2197
+ },
2198
+ {
2199
+ "epoch": 1.7814726840855108,
2200
+ "grad_norm": 20.690967559814453,
2201
+ "learning_rate": 2.0308978926853037e-05,
2202
+ "loss": 0.4769,
2203
+ "step": 156000
2204
+ },
2205
+ {
2206
+ "epoch": 1.7871825324319386,
2207
+ "grad_norm": 0.7456624507904053,
2208
+ "learning_rate": 2.0213814787745904e-05,
2209
+ "loss": 0.47,
2210
+ "step": 156500
2211
+ },
2212
+ {
2213
+ "epoch": 1.7928923807783665,
2214
+ "grad_norm": 19.866342544555664,
2215
+ "learning_rate": 2.0118650648638774e-05,
2216
+ "loss": 0.4132,
2217
+ "step": 157000
2218
+ },
2219
+ {
2220
+ "epoch": 1.7986022291247945,
2221
+ "grad_norm": 0.34379786252975464,
2222
+ "learning_rate": 2.002348650953164e-05,
2223
+ "loss": 0.4492,
2224
+ "step": 157500
2225
+ },
2226
+ {
2227
+ "epoch": 1.8043120774712222,
2228
+ "grad_norm": 1.0133875608444214,
2229
+ "learning_rate": 1.992832237042451e-05,
2230
+ "loss": 0.4498,
2231
+ "step": 158000
2232
+ },
2233
+ {
2234
+ "epoch": 1.8100219258176504,
2235
+ "grad_norm": 16.033292770385742,
2236
+ "learning_rate": 1.9833158231317376e-05,
2237
+ "loss": 0.4201,
2238
+ "step": 158500
2239
+ },
2240
+ {
2241
+ "epoch": 1.8157317741640782,
2242
+ "grad_norm": 19.120033264160156,
2243
+ "learning_rate": 1.9737994092210246e-05,
2244
+ "loss": 0.4107,
2245
+ "step": 159000
2246
+ },
2247
+ {
2248
+ "epoch": 1.8214416225105061,
2249
+ "grad_norm": 10.292997360229492,
2250
+ "learning_rate": 1.9642829953103113e-05,
2251
+ "loss": 0.4329,
2252
+ "step": 159500
2253
+ },
2254
+ {
2255
+ "epoch": 1.827151470856934,
2256
+ "grad_norm": 3.8872265815734863,
2257
+ "learning_rate": 1.954766581399598e-05,
2258
+ "loss": 0.4482,
2259
+ "step": 160000
2260
+ },
2261
+ {
2262
+ "epoch": 1.8328613192033618,
2263
+ "grad_norm": 16.315399169921875,
2264
+ "learning_rate": 1.945250167488885e-05,
2265
+ "loss": 0.4434,
2266
+ "step": 160500
2267
+ },
2268
+ {
2269
+ "epoch": 1.83857116754979,
2270
+ "grad_norm": 16.412328720092773,
2271
+ "learning_rate": 1.9357337535781715e-05,
2272
+ "loss": 0.4234,
2273
+ "step": 161000
2274
+ },
2275
+ {
2276
+ "epoch": 1.8442810158962177,
2277
+ "grad_norm": 24.64002799987793,
2278
+ "learning_rate": 1.9262173396674585e-05,
2279
+ "loss": 0.4273,
2280
+ "step": 161500
2281
+ },
2282
+ {
2283
+ "epoch": 1.8499908642426457,
2284
+ "grad_norm": 22.36802101135254,
2285
+ "learning_rate": 1.916700925756745e-05,
2286
+ "loss": 0.429,
2287
+ "step": 162000
2288
+ },
2289
+ {
2290
+ "epoch": 1.8557007125890737,
2291
+ "grad_norm": 19.680646896362305,
2292
+ "learning_rate": 1.907184511846032e-05,
2293
+ "loss": 0.4321,
2294
+ "step": 162500
2295
+ },
2296
+ {
2297
+ "epoch": 1.8614105609355014,
2298
+ "grad_norm": 14.844084739685059,
2299
+ "learning_rate": 1.897668097935319e-05,
2300
+ "loss": 0.4512,
2301
+ "step": 163000
2302
+ },
2303
+ {
2304
+ "epoch": 1.8671204092819296,
2305
+ "grad_norm": 19.201353073120117,
2306
+ "learning_rate": 1.8881516840246058e-05,
2307
+ "loss": 0.439,
2308
+ "step": 163500
2309
+ },
2310
+ {
2311
+ "epoch": 1.8728302576283573,
2312
+ "grad_norm": 0.0863179937005043,
2313
+ "learning_rate": 1.8786352701138927e-05,
2314
+ "loss": 0.4534,
2315
+ "step": 164000
2316
+ },
2317
+ {
2318
+ "epoch": 1.8785401059747853,
2319
+ "grad_norm": 12.593235969543457,
2320
+ "learning_rate": 1.8691188562031794e-05,
2321
+ "loss": 0.4594,
2322
+ "step": 164500
2323
+ },
2324
+ {
2325
+ "epoch": 1.8842499543212132,
2326
+ "grad_norm": 13.752100944519043,
2327
+ "learning_rate": 1.859602442292466e-05,
2328
+ "loss": 0.4483,
2329
+ "step": 165000
2330
+ },
2331
+ {
2332
+ "epoch": 1.8899598026676412,
2333
+ "grad_norm": 12.55861759185791,
2334
+ "learning_rate": 1.8500860283817527e-05,
2335
+ "loss": 0.4421,
2336
+ "step": 165500
2337
+ },
2338
+ {
2339
+ "epoch": 1.8956696510140691,
2340
+ "grad_norm": 16.184236526489258,
2341
+ "learning_rate": 1.8405696144710397e-05,
2342
+ "loss": 0.4286,
2343
+ "step": 166000
2344
+ },
2345
+ {
2346
+ "epoch": 1.9013794993604969,
2347
+ "grad_norm": 7.947886943817139,
2348
+ "learning_rate": 1.8310532005603266e-05,
2349
+ "loss": 0.4466,
2350
+ "step": 166500
2351
+ },
2352
+ {
2353
+ "epoch": 1.907089347706925,
2354
+ "grad_norm": 32.889652252197266,
2355
+ "learning_rate": 1.8215367866496133e-05,
2356
+ "loss": 0.4329,
2357
+ "step": 167000
2358
+ },
2359
+ {
2360
+ "epoch": 1.9127991960533528,
2361
+ "grad_norm": 7.619750499725342,
2362
+ "learning_rate": 1.8120203727389003e-05,
2363
+ "loss": 0.4501,
2364
+ "step": 167500
2365
+ },
2366
+ {
2367
+ "epoch": 1.9185090443997808,
2368
+ "grad_norm": 26.409927368164062,
2369
+ "learning_rate": 1.802503958828187e-05,
2370
+ "loss": 0.4573,
2371
+ "step": 168000
2372
+ },
2373
+ {
2374
+ "epoch": 1.9242188927462087,
2375
+ "grad_norm": 13.146305084228516,
2376
+ "learning_rate": 1.792987544917474e-05,
2377
+ "loss": 0.4233,
2378
+ "step": 168500
2379
+ },
2380
+ {
2381
+ "epoch": 1.9299287410926365,
2382
+ "grad_norm": 0.30020129680633545,
2383
+ "learning_rate": 1.7834711310067605e-05,
2384
+ "loss": 0.4292,
2385
+ "step": 169000
2386
+ },
2387
+ {
2388
+ "epoch": 1.9356385894390646,
2389
+ "grad_norm": 11.028871536254883,
2390
+ "learning_rate": 1.7739547170960475e-05,
2391
+ "loss": 0.4413,
2392
+ "step": 169500
2393
+ },
2394
+ {
2395
+ "epoch": 1.9413484377854924,
2396
+ "grad_norm": 15.962000846862793,
2397
+ "learning_rate": 1.764438303185334e-05,
2398
+ "loss": 0.4185,
2399
+ "step": 170000
2400
+ },
2401
+ {
2402
+ "epoch": 1.9470582861319203,
2403
+ "grad_norm": 20.80706787109375,
2404
+ "learning_rate": 1.7549218892746208e-05,
2405
+ "loss": 0.4288,
2406
+ "step": 170500
2407
+ },
2408
+ {
2409
+ "epoch": 1.9527681344783483,
2410
+ "grad_norm": 10.617173194885254,
2411
+ "learning_rate": 1.7454054753639078e-05,
2412
+ "loss": 0.4106,
2413
+ "step": 171000
2414
+ },
2415
+ {
2416
+ "epoch": 1.958477982824776,
2417
+ "grad_norm": 1.3070753812789917,
2418
+ "learning_rate": 1.7358890614531944e-05,
2419
+ "loss": 0.452,
2420
+ "step": 171500
2421
+ },
2422
+ {
2423
+ "epoch": 1.9641878311712042,
2424
+ "grad_norm": 14.295309066772461,
2425
+ "learning_rate": 1.7263726475424814e-05,
2426
+ "loss": 0.4359,
2427
+ "step": 172000
2428
+ },
2429
+ {
2430
+ "epoch": 1.969897679517632,
2431
+ "grad_norm": 2.0716302394866943,
2432
+ "learning_rate": 1.716856233631768e-05,
2433
+ "loss": 0.4287,
2434
+ "step": 172500
2435
+ },
2436
+ {
2437
+ "epoch": 1.97560752786406,
2438
+ "grad_norm": 18.961374282836914,
2439
+ "learning_rate": 1.707339819721055e-05,
2440
+ "loss": 0.4117,
2441
+ "step": 173000
2442
+ },
2443
+ {
2444
+ "epoch": 1.9813173762104879,
2445
+ "grad_norm": 12.643240928649902,
2446
+ "learning_rate": 1.6978234058103417e-05,
2447
+ "loss": 0.4508,
2448
+ "step": 173500
2449
+ },
2450
+ {
2451
+ "epoch": 1.9870272245569156,
2452
+ "grad_norm": 17.821788787841797,
2453
+ "learning_rate": 1.6883069918996287e-05,
2454
+ "loss": 0.4319,
2455
+ "step": 174000
2456
+ },
2457
+ {
2458
+ "epoch": 1.9927370729033438,
2459
+ "grad_norm": 3.3135876655578613,
2460
+ "learning_rate": 1.6787905779889153e-05,
2461
+ "loss": 0.437,
2462
+ "step": 174500
2463
+ },
2464
+ {
2465
+ "epoch": 1.9984469212497715,
2466
+ "grad_norm": 0.5311791300773621,
2467
+ "learning_rate": 1.6692741640782023e-05,
2468
+ "loss": 0.4289,
2469
+ "step": 175000
2470
+ },
2471
+ {
2472
+ "epoch": 2.0,
2473
+ "eval_f1": 0.8449699871346444,
2474
+ "eval_loss": 0.5234811902046204,
2475
+ "eval_runtime": 49.6423,
2476
+ "eval_samples_per_second": 1764.041,
2477
+ "eval_steps_per_second": 220.518,
2478
+ "step": 175136
2479
+ },
2480
+ {
2481
+ "epoch": 2.0041567695961997,
2482
+ "grad_norm": 1.241629958152771,
2483
+ "learning_rate": 1.659757750167489e-05,
2484
+ "loss": 0.3403,
2485
+ "step": 175500
2486
+ },
2487
+ {
2488
+ "epoch": 2.0098666179426274,
2489
+ "grad_norm": 0.05915088579058647,
2490
+ "learning_rate": 1.6502413362567756e-05,
2491
+ "loss": 0.3111,
2492
+ "step": 176000
2493
+ },
2494
+ {
2495
+ "epoch": 2.015576466289055,
2496
+ "grad_norm": 0.40101704001426697,
2497
+ "learning_rate": 1.6407249223460626e-05,
2498
+ "loss": 0.3222,
2499
+ "step": 176500
2500
+ },
2501
+ {
2502
+ "epoch": 2.0212863146354834,
2503
+ "grad_norm": 12.119406700134277,
2504
+ "learning_rate": 1.6312085084353492e-05,
2505
+ "loss": 0.3219,
2506
+ "step": 177000
2507
+ },
2508
+ {
2509
+ "epoch": 2.026996162981911,
2510
+ "grad_norm": 8.948612213134766,
2511
+ "learning_rate": 1.6216920945246362e-05,
2512
+ "loss": 0.3449,
2513
+ "step": 177500
2514
+ },
2515
+ {
2516
+ "epoch": 2.0327060113283393,
2517
+ "grad_norm": 32.14179611206055,
2518
+ "learning_rate": 1.6121756806139228e-05,
2519
+ "loss": 0.3156,
2520
+ "step": 178000
2521
+ },
2522
+ {
2523
+ "epoch": 2.038415859674767,
2524
+ "grad_norm": 18.450700759887695,
2525
+ "learning_rate": 1.6026592667032098e-05,
2526
+ "loss": 0.3055,
2527
+ "step": 178500
2528
+ },
2529
+ {
2530
+ "epoch": 2.0441257080211948,
2531
+ "grad_norm": 0.17399251461029053,
2532
+ "learning_rate": 1.5931428527924965e-05,
2533
+ "loss": 0.3376,
2534
+ "step": 179000
2535
+ },
2536
+ {
2537
+ "epoch": 2.049835556367623,
2538
+ "grad_norm": 3.5248239040374756,
2539
+ "learning_rate": 1.5836264388817834e-05,
2540
+ "loss": 0.3141,
2541
+ "step": 179500
2542
+ },
2543
+ {
2544
+ "epoch": 2.0555454047140507,
2545
+ "grad_norm": 5.875972747802734,
2546
+ "learning_rate": 1.57411002497107e-05,
2547
+ "loss": 0.3337,
2548
+ "step": 180000
2549
+ },
2550
+ {
2551
+ "epoch": 2.061255253060479,
2552
+ "grad_norm": 19.526226043701172,
2553
+ "learning_rate": 1.564593611060357e-05,
2554
+ "loss": 0.3246,
2555
+ "step": 180500
2556
+ },
2557
+ {
2558
+ "epoch": 2.0669651014069066,
2559
+ "grad_norm": 27.81098747253418,
2560
+ "learning_rate": 1.555077197149644e-05,
2561
+ "loss": 0.3621,
2562
+ "step": 181000
2563
+ },
2564
+ {
2565
+ "epoch": 2.0726749497533348,
2566
+ "grad_norm": 8.206782341003418,
2567
+ "learning_rate": 1.5455607832389303e-05,
2568
+ "loss": 0.375,
2569
+ "step": 181500
2570
+ },
2571
+ {
2572
+ "epoch": 2.0783847980997625,
2573
+ "grad_norm": 16.695953369140625,
2574
+ "learning_rate": 1.5360443693282173e-05,
2575
+ "loss": 0.3388,
2576
+ "step": 182000
2577
+ },
2578
+ {
2579
+ "epoch": 2.0840946464461902,
2580
+ "grad_norm": 17.62847328186035,
2581
+ "learning_rate": 1.526527955417504e-05,
2582
+ "loss": 0.3011,
2583
+ "step": 182500
2584
+ },
2585
+ {
2586
+ "epoch": 2.0898044947926184,
2587
+ "grad_norm": 14.897637367248535,
2588
+ "learning_rate": 1.517011541506791e-05,
2589
+ "loss": 0.3196,
2590
+ "step": 183000
2591
+ },
2592
+ {
2593
+ "epoch": 2.095514343139046,
2594
+ "grad_norm": 37.55620193481445,
2595
+ "learning_rate": 1.5074951275960778e-05,
2596
+ "loss": 0.332,
2597
+ "step": 183500
2598
+ },
2599
+ {
2600
+ "epoch": 2.1012241914854743,
2601
+ "grad_norm": 2.076647996902466,
2602
+ "learning_rate": 1.4979787136853646e-05,
2603
+ "loss": 0.3342,
2604
+ "step": 184000
2605
+ },
2606
+ {
2607
+ "epoch": 2.106934039831902,
2608
+ "grad_norm": 0.15523919463157654,
2609
+ "learning_rate": 1.4884622997746514e-05,
2610
+ "loss": 0.3636,
2611
+ "step": 184500
2612
+ },
2613
+ {
2614
+ "epoch": 2.11264388817833,
2615
+ "grad_norm": 5.540187358856201,
2616
+ "learning_rate": 1.4789458858639382e-05,
2617
+ "loss": 0.3371,
2618
+ "step": 185000
2619
+ },
2620
+ {
2621
+ "epoch": 2.118353736524758,
2622
+ "grad_norm": 29.953880310058594,
2623
+ "learning_rate": 1.469429471953225e-05,
2624
+ "loss": 0.3659,
2625
+ "step": 185500
2626
+ },
2627
+ {
2628
+ "epoch": 2.1240635848711857,
2629
+ "grad_norm": 0.3183216452598572,
2630
+ "learning_rate": 1.4599130580425118e-05,
2631
+ "loss": 0.3335,
2632
+ "step": 186000
2633
+ },
2634
+ {
2635
+ "epoch": 2.129773433217614,
2636
+ "grad_norm": 3.377964735031128,
2637
+ "learning_rate": 1.4503966441317986e-05,
2638
+ "loss": 0.3319,
2639
+ "step": 186500
2640
+ },
2641
+ {
2642
+ "epoch": 2.1354832815640417,
2643
+ "grad_norm": 15.888415336608887,
2644
+ "learning_rate": 1.4408802302210853e-05,
2645
+ "loss": 0.3308,
2646
+ "step": 187000
2647
+ },
2648
+ {
2649
+ "epoch": 2.1411931299104694,
2650
+ "grad_norm": 25.057111740112305,
2651
+ "learning_rate": 1.4313638163103721e-05,
2652
+ "loss": 0.3291,
2653
+ "step": 187500
2654
+ },
2655
+ {
2656
+ "epoch": 2.1469029782568976,
2657
+ "grad_norm": 0.16742169857025146,
2658
+ "learning_rate": 1.4218474023996589e-05,
2659
+ "loss": 0.3543,
2660
+ "step": 188000
2661
+ },
2662
+ {
2663
+ "epoch": 2.1526128266033253,
2664
+ "grad_norm": 15.201740264892578,
2665
+ "learning_rate": 1.4123309884889457e-05,
2666
+ "loss": 0.3118,
2667
+ "step": 188500
2668
+ },
2669
+ {
2670
+ "epoch": 2.1583226749497535,
2671
+ "grad_norm": 1.3998130559921265,
2672
+ "learning_rate": 1.4028145745782325e-05,
2673
+ "loss": 0.3649,
2674
+ "step": 189000
2675
+ },
2676
+ {
2677
+ "epoch": 2.1640325232961812,
2678
+ "grad_norm": 24.985782623291016,
2679
+ "learning_rate": 1.3932981606675193e-05,
2680
+ "loss": 0.3308,
2681
+ "step": 189500
2682
+ },
2683
+ {
2684
+ "epoch": 2.169742371642609,
2685
+ "grad_norm": 4.727104187011719,
2686
+ "learning_rate": 1.3837817467568062e-05,
2687
+ "loss": 0.3369,
2688
+ "step": 190000
2689
+ },
2690
+ {
2691
+ "epoch": 2.175452219989037,
2692
+ "grad_norm": 2.8168013095855713,
2693
+ "learning_rate": 1.374265332846093e-05,
2694
+ "loss": 0.3398,
2695
+ "step": 190500
2696
+ },
2697
+ {
2698
+ "epoch": 2.181162068335465,
2699
+ "grad_norm": 16.57103157043457,
2700
+ "learning_rate": 1.3647489189353798e-05,
2701
+ "loss": 0.3591,
2702
+ "step": 191000
2703
+ },
2704
+ {
2705
+ "epoch": 2.186871916681893,
2706
+ "grad_norm": 10.243144989013672,
2707
+ "learning_rate": 1.3552325050246668e-05,
2708
+ "loss": 0.3187,
2709
+ "step": 191500
2710
+ },
2711
+ {
2712
+ "epoch": 2.192581765028321,
2713
+ "grad_norm": 2.3375298976898193,
2714
+ "learning_rate": 1.3457160911139536e-05,
2715
+ "loss": 0.3373,
2716
+ "step": 192000
2717
+ },
2718
+ {
2719
+ "epoch": 2.1982916133747485,
2720
+ "grad_norm": 38.76338577270508,
2721
+ "learning_rate": 1.33619967720324e-05,
2722
+ "loss": 0.329,
2723
+ "step": 192500
2724
+ },
2725
+ {
2726
+ "epoch": 2.2040014617211767,
2727
+ "grad_norm": 41.014060974121094,
2728
+ "learning_rate": 1.3266832632925269e-05,
2729
+ "loss": 0.3152,
2730
+ "step": 193000
2731
+ },
2732
+ {
2733
+ "epoch": 2.2097113100676045,
2734
+ "grad_norm": 0.435696005821228,
2735
+ "learning_rate": 1.3171668493818137e-05,
2736
+ "loss": 0.3276,
2737
+ "step": 193500
2738
+ },
2739
+ {
2740
+ "epoch": 2.2154211584140326,
2741
+ "grad_norm": 21.630054473876953,
2742
+ "learning_rate": 1.3076504354711005e-05,
2743
+ "loss": 0.3251,
2744
+ "step": 194000
2745
+ },
2746
+ {
2747
+ "epoch": 2.2211310067604604,
2748
+ "grad_norm": 0.03617844730615616,
2749
+ "learning_rate": 1.2981340215603873e-05,
2750
+ "loss": 0.3334,
2751
+ "step": 194500
2752
+ },
2753
+ {
2754
+ "epoch": 2.2268408551068886,
2755
+ "grad_norm": 21.26926612854004,
2756
+ "learning_rate": 1.2886176076496743e-05,
2757
+ "loss": 0.3466,
2758
+ "step": 195000
2759
+ },
2760
+ {
2761
+ "epoch": 2.2325507034533163,
2762
+ "grad_norm": 9.805768966674805,
2763
+ "learning_rate": 1.2791011937389611e-05,
2764
+ "loss": 0.3636,
2765
+ "step": 195500
2766
+ },
2767
+ {
2768
+ "epoch": 2.238260551799744,
2769
+ "grad_norm": 9.061161041259766,
2770
+ "learning_rate": 1.269584779828248e-05,
2771
+ "loss": 0.315,
2772
+ "step": 196000
2773
+ },
2774
+ {
2775
+ "epoch": 2.243970400146172,
2776
+ "grad_norm": 2.999135732650757,
2777
+ "learning_rate": 1.2600683659175347e-05,
2778
+ "loss": 0.3211,
2779
+ "step": 196500
2780
+ },
2781
+ {
2782
+ "epoch": 2.2496802484926,
2783
+ "grad_norm": 33.715641021728516,
2784
+ "learning_rate": 1.2505519520068215e-05,
2785
+ "loss": 0.3271,
2786
+ "step": 197000
2787
+ },
2788
+ {
2789
+ "epoch": 2.255390096839028,
2790
+ "grad_norm": 2.427324056625366,
2791
+ "learning_rate": 1.2410355380961082e-05,
2792
+ "loss": 0.3507,
2793
+ "step": 197500
2794
+ },
2795
+ {
2796
+ "epoch": 2.261099945185456,
2797
+ "grad_norm": 35.71702575683594,
2798
+ "learning_rate": 1.231519124185395e-05,
2799
+ "loss": 0.3091,
2800
+ "step": 198000
2801
+ },
2802
+ {
2803
+ "epoch": 2.2668097935318836,
2804
+ "grad_norm": 18.49312400817871,
2805
+ "learning_rate": 1.2220027102746818e-05,
2806
+ "loss": 0.3381,
2807
+ "step": 198500
2808
+ },
2809
+ {
2810
+ "epoch": 2.272519641878312,
2811
+ "grad_norm": 2.1404948234558105,
2812
+ "learning_rate": 1.2124862963639686e-05,
2813
+ "loss": 0.343,
2814
+ "step": 199000
2815
+ },
2816
+ {
2817
+ "epoch": 2.2782294902247395,
2818
+ "grad_norm": 10.635991096496582,
2819
+ "learning_rate": 1.2029698824532554e-05,
2820
+ "loss": 0.3212,
2821
+ "step": 199500
2822
+ },
2823
+ {
2824
+ "epoch": 2.2839393385711677,
2825
+ "grad_norm": 0.5238596200942993,
2826
+ "learning_rate": 1.1934534685425422e-05,
2827
+ "loss": 0.308,
2828
+ "step": 200000
2829
+ },
2830
+ {
2831
+ "epoch": 2.2896491869175954,
2832
+ "grad_norm": 9.8034029006958,
2833
+ "learning_rate": 1.183937054631829e-05,
2834
+ "loss": 0.3273,
2835
+ "step": 200500
2836
+ },
2837
+ {
2838
+ "epoch": 2.295359035264023,
2839
+ "grad_norm": 26.736309051513672,
2840
+ "learning_rate": 1.1744206407211159e-05,
2841
+ "loss": 0.3145,
2842
+ "step": 201000
2843
+ },
2844
+ {
2845
+ "epoch": 2.3010688836104514,
2846
+ "grad_norm": 15.2411527633667,
2847
+ "learning_rate": 1.1649042268104027e-05,
2848
+ "loss": 0.3511,
2849
+ "step": 201500
2850
+ },
2851
+ {
2852
+ "epoch": 2.306778731956879,
2853
+ "grad_norm": 35.22157669067383,
2854
+ "learning_rate": 1.1553878128996895e-05,
2855
+ "loss": 0.3647,
2856
+ "step": 202000
2857
+ },
2858
+ {
2859
+ "epoch": 2.3124885803033073,
2860
+ "grad_norm": 1.2809624671936035,
2861
+ "learning_rate": 1.1458713989889761e-05,
2862
+ "loss": 0.3193,
2863
+ "step": 202500
2864
+ },
2865
+ {
2866
+ "epoch": 2.318198428649735,
2867
+ "grad_norm": 16.301931381225586,
2868
+ "learning_rate": 1.136354985078263e-05,
2869
+ "loss": 0.3257,
2870
+ "step": 203000
2871
+ },
2872
+ {
2873
+ "epoch": 2.323908276996163,
2874
+ "grad_norm": 17.068782806396484,
2875
+ "learning_rate": 1.1268385711675498e-05,
2876
+ "loss": 0.3408,
2877
+ "step": 203500
2878
+ },
2879
+ {
2880
+ "epoch": 2.329618125342591,
2881
+ "grad_norm": 18.44080352783203,
2882
+ "learning_rate": 1.1173221572568368e-05,
2883
+ "loss": 0.3163,
2884
+ "step": 204000
2885
+ },
2886
+ {
2887
+ "epoch": 2.3353279736890187,
2888
+ "grad_norm": 24.930368423461914,
2889
+ "learning_rate": 1.1078057433461236e-05,
2890
+ "loss": 0.3141,
2891
+ "step": 204500
2892
+ },
2893
+ {
2894
+ "epoch": 2.341037822035447,
2895
+ "grad_norm": 31.808116912841797,
2896
+ "learning_rate": 1.0982893294354102e-05,
2897
+ "loss": 0.3265,
2898
+ "step": 205000
2899
+ },
2900
+ {
2901
+ "epoch": 2.3467476703818746,
2902
+ "grad_norm": 31.13050651550293,
2903
+ "learning_rate": 1.088772915524697e-05,
2904
+ "loss": 0.336,
2905
+ "step": 205500
2906
+ },
2907
+ {
2908
+ "epoch": 2.3524575187283023,
2909
+ "grad_norm": 31.818363189697266,
2910
+ "learning_rate": 1.0792565016139838e-05,
2911
+ "loss": 0.3444,
2912
+ "step": 206000
2913
+ },
2914
+ {
2915
+ "epoch": 2.3581673670747305,
2916
+ "grad_norm": 16.990793228149414,
2917
+ "learning_rate": 1.0697400877032706e-05,
2918
+ "loss": 0.3227,
2919
+ "step": 206500
2920
+ },
2921
+ {
2922
+ "epoch": 2.3638772154211583,
2923
+ "grad_norm": 26.66213035583496,
2924
+ "learning_rate": 1.0602236737925575e-05,
2925
+ "loss": 0.3474,
2926
+ "step": 207000
2927
+ },
2928
+ {
2929
+ "epoch": 2.3695870637675864,
2930
+ "grad_norm": 0.362734854221344,
2931
+ "learning_rate": 1.0507072598818443e-05,
2932
+ "loss": 0.3201,
2933
+ "step": 207500
2934
+ },
2935
+ {
2936
+ "epoch": 2.375296912114014,
2937
+ "grad_norm": 1.2602988481521606,
2938
+ "learning_rate": 1.041190845971131e-05,
2939
+ "loss": 0.3106,
2940
+ "step": 208000
2941
+ },
2942
+ {
2943
+ "epoch": 2.3810067604604424,
2944
+ "grad_norm": 24.976394653320312,
2945
+ "learning_rate": 1.0316744320604179e-05,
2946
+ "loss": 0.3295,
2947
+ "step": 208500
2948
+ },
2949
+ {
2950
+ "epoch": 2.38671660880687,
2951
+ "grad_norm": 14.368584632873535,
2952
+ "learning_rate": 1.0221580181497047e-05,
2953
+ "loss": 0.3172,
2954
+ "step": 209000
2955
+ },
2956
+ {
2957
+ "epoch": 2.392426457153298,
2958
+ "grad_norm": 25.859315872192383,
2959
+ "learning_rate": 1.0126416042389915e-05,
2960
+ "loss": 0.3504,
2961
+ "step": 209500
2962
+ },
2963
+ {
2964
+ "epoch": 2.398136305499726,
2965
+ "grad_norm": 8.047534942626953,
2966
+ "learning_rate": 1.0031251903282783e-05,
2967
+ "loss": 0.3355,
2968
+ "step": 210000
2969
+ },
2970
+ {
2971
+ "epoch": 2.4038461538461537,
2972
+ "grad_norm": 1.6200047731399536,
2973
+ "learning_rate": 9.93608776417565e-06,
2974
+ "loss": 0.359,
2975
+ "step": 210500
2976
+ },
2977
+ {
2978
+ "epoch": 2.409556002192582,
2979
+ "grad_norm": 15.309507369995117,
2980
+ "learning_rate": 9.840923625068518e-06,
2981
+ "loss": 0.3262,
2982
+ "step": 211000
2983
+ },
2984
+ {
2985
+ "epoch": 2.4152658505390097,
2986
+ "grad_norm": 2.4801056385040283,
2987
+ "learning_rate": 9.745759485961386e-06,
2988
+ "loss": 0.3049,
2989
+ "step": 211500
2990
+ },
2991
+ {
2992
+ "epoch": 2.420975698885438,
2993
+ "grad_norm": 15.196561813354492,
2994
+ "learning_rate": 9.650595346854254e-06,
2995
+ "loss": 0.3363,
2996
+ "step": 212000
2997
+ },
2998
+ {
2999
+ "epoch": 2.4266855472318656,
3000
+ "grad_norm": 21.050739288330078,
3001
+ "learning_rate": 9.555431207747122e-06,
3002
+ "loss": 0.3094,
3003
+ "step": 212500
3004
+ },
3005
+ {
3006
+ "epoch": 2.4323953955782933,
3007
+ "grad_norm": 20.074676513671875,
3008
+ "learning_rate": 9.460267068639992e-06,
3009
+ "loss": 0.3472,
3010
+ "step": 213000
3011
+ },
3012
+ {
3013
+ "epoch": 2.4381052439247215,
3014
+ "grad_norm": 9.448333740234375,
3015
+ "learning_rate": 9.365102929532859e-06,
3016
+ "loss": 0.3314,
3017
+ "step": 213500
3018
+ },
3019
+ {
3020
+ "epoch": 2.4438150922711492,
3021
+ "grad_norm": 4.018008232116699,
3022
+ "learning_rate": 9.269938790425727e-06,
3023
+ "loss": 0.3238,
3024
+ "step": 214000
3025
+ },
3026
+ {
3027
+ "epoch": 2.449524940617577,
3028
+ "grad_norm": 36.46582794189453,
3029
+ "learning_rate": 9.174774651318595e-06,
3030
+ "loss": 0.3827,
3031
+ "step": 214500
3032
+ },
3033
+ {
3034
+ "epoch": 2.455234788964005,
3035
+ "grad_norm": 14.752501487731934,
3036
+ "learning_rate": 9.079610512211463e-06,
3037
+ "loss": 0.3254,
3038
+ "step": 215000
3039
+ },
3040
+ {
3041
+ "epoch": 2.460944637310433,
3042
+ "grad_norm": 0.1443174183368683,
3043
+ "learning_rate": 8.984446373104331e-06,
3044
+ "loss": 0.3342,
3045
+ "step": 215500
3046
+ },
3047
+ {
3048
+ "epoch": 2.466654485656861,
3049
+ "grad_norm": 11.833756446838379,
3050
+ "learning_rate": 8.889282233997197e-06,
3051
+ "loss": 0.298,
3052
+ "step": 216000
3053
+ },
3054
+ {
3055
+ "epoch": 2.472364334003289,
3056
+ "grad_norm": 18.4212589263916,
3057
+ "learning_rate": 8.794118094890066e-06,
3058
+ "loss": 0.3479,
3059
+ "step": 216500
3060
+ },
3061
+ {
3062
+ "epoch": 2.478074182349717,
3063
+ "grad_norm": 0.8287930488586426,
3064
+ "learning_rate": 8.698953955782935e-06,
3065
+ "loss": 0.3515,
3066
+ "step": 217000
3067
+ },
3068
+ {
3069
+ "epoch": 2.4837840306961447,
3070
+ "grad_norm": 4.355220317840576,
3071
+ "learning_rate": 8.603789816675804e-06,
3072
+ "loss": 0.3459,
3073
+ "step": 217500
3074
+ },
3075
+ {
3076
+ "epoch": 2.4894938790425725,
3077
+ "grad_norm": 0.2392296940088272,
3078
+ "learning_rate": 8.508625677568672e-06,
3079
+ "loss": 0.3516,
3080
+ "step": 218000
3081
+ },
3082
+ {
3083
+ "epoch": 2.4952037273890006,
3084
+ "grad_norm": 1.1307297945022583,
3085
+ "learning_rate": 8.41346153846154e-06,
3086
+ "loss": 0.3372,
3087
+ "step": 218500
3088
+ },
3089
+ {
3090
+ "epoch": 2.5009135757354284,
3091
+ "grad_norm": 49.16020202636719,
3092
+ "learning_rate": 8.318297399354406e-06,
3093
+ "loss": 0.3329,
3094
+ "step": 219000
3095
+ },
3096
+ {
3097
+ "epoch": 2.506623424081856,
3098
+ "grad_norm": 0.09183380007743835,
3099
+ "learning_rate": 8.223133260247274e-06,
3100
+ "loss": 0.345,
3101
+ "step": 219500
3102
+ },
3103
+ {
3104
+ "epoch": 2.5123332724282843,
3105
+ "grad_norm": 23.092741012573242,
3106
+ "learning_rate": 8.127969121140142e-06,
3107
+ "loss": 0.3545,
3108
+ "step": 220000
3109
+ },
3110
+ {
3111
+ "epoch": 2.5180431207747125,
3112
+ "grad_norm": 2.125396490097046,
3113
+ "learning_rate": 8.03280498203301e-06,
3114
+ "loss": 0.3181,
3115
+ "step": 220500
3116
+ },
3117
+ {
3118
+ "epoch": 2.52375296912114,
3119
+ "grad_norm": 12.284502029418945,
3120
+ "learning_rate": 7.937640842925879e-06,
3121
+ "loss": 0.3343,
3122
+ "step": 221000
3123
+ },
3124
+ {
3125
+ "epoch": 2.529462817467568,
3126
+ "grad_norm": 28.287986755371094,
3127
+ "learning_rate": 7.842476703818747e-06,
3128
+ "loss": 0.3087,
3129
+ "step": 221500
3130
+ },
3131
+ {
3132
+ "epoch": 2.535172665813996,
3133
+ "grad_norm": 3.0625014305114746,
3134
+ "learning_rate": 7.747312564711615e-06,
3135
+ "loss": 0.3052,
3136
+ "step": 222000
3137
+ },
3138
+ {
3139
+ "epoch": 2.540882514160424,
3140
+ "grad_norm": 51.65266036987305,
3141
+ "learning_rate": 7.652148425604483e-06,
3142
+ "loss": 0.3229,
3143
+ "step": 222500
3144
+ },
3145
+ {
3146
+ "epoch": 2.5465923625068516,
3147
+ "grad_norm": 38.66397476196289,
3148
+ "learning_rate": 7.556984286497351e-06,
3149
+ "loss": 0.3471,
3150
+ "step": 223000
3151
+ },
3152
+ {
3153
+ "epoch": 2.55230221085328,
3154
+ "grad_norm": 14.271660804748535,
3155
+ "learning_rate": 7.461820147390219e-06,
3156
+ "loss": 0.3387,
3157
+ "step": 223500
3158
+ },
3159
+ {
3160
+ "epoch": 2.5580120591997075,
3161
+ "grad_norm": 1.0824235677719116,
3162
+ "learning_rate": 7.3666560082830875e-06,
3163
+ "loss": 0.3378,
3164
+ "step": 224000
3165
+ },
3166
+ {
3167
+ "epoch": 2.5637219075461357,
3168
+ "grad_norm": 20.859922409057617,
3169
+ "learning_rate": 7.271491869175955e-06,
3170
+ "loss": 0.3328,
3171
+ "step": 224500
3172
+ },
3173
+ {
3174
+ "epoch": 2.5694317558925635,
3175
+ "grad_norm": 16.753334045410156,
3176
+ "learning_rate": 7.176327730068823e-06,
3177
+ "loss": 0.3613,
3178
+ "step": 225000
3179
+ },
3180
+ {
3181
+ "epoch": 2.5751416042389916,
3182
+ "grad_norm": 6.529033184051514,
3183
+ "learning_rate": 7.081163590961691e-06,
3184
+ "loss": 0.3139,
3185
+ "step": 225500
3186
+ },
3187
+ {
3188
+ "epoch": 2.5808514525854194,
3189
+ "grad_norm": 8.591696739196777,
3190
+ "learning_rate": 6.985999451854559e-06,
3191
+ "loss": 0.3297,
3192
+ "step": 226000
3193
+ },
3194
+ {
3195
+ "epoch": 2.586561300931847,
3196
+ "grad_norm": 20.206890106201172,
3197
+ "learning_rate": 6.890835312747427e-06,
3198
+ "loss": 0.3097,
3199
+ "step": 226500
3200
+ },
3201
+ {
3202
+ "epoch": 2.5922711492782753,
3203
+ "grad_norm": 0.272714763879776,
3204
+ "learning_rate": 6.795671173640295e-06,
3205
+ "loss": 0.3466,
3206
+ "step": 227000
3207
+ },
3208
+ {
3209
+ "epoch": 2.597980997624703,
3210
+ "grad_norm": 2.785320520401001,
3211
+ "learning_rate": 6.700507034533163e-06,
3212
+ "loss": 0.3363,
3213
+ "step": 227500
3214
+ },
3215
+ {
3216
+ "epoch": 2.6036908459711308,
3217
+ "grad_norm": 18.38456153869629,
3218
+ "learning_rate": 6.605342895426031e-06,
3219
+ "loss": 0.2917,
3220
+ "step": 228000
3221
+ },
3222
+ {
3223
+ "epoch": 2.609400694317559,
3224
+ "grad_norm": 11.462959289550781,
3225
+ "learning_rate": 6.510178756318899e-06,
3226
+ "loss": 0.3105,
3227
+ "step": 228500
3228
+ },
3229
+ {
3230
+ "epoch": 2.6151105426639867,
3231
+ "grad_norm": 19.463748931884766,
3232
+ "learning_rate": 6.415014617211768e-06,
3233
+ "loss": 0.3105,
3234
+ "step": 229000
3235
+ },
3236
+ {
3237
+ "epoch": 2.620820391010415,
3238
+ "grad_norm": 14.646320343017578,
3239
+ "learning_rate": 6.319850478104636e-06,
3240
+ "loss": 0.3452,
3241
+ "step": 229500
3242
+ },
3243
+ {
3244
+ "epoch": 2.6265302393568426,
3245
+ "grad_norm": 3.772554636001587,
3246
+ "learning_rate": 6.224686338997503e-06,
3247
+ "loss": 0.3402,
3248
+ "step": 230000
3249
+ },
3250
+ {
3251
+ "epoch": 2.632240087703271,
3252
+ "grad_norm": 13.92446231842041,
3253
+ "learning_rate": 6.129522199890371e-06,
3254
+ "loss": 0.3419,
3255
+ "step": 230500
3256
+ },
3257
+ {
3258
+ "epoch": 2.6379499360496985,
3259
+ "grad_norm": 7.647080898284912,
3260
+ "learning_rate": 6.03435806078324e-06,
3261
+ "loss": 0.3114,
3262
+ "step": 231000
3263
+ },
3264
+ {
3265
+ "epoch": 2.6436597843961263,
3266
+ "grad_norm": 0.2672014534473419,
3267
+ "learning_rate": 5.939193921676108e-06,
3268
+ "loss": 0.3153,
3269
+ "step": 231500
3270
+ },
3271
+ {
3272
+ "epoch": 2.6493696327425544,
3273
+ "grad_norm": 35.36139678955078,
3274
+ "learning_rate": 5.844029782568975e-06,
3275
+ "loss": 0.323,
3276
+ "step": 232000
3277
+ },
3278
+ {
3279
+ "epoch": 2.655079481088982,
3280
+ "grad_norm": 19.425006866455078,
3281
+ "learning_rate": 5.748865643461843e-06,
3282
+ "loss": 0.2695,
3283
+ "step": 232500
3284
+ },
3285
+ {
3286
+ "epoch": 2.6607893294354104,
3287
+ "grad_norm": 12.74644660949707,
3288
+ "learning_rate": 5.653701504354711e-06,
3289
+ "loss": 0.343,
3290
+ "step": 233000
3291
+ },
3292
+ {
3293
+ "epoch": 2.666499177781838,
3294
+ "grad_norm": 15.746671676635742,
3295
+ "learning_rate": 5.558537365247579e-06,
3296
+ "loss": 0.3449,
3297
+ "step": 233500
3298
+ },
3299
+ {
3300
+ "epoch": 2.6722090261282663,
3301
+ "grad_norm": 34.70107650756836,
3302
+ "learning_rate": 5.4633732261404475e-06,
3303
+ "loss": 0.3249,
3304
+ "step": 234000
3305
+ },
3306
+ {
3307
+ "epoch": 2.677918874474694,
3308
+ "grad_norm": 3.9587759971618652,
3309
+ "learning_rate": 5.368209087033315e-06,
3310
+ "loss": 0.3393,
3311
+ "step": 234500
3312
+ },
3313
+ {
3314
+ "epoch": 2.6836287228211217,
3315
+ "grad_norm": 21.72762107849121,
3316
+ "learning_rate": 5.273044947926183e-06,
3317
+ "loss": 0.3057,
3318
+ "step": 235000
3319
+ },
3320
+ {
3321
+ "epoch": 2.68933857116755,
3322
+ "grad_norm": 0.1998819261789322,
3323
+ "learning_rate": 5.177880808819052e-06,
3324
+ "loss": 0.3137,
3325
+ "step": 235500
3326
+ },
3327
+ {
3328
+ "epoch": 2.6950484195139777,
3329
+ "grad_norm": 38.329036712646484,
3330
+ "learning_rate": 5.082716669711919e-06,
3331
+ "loss": 0.3267,
3332
+ "step": 236000
3333
+ },
3334
+ {
3335
+ "epoch": 2.7007582678604054,
3336
+ "grad_norm": 0.8766566514968872,
3337
+ "learning_rate": 4.987552530604787e-06,
3338
+ "loss": 0.3014,
3339
+ "step": 236500
3340
+ },
3341
+ {
3342
+ "epoch": 2.7064681162068336,
3343
+ "grad_norm": 40.94557189941406,
3344
+ "learning_rate": 4.8923883914976554e-06,
3345
+ "loss": 0.3035,
3346
+ "step": 237000
3347
+ },
3348
+ {
3349
+ "epoch": 2.7121779645532613,
3350
+ "grad_norm": 37.07609558105469,
3351
+ "learning_rate": 4.7972242523905236e-06,
3352
+ "loss": 0.3285,
3353
+ "step": 237500
3354
+ },
3355
+ {
3356
+ "epoch": 2.7178878128996895,
3357
+ "grad_norm": 26.342134475708008,
3358
+ "learning_rate": 4.702060113283392e-06,
3359
+ "loss": 0.3072,
3360
+ "step": 238000
3361
+ },
3362
+ {
3363
+ "epoch": 2.7235976612461172,
3364
+ "grad_norm": 3.3836374282836914,
3365
+ "learning_rate": 4.60689597417626e-06,
3366
+ "loss": 0.3317,
3367
+ "step": 238500
3368
+ },
3369
+ {
3370
+ "epoch": 2.7293075095925454,
3371
+ "grad_norm": 1.3567613363265991,
3372
+ "learning_rate": 4.511731835069127e-06,
3373
+ "loss": 0.3153,
3374
+ "step": 239000
3375
+ },
3376
+ {
3377
+ "epoch": 2.735017357938973,
3378
+ "grad_norm": 4.745734691619873,
3379
+ "learning_rate": 4.416567695961995e-06,
3380
+ "loss": 0.3093,
3381
+ "step": 239500
3382
+ },
3383
+ {
3384
+ "epoch": 2.740727206285401,
3385
+ "grad_norm": 22.728782653808594,
3386
+ "learning_rate": 4.321403556854863e-06,
3387
+ "loss": 0.2851,
3388
+ "step": 240000
3389
+ },
3390
+ {
3391
+ "epoch": 2.746437054631829,
3392
+ "grad_norm": 5.786905765533447,
3393
+ "learning_rate": 4.2262394177477315e-06,
3394
+ "loss": 0.3154,
3395
+ "step": 240500
3396
+ },
3397
+ {
3398
+ "epoch": 2.752146902978257,
3399
+ "grad_norm": 18.029577255249023,
3400
+ "learning_rate": 4.1310752786406e-06,
3401
+ "loss": 0.3412,
3402
+ "step": 241000
3403
+ },
3404
+ {
3405
+ "epoch": 2.7578567513246846,
3406
+ "grad_norm": 22.60212516784668,
3407
+ "learning_rate": 4.035911139533467e-06,
3408
+ "loss": 0.3242,
3409
+ "step": 241500
3410
+ },
3411
+ {
3412
+ "epoch": 2.7635665996711127,
3413
+ "grad_norm": 25.419410705566406,
3414
+ "learning_rate": 3.940747000426336e-06,
3415
+ "loss": 0.334,
3416
+ "step": 242000
3417
+ },
3418
+ {
3419
+ "epoch": 2.769276448017541,
3420
+ "grad_norm": 48.676761627197266,
3421
+ "learning_rate": 3.845582861319204e-06,
3422
+ "loss": 0.3336,
3423
+ "step": 242500
3424
+ },
3425
+ {
3426
+ "epoch": 2.7749862963639687,
3427
+ "grad_norm": 1.694673776626587,
3428
+ "learning_rate": 3.7504187222120713e-06,
3429
+ "loss": 0.3078,
3430
+ "step": 243000
3431
+ },
3432
+ {
3433
+ "epoch": 2.7806961447103964,
3434
+ "grad_norm": 19.72800064086914,
3435
+ "learning_rate": 3.65525458310494e-06,
3436
+ "loss": 0.3137,
3437
+ "step": 243500
3438
+ },
3439
+ {
3440
+ "epoch": 2.7864059930568246,
3441
+ "grad_norm": 20.324703216552734,
3442
+ "learning_rate": 3.560090443997808e-06,
3443
+ "loss": 0.3484,
3444
+ "step": 244000
3445
+ },
3446
+ {
3447
+ "epoch": 2.7921158414032523,
3448
+ "grad_norm": 5.6303019523620605,
3449
+ "learning_rate": 3.4649263048906757e-06,
3450
+ "loss": 0.3124,
3451
+ "step": 244500
3452
+ },
3453
+ {
3454
+ "epoch": 2.79782568974968,
3455
+ "grad_norm": 13.881755828857422,
3456
+ "learning_rate": 3.369762165783544e-06,
3457
+ "loss": 0.305,
3458
+ "step": 245000
3459
+ },
3460
+ {
3461
+ "epoch": 2.8035355380961082,
3462
+ "grad_norm": 0.262673944234848,
3463
+ "learning_rate": 3.2745980266764115e-06,
3464
+ "loss": 0.3246,
3465
+ "step": 245500
3466
+ },
3467
+ {
3468
+ "epoch": 2.809245386442536,
3469
+ "grad_norm": 0.8281906843185425,
3470
+ "learning_rate": 3.1794338875692796e-06,
3471
+ "loss": 0.3143,
3472
+ "step": 246000
3473
+ },
3474
+ {
3475
+ "epoch": 2.814955234788964,
3476
+ "grad_norm": 25.29074478149414,
3477
+ "learning_rate": 3.0842697484621473e-06,
3478
+ "loss": 0.3062,
3479
+ "step": 246500
3480
+ },
3481
+ {
3482
+ "epoch": 2.820665083135392,
3483
+ "grad_norm": 54.874996185302734,
3484
+ "learning_rate": 2.989105609355016e-06,
3485
+ "loss": 0.2947,
3486
+ "step": 247000
3487
+ },
3488
+ {
3489
+ "epoch": 2.82637493148182,
3490
+ "grad_norm": 51.22450256347656,
3491
+ "learning_rate": 2.8939414702478836e-06,
3492
+ "loss": 0.3125,
3493
+ "step": 247500
3494
+ },
3495
+ {
3496
+ "epoch": 2.832084779828248,
3497
+ "grad_norm": 2.700890064239502,
3498
+ "learning_rate": 2.7987773311407517e-06,
3499
+ "loss": 0.3114,
3500
+ "step": 248000
3501
+ },
3502
+ {
3503
+ "epoch": 2.8377946281746755,
3504
+ "grad_norm": 41.62983322143555,
3505
+ "learning_rate": 2.70361319203362e-06,
3506
+ "loss": 0.3206,
3507
+ "step": 248500
3508
+ },
3509
+ {
3510
+ "epoch": 2.8435044765211037,
3511
+ "grad_norm": 27.412126541137695,
3512
+ "learning_rate": 2.608449052926488e-06,
3513
+ "loss": 0.315,
3514
+ "step": 249000
3515
+ },
3516
+ {
3517
+ "epoch": 2.8492143248675315,
3518
+ "grad_norm": 32.21315002441406,
3519
+ "learning_rate": 2.5132849138193557e-06,
3520
+ "loss": 0.3122,
3521
+ "step": 249500
3522
+ },
3523
+ {
3524
+ "epoch": 2.854924173213959,
3525
+ "grad_norm": 8.243450164794922,
3526
+ "learning_rate": 2.418120774712224e-06,
3527
+ "loss": 0.3231,
3528
+ "step": 250000
3529
+ },
3530
+ {
3531
+ "epoch": 2.8606340215603874,
3532
+ "grad_norm": 0.3466567099094391,
3533
+ "learning_rate": 2.322956635605092e-06,
3534
+ "loss": 0.3311,
3535
+ "step": 250500
3536
+ },
3537
+ {
3538
+ "epoch": 2.866343869906815,
3539
+ "grad_norm": 7.0024590492248535,
3540
+ "learning_rate": 2.2277924964979596e-06,
3541
+ "loss": 0.2668,
3542
+ "step": 251000
3543
+ },
3544
+ {
3545
+ "epoch": 2.8720537182532433,
3546
+ "grad_norm": 14.889925956726074,
3547
+ "learning_rate": 2.1326283573908278e-06,
3548
+ "loss": 0.2951,
3549
+ "step": 251500
3550
+ },
3551
+ {
3552
+ "epoch": 2.877763566599671,
3553
+ "grad_norm": 28.448863983154297,
3554
+ "learning_rate": 2.037464218283696e-06,
3555
+ "loss": 0.3317,
3556
+ "step": 252000
3557
+ },
3558
+ {
3559
+ "epoch": 2.883473414946099,
3560
+ "grad_norm": 30.778017044067383,
3561
+ "learning_rate": 1.942300079176564e-06,
3562
+ "loss": 0.3445,
3563
+ "step": 252500
3564
+ },
3565
+ {
3566
+ "epoch": 2.889183263292527,
3567
+ "grad_norm": 2.7402122020721436,
3568
+ "learning_rate": 1.847135940069432e-06,
3569
+ "loss": 0.2826,
3570
+ "step": 253000
3571
+ },
3572
+ {
3573
+ "epoch": 2.8948931116389547,
3574
+ "grad_norm": 14.787317276000977,
3575
+ "learning_rate": 1.7519718009622998e-06,
3576
+ "loss": 0.3266,
3577
+ "step": 253500
3578
+ },
3579
+ {
3580
+ "epoch": 2.900602959985383,
3581
+ "grad_norm": 1.2082672119140625,
3582
+ "learning_rate": 1.656807661855168e-06,
3583
+ "loss": 0.3143,
3584
+ "step": 254000
3585
+ },
3586
+ {
3587
+ "epoch": 2.9063128083318106,
3588
+ "grad_norm": 1.1399238109588623,
3589
+ "learning_rate": 1.5616435227480359e-06,
3590
+ "loss": 0.2956,
3591
+ "step": 254500
3592
+ },
3593
+ {
3594
+ "epoch": 2.912022656678239,
3595
+ "grad_norm": 25.56263542175293,
3596
+ "learning_rate": 1.4664793836409038e-06,
3597
+ "loss": 0.3339,
3598
+ "step": 255000
3599
+ },
3600
+ {
3601
+ "epoch": 2.9177325050246665,
3602
+ "grad_norm": 6.127387046813965,
3603
+ "learning_rate": 1.371315244533772e-06,
3604
+ "loss": 0.3233,
3605
+ "step": 255500
3606
+ },
3607
+ {
3608
+ "epoch": 2.9234423533710947,
3609
+ "grad_norm": 22.642745971679688,
3610
+ "learning_rate": 1.2761511054266398e-06,
3611
+ "loss": 0.288,
3612
+ "step": 256000
3613
+ },
3614
+ {
3615
+ "epoch": 2.9291522017175224,
3616
+ "grad_norm": 13.069123268127441,
3617
+ "learning_rate": 1.180986966319508e-06,
3618
+ "loss": 0.3296,
3619
+ "step": 256500
3620
+ },
3621
+ {
3622
+ "epoch": 2.93486205006395,
3623
+ "grad_norm": 12.685135841369629,
3624
+ "learning_rate": 1.0858228272123759e-06,
3625
+ "loss": 0.3205,
3626
+ "step": 257000
3627
+ },
3628
+ {
3629
+ "epoch": 2.9405718984103784,
3630
+ "grad_norm": 15.252617835998535,
3631
+ "learning_rate": 9.90658688105244e-07,
3632
+ "loss": 0.2777,
3633
+ "step": 257500
3634
+ },
3635
+ {
3636
+ "epoch": 2.946281746756806,
3637
+ "grad_norm": 29.784408569335938,
3638
+ "learning_rate": 8.954945489981119e-07,
3639
+ "loss": 0.3046,
3640
+ "step": 258000
3641
+ },
3642
+ {
3643
+ "epoch": 2.951991595103234,
3644
+ "grad_norm": 26.255334854125977,
3645
+ "learning_rate": 8.003304098909801e-07,
3646
+ "loss": 0.3466,
3647
+ "step": 258500
3648
+ },
3649
+ {
3650
+ "epoch": 2.957701443449662,
3651
+ "grad_norm": 5.114432334899902,
3652
+ "learning_rate": 7.05166270783848e-07,
3653
+ "loss": 0.2932,
3654
+ "step": 259000
3655
+ },
3656
+ {
3657
+ "epoch": 2.9634112917960898,
3658
+ "grad_norm": 10.378493309020996,
3659
+ "learning_rate": 6.10002131676716e-07,
3660
+ "loss": 0.344,
3661
+ "step": 259500
3662
+ },
3663
+ {
3664
+ "epoch": 2.969121140142518,
3665
+ "grad_norm": 3.339512825012207,
3666
+ "learning_rate": 5.14837992569584e-07,
3667
+ "loss": 0.3009,
3668
+ "step": 260000
3669
+ },
3670
+ {
3671
+ "epoch": 2.9748309884889457,
3672
+ "grad_norm": 0.3262183666229248,
3673
+ "learning_rate": 4.1967385346245204e-07,
3674
+ "loss": 0.3004,
3675
+ "step": 260500
3676
+ },
3677
+ {
3678
+ "epoch": 2.980540836835374,
3679
+ "grad_norm": 14.634820938110352,
3680
+ "learning_rate": 3.245097143553201e-07,
3681
+ "loss": 0.3348,
3682
+ "step": 261000
3683
+ },
3684
+ {
3685
+ "epoch": 2.9862506851818016,
3686
+ "grad_norm": 33.47109603881836,
3687
+ "learning_rate": 2.293455752481881e-07,
3688
+ "loss": 0.3198,
3689
+ "step": 261500
3690
+ },
3691
+ {
3692
+ "epoch": 2.9919605335282293,
3693
+ "grad_norm": 23.320194244384766,
3694
+ "learning_rate": 1.341814361410561e-07,
3695
+ "loss": 0.2931,
3696
+ "step": 262000
3697
+ },
3698
+ {
3699
+ "epoch": 2.9976703818746575,
3700
+ "grad_norm": 34.757747650146484,
3701
+ "learning_rate": 3.9017297033924116e-08,
3702
+ "loss": 0.3016,
3703
+ "step": 262500
3704
+ },
3705
+ {
3706
+ "epoch": 3.0,
3707
+ "eval_f1": 0.8483668821316216,
3708
+ "eval_loss": 0.6198369264602661,
3709
+ "eval_runtime": 49.7688,
3710
+ "eval_samples_per_second": 1759.556,
3711
+ "eval_steps_per_second": 219.957,
3712
+ "step": 262704
3713
+ },
3714
+ {
3715
+ "epoch": 3.0,
3716
+ "step": 262704,
3717
+ "total_flos": 3.4624973235879936e+16,
3718
+ "train_loss": 0.47607343616087144,
3719
+ "train_runtime": 4470.8117,
3720
+ "train_samples_per_second": 470.078,
3721
+ "train_steps_per_second": 58.76
3722
+ }
3723
+ ],
3724
+ "logging_steps": 500,
3725
+ "max_steps": 262704,
3726
+ "num_input_tokens_seen": 0,
3727
+ "num_train_epochs": 3,
3728
+ "save_steps": 500,
3729
+ "stateful_callbacks": {
3730
+ "TrainerControl": {
3731
+ "args": {
3732
+ "should_epoch_stop": false,
3733
+ "should_evaluate": false,
3734
+ "should_log": false,
3735
+ "should_save": true,
3736
+ "should_training_stop": true
3737
+ },
3738
+ "attributes": {}
3739
+ }
3740
+ },
3741
+ "total_flos": 3.4624973235879936e+16,
3742
+ "train_batch_size": 8,
3743
+ "trial_name": null,
3744
+ "trial_params": null
3745
+ }
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:25e79e814556f47881069ae29dcd9c7e4e2fa46664ba4e52441d8bf6aed1b1d6
3
+ size 5201
vocab.txt ADDED
The diff for this file is too large to render. See raw diff