Hugging Face's logo

Spaces:
distributed
/
model_convergence
Sleeping

App Files Community
kmfoda commited on
Commit
8023a42
·
1 Parent(s): 4de26b2

Update results

Browse files
Files changed (3) hide show
  1. evaluate.py +2 -2
  2. requirements.txt +2 -1
  3. results.json +1605 -0
evaluate.py CHANGED
@@ -10,7 +10,7 @@ from transformers import AutoModelForCausalLM, AutoTokenizer
10
  device = "cuda"
11
  test_indices_length = 1000
12
 
13
- models = ["distributed/optimized-gpt2-250m", "distributed/optimized-gpt2-250m-v0.1.3", "distributed/optimized-gpt2-250m-v0.1.1", "distributed/gpt2-94m"]
14
 
15
  if os.path.exists("results.json"):
16
  with open('results.json', 'r') as file:
@@ -23,7 +23,7 @@ for model_name in models:
23
  if (model_name not in results.keys()):
24
  results[model_name] = {}
25
 
26
- tokenizer = AutoTokenizer.from_pretrained(model_name, trust_remote_code=True)
27
 
28
  refs = list_repo_refs(model_name, repo_type="model")
29
  global_epoch = max([int(tag.name) for tag in refs.tags]) if refs.tags else None
 
10
  device = "cuda"
11
  test_indices_length = 1000
12
 
13
+ models = ["distributed/optimized-gpt2-500m", "distributed/optimized-gpt2-250m", "distributed/optimized-gpt2-250m-v0.1.3", "distributed/optimized-gpt2-250m-v0.1.1", "distributed/gpt2-94m"]
14
 
15
  if os.path.exists("results.json"):
16
  with open('results.json', 'r') as file:
 
23
  if (model_name not in results.keys()):
24
  results[model_name] = {}
25
 
26
+ tokenizer = AutoTokenizer.from_pretrained("distributed/optimized-gpt2-250m", trust_remote_code=True)
27
 
28
  refs = list_repo_refs(model_name, repo_type="model")
29
  global_epoch = max([int(tag.name) for tag in refs.tags]) if refs.tags else None
requirements.txt CHANGED
@@ -1,2 +1,3 @@
1
  -e git+https://github.com/KMFODA/DistributedTraining@85fa80558a26bb8612bbd60d21cb38fee777afaf#egg=distributed_training
2
- transformers==4.39.3
 
 
1
  -e git+https://github.com/KMFODA/DistributedTraining@85fa80558a26bb8612bbd60d21cb38fee777afaf#egg=distributed_training
2
+ transformers==4.39.3
3
+ gradio
results.json CHANGED
@@ -1,4 +1,1609 @@
1
  {
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  "distributed/optimized-gpt2-250m": {
3
  "main-net": {
4
  "0": [
 
1
  {
2
+ "distributed/optimized-gpt2-500m": {
3
+ "main-net": {
4
+ "0": [
5
+ 11.02587887554821
6
+ ],
7
+ "1": [
8
+ 11.012336076252044
9
+ ],
10
+ "2": [
11
+ 10.942250209724259
12
+ ],
13
+ "3": [
14
+ 10.789852518838812
15
+ ],
16
+ "4": [
17
+ 10.591135017333492
18
+ ],
19
+ "5": [
20
+ 10.381960663302191
21
+ ],
22
+ "6": [
23
+ 10.204604120760395
24
+ ],
25
+ "7": [
26
+ 9.99313148655757
27
+ ],
28
+ "8": [
29
+ 9.808594073348802
30
+ ],
31
+ "9": [
32
+ 9.699155184017714
33
+ ],
34
+ "10": [
35
+ 9.538408678294134
36
+ ],
37
+ "11": [
38
+ 9.459038364137331
39
+ ],
40
+ "12": [
41
+ 9.341624254305687
42
+ ],
43
+ "13": [
44
+ 9.269227776676416
45
+ ],
46
+ "14": [
47
+ 9.215532861006887
48
+ ],
49
+ "15": [
50
+ 9.188852574090538
51
+ ],
52
+ "16": [
53
+ 9.146546052052425
54
+ ],
55
+ "17": [
56
+ 9.138851456937537
57
+ ],
58
+ "18": [
59
+ 9.126462873584495
60
+ ],
61
+ "19": [
62
+ 9.056797283705665
63
+ ],
64
+ "20": [
65
+ 9.032494962677475
66
+ ],
67
+ "21": [
68
+ 8.928327749987117
69
+ ],
70
+ "22": [
71
+ 9.23310801814404
72
+ ],
73
+ "23": [
74
+ 9.843688889926659
75
+ ],
76
+ "24": [
77
+ 9.047534827495245
78
+ ],
79
+ "25": [
80
+ 8.903008035686021
81
+ ],
82
+ "26": [
83
+ 9.110728626408854
84
+ ],
85
+ "27": [
86
+ 9.049401350799037
87
+ ],
88
+ "28": [
89
+ 9.06801783798525
90
+ ],
91
+ "29": [
92
+ 8.961993099038118
93
+ ],
94
+ "30": [
95
+ 8.797927968422727
96
+ ],
97
+ "31": [
98
+ 8.726444166783857
99
+ ],
100
+ "32": [
101
+ 8.678951541344802
102
+ ]
103
+ },
104
+ "baseline": {
105
+ "0": [
106
+ 10.95511245727539
107
+ ],
108
+ "2": [
109
+ 10.903534889221191
110
+ ],
111
+ "3": [
112
+ 10.851415634155273
113
+ ],
114
+ "4": [
115
+ 10.784759521484375
116
+ ],
117
+ "5": [
118
+ 10.705351829528809
119
+ ],
120
+ "6": [
121
+ 10.611644744873047
122
+ ],
123
+ "7": [
124
+ 10.5181245803833
125
+ ],
126
+ "8": [
127
+ 10.423306465148926
128
+ ],
129
+ "9": [
130
+ 10.328965187072754
131
+ ],
132
+ "10": [
133
+ 10.240520477294922
134
+ ],
135
+ "11": [
136
+ 10.151151657104492
137
+ ],
138
+ "12": [
139
+ 10.068592071533203
140
+ ],
141
+ "13": [
142
+ 9.988373756408691
143
+ ],
144
+ "14": [
145
+ 9.913373947143555
146
+ ],
147
+ "15": [
148
+ 9.849650382995605
149
+ ],
150
+ "16": [
151
+ 9.793644905090332
152
+ ],
153
+ "17": [
154
+ 9.736211776733398
155
+ ],
156
+ "18": [
157
+ 9.68893814086914
158
+ ],
159
+ "19": [
160
+ 9.644975662231445
161
+ ],
162
+ "20": [
163
+ 9.604911804199219
164
+ ],
165
+ "21": [
166
+ 9.572737693786621
167
+ ],
168
+ "22": [
169
+ 9.539426803588867
170
+ ],
171
+ "23": [
172
+ 9.509159088134766
173
+ ],
174
+ "24": [
175
+ 9.48029899597168
176
+ ],
177
+ "25": [
178
+ 9.454708099365234
179
+ ],
180
+ "26": [
181
+ 9.426265716552734
182
+ ],
183
+ "27": [
184
+ 9.393267631530762
185
+ ],
186
+ "28": [
187
+ 9.358389854431152
188
+ ],
189
+ "29": [
190
+ 9.318961143493652
191
+ ],
192
+ "31": [
193
+ 9.240694999694824
194
+ ],
195
+ "32": [
196
+ 9.210143089294434
197
+ ],
198
+ "33": [
199
+ 9.161873817443848
200
+ ],
201
+ "34": [
202
+ 9.12850570678711
203
+ ],
204
+ "35": [
205
+ 9.085844993591309
206
+ ],
207
+ "36": [
208
+ 9.042040824890137
209
+ ],
210
+ "37": [
211
+ 9.001519203186035
212
+ ],
213
+ "38": [
214
+ 8.958778381347656
215
+ ],
216
+ "39": [
217
+ 8.906691551208496
218
+ ],
219
+ "40": [
220
+ 8.862005233764648
221
+ ],
222
+ "41": [
223
+ 8.820011138916016
224
+ ],
225
+ "42": [
226
+ 8.769862174987793
227
+ ],
228
+ "44": [
229
+ 8.681952476501465
230
+ ],
231
+ "45": [
232
+ 8.628429412841797
233
+ ],
234
+ "46": [
235
+ 8.596380233764648
236
+ ],
237
+ "47": [
238
+ 8.55947494506836
239
+ ],
240
+ "48": [
241
+ 8.503355979919434
242
+ ],
243
+ "49": [
244
+ 8.464351654052734
245
+ ],
246
+ "50": [
247
+ 8.425146102905273
248
+ ],
249
+ "51": [
250
+ 8.37761116027832
251
+ ],
252
+ "52": [
253
+ 8.338064193725586
254
+ ],
255
+ "53": [
256
+ 8.301886558532715
257
+ ],
258
+ "54": [
259
+ 8.253142356872559
260
+ ],
261
+ "55": [
262
+ 8.213857650756836
263
+ ],
264
+ "56": [
265
+ 8.18204402923584
266
+ ],
267
+ "58": [
268
+ 8.099894523620605
269
+ ],
270
+ "60": [
271
+ 8.000508308410645
272
+ ],
273
+ "61": [
274
+ 7.969767093658447
275
+ ],
276
+ "62": [
277
+ 7.933720111846924
278
+ ],
279
+ "65": [
280
+ 7.8169379234313965
281
+ ],
282
+ "66": [
283
+ 7.7661590576171875
284
+ ],
285
+ "67": [
286
+ 7.738090515136719
287
+ ],
288
+ "68": [
289
+ 7.696783542633057
290
+ ],
291
+ "69": [
292
+ 7.641815662384033
293
+ ],
294
+ "70": [
295
+ 7.630120754241943
296
+ ],
297
+ "71": [
298
+ 7.587459564208984
299
+ ],
300
+ "72": [
301
+ 7.552192211151123
302
+ ],
303
+ "73": [
304
+ 7.5274481773376465
305
+ ],
306
+ "74": [
307
+ 7.4899420738220215
308
+ ],
309
+ "75": [
310
+ 7.452051639556885
311
+ ],
312
+ "76": [
313
+ 7.4407453536987305
314
+ ],
315
+ "77": [
316
+ 7.408007621765137
317
+ ],
318
+ "78": [
319
+ 7.371201038360596
320
+ ],
321
+ "79": [
322
+ 7.351102828979492
323
+ ],
324
+ "80": [
325
+ 7.310842990875244
326
+ ],
327
+ "81": [
328
+ 7.288948059082031
329
+ ],
330
+ "82": [
331
+ 7.2828898429870605
332
+ ],
333
+ "83": [
334
+ 7.232029914855957
335
+ ],
336
+ "85": [
337
+ 7.209151268005371
338
+ ],
339
+ "87": [
340
+ 7.154072284698486
341
+ ],
342
+ "88": [
343
+ 7.144335746765137
344
+ ],
345
+ "89": [
346
+ 7.098391532897949
347
+ ],
348
+ "90": [
349
+ 7.086823463439941
350
+ ],
351
+ "91": [
352
+ 7.069278717041016
353
+ ],
354
+ "92": [
355
+ 7.041197776794434
356
+ ],
357
+ "93": [
358
+ 7.043648719787598
359
+ ],
360
+ "94": [
361
+ 7.037468910217285
362
+ ],
363
+ "95": [
364
+ 7.026734352111816
365
+ ],
366
+ "96": [
367
+ 7.000428199768066
368
+ ],
369
+ "98": [
370
+ 6.972815990447998
371
+ ],
372
+ "99": [
373
+ 6.958772659301758
374
+ ],
375
+ "100": [
376
+ 6.942638397216797
377
+ ],
378
+ "101": [
379
+ 6.912716388702393
380
+ ],
381
+ "103": [
382
+ 6.885679721832275
383
+ ],
384
+ "104": [
385
+ 6.876980781555176
386
+ ],
387
+ "105": [
388
+ 6.856561183929443
389
+ ],
390
+ "107": [
391
+ 6.828001499176025
392
+ ],
393
+ "108": [
394
+ 6.813321113586426
395
+ ],
396
+ "109": [
397
+ 6.792052745819092
398
+ ],
399
+ "110": [
400
+ 6.770946502685547
401
+ ],
402
+ "111": [
403
+ 6.770632266998291
404
+ ],
405
+ "112": [
406
+ 6.753300189971924
407
+ ],
408
+ "113": [
409
+ 6.743083953857422
410
+ ],
411
+ "114": [
412
+ 6.735600471496582
413
+ ],
414
+ "115": [
415
+ 6.710375785827637
416
+ ],
417
+ "116": [
418
+ 6.699243545532227
419
+ ],
420
+ "117": [
421
+ 6.680922031402588
422
+ ],
423
+ "118": [
424
+ 6.690885543823242
425
+ ],
426
+ "119": [
427
+ 6.664650917053223
428
+ ],
429
+ "120": [
430
+ 6.671673774719238
431
+ ],
432
+ "121": [
433
+ 6.654481887817383
434
+ ],
435
+ "122": [
436
+ 6.649986267089844
437
+ ],
438
+ "123": [
439
+ 6.636155605316162
440
+ ],
441
+ "124": [
442
+ 6.620141983032227
443
+ ],
444
+ "125": [
445
+ 6.612869739532471
446
+ ],
447
+ "126": [
448
+ 6.606642723083496
449
+ ],
450
+ "129": [
451
+ 6.587365627288818
452
+ ],
453
+ "131": [
454
+ 6.550192832946777
455
+ ],
456
+ "132": [
457
+ 6.5400800704956055
458
+ ],
459
+ "133": [
460
+ 6.541842460632324
461
+ ],
462
+ "134": [
463
+ 6.523106098175049
464
+ ],
465
+ "135": [
466
+ 6.503216743469238
467
+ ],
468
+ "136": [
469
+ 6.492585182189941
470
+ ],
471
+ "138": [
472
+ 6.482771396636963
473
+ ],
474
+ "139": [
475
+ 6.470407962799072
476
+ ],
477
+ "140": [
478
+ 6.474955081939697
479
+ ],
480
+ "141": [
481
+ 6.469099998474121
482
+ ],
483
+ "142": [
484
+ 6.4600443840026855
485
+ ],
486
+ "144": [
487
+ 6.433396339416504
488
+ ],
489
+ "145": [
490
+ 6.4286065101623535
491
+ ],
492
+ "146": [
493
+ 6.440338134765625
494
+ ],
495
+ "147": [
496
+ 6.422786235809326
497
+ ],
498
+ "148": [
499
+ 6.409480094909668
500
+ ],
501
+ "149": [
502
+ 6.402649402618408
503
+ ],
504
+ "150": [
505
+ 6.407670974731445
506
+ ],
507
+ "151": [
508
+ 6.396670341491699
509
+ ],
510
+ "152": [
511
+ 6.380721092224121
512
+ ],
513
+ "154": [
514
+ 6.356389045715332
515
+ ],
516
+ "155": [
517
+ 6.365396499633789
518
+ ],
519
+ "156": [
520
+ 6.3473310470581055
521
+ ],
522
+ "157": [
523
+ 6.332749366760254
524
+ ],
525
+ "158": [
526
+ 6.315455436706543
527
+ ],
528
+ "159": [
529
+ 6.305903911590576
530
+ ],
531
+ "160": [
532
+ 6.30325984954834
533
+ ],
534
+ "161": [
535
+ 6.312277317047119
536
+ ],
537
+ "162": [
538
+ 6.293718338012695
539
+ ],
540
+ "163": [
541
+ 6.29055643081665
542
+ ],
543
+ "164": [
544
+ 6.287791728973389
545
+ ],
546
+ "165": [
547
+ 6.2886505126953125
548
+ ],
549
+ "166": [
550
+ 6.280340671539307
551
+ ],
552
+ "167": [
553
+ 6.260507106781006
554
+ ],
555
+ "169": [
556
+ 6.257781028747559
557
+ ],
558
+ "171": [
559
+ 6.240293502807617
560
+ ],
561
+ "172": [
562
+ 6.23004150390625
563
+ ],
564
+ "174": [
565
+ 6.224309921264648
566
+ ],
567
+ "175": [
568
+ 6.218266487121582
569
+ ],
570
+ "176": [
571
+ 6.21510124206543
572
+ ],
573
+ "178": [
574
+ 6.194764614105225
575
+ ],
576
+ "179": [
577
+ 6.199686050415039
578
+ ],
579
+ "180": [
580
+ 6.188028812408447
581
+ ],
582
+ "181": [
583
+ 6.162545680999756
584
+ ],
585
+ "182": [
586
+ 6.152849197387695
587
+ ],
588
+ "183": [
589
+ 6.147336959838867
590
+ ],
591
+ "184": [
592
+ 6.141636848449707
593
+ ],
594
+ "185": [
595
+ 6.139773368835449
596
+ ],
597
+ "186": [
598
+ 6.1278791427612305
599
+ ],
600
+ "187": [
601
+ 6.133630752563477
602
+ ],
603
+ "188": [
604
+ 6.127473831176758
605
+ ],
606
+ "189": [
607
+ 6.109642505645752
608
+ ],
609
+ "190": [
610
+ 6.10366153717041
611
+ ],
612
+ "191": [
613
+ 6.081837177276611
614
+ ],
615
+ "192": [
616
+ 6.089879512786865
617
+ ],
618
+ "193": [
619
+ 6.077977657318115
620
+ ],
621
+ "194": [
622
+ 6.0798234939575195
623
+ ],
624
+ "195": [
625
+ 6.077410697937012
626
+ ],
627
+ "196": [
628
+ 6.068553924560547
629
+ ],
630
+ "197": [
631
+ 6.063356876373291
632
+ ],
633
+ "199": [
634
+ 6.057088375091553
635
+ ],
636
+ "200": [
637
+ 6.050692081451416
638
+ ],
639
+ "201": [
640
+ 6.032055854797363
641
+ ],
642
+ "202": [
643
+ 6.040605545043945
644
+ ],
645
+ "203": [
646
+ 6.04606294631958
647
+ ],
648
+ "204": [
649
+ 6.033795356750488
650
+ ],
651
+ "205": [
652
+ 6.019334316253662
653
+ ],
654
+ "206": [
655
+ 6.009232521057129
656
+ ],
657
+ "207": [
658
+ 6.017391204833984
659
+ ],
660
+ "208": [
661
+ 6.006136417388916
662
+ ],
663
+ "209": [
664
+ 5.995009422302246
665
+ ],
666
+ "210": [
667
+ 5.995218276977539
668
+ ],
669
+ "211": [
670
+ 5.988270282745361
671
+ ],
672
+ "212": [
673
+ 5.977220058441162
674
+ ],
675
+ "213": [
676
+ 5.966462135314941
677
+ ],
678
+ "214": [
679
+ 5.961383819580078
680
+ ],
681
+ "215": [
682
+ 5.9638590812683105
683
+ ],
684
+ "216": [
685
+ 5.956181049346924
686
+ ],
687
+ "217": [
688
+ 5.95109748840332
689
+ ],
690
+ "218": [
691
+ 5.926913261413574
692
+ ],
693
+ "219": [
694
+ 5.933916091918945
695
+ ],
696
+ "220": [
697
+ 5.930830001831055
698
+ ],
699
+ "221": [
700
+ 5.931302547454834
701
+ ],
702
+ "222": [
703
+ 5.9127397537231445
704
+ ],
705
+ "223": [
706
+ 5.907376766204834
707
+ ],
708
+ "225": [
709
+ 5.910128593444824
710
+ ],
711
+ "226": [
712
+ 5.907344818115234
713
+ ],
714
+ "227": [
715
+ 5.886994361877441
716
+ ],
717
+ "228": [
718
+ 5.885712623596191
719
+ ],
720
+ "229": [
721
+ 5.882732391357422
722
+ ],
723
+ "230": [
724
+ 5.884702205657959
725
+ ],
726
+ "231": [
727
+ 5.8586554527282715
728
+ ],
729
+ "232": [
730
+ 5.860570430755615
731
+ ],
732
+ "233": [
733
+ 5.8592915534973145
734
+ ],
735
+ "235": [
736
+ 5.853981971740723
737
+ ],
738
+ "237": [
739
+ 5.836703777313232
740
+ ],
741
+ "238": [
742
+ 5.830770969390869
743
+ ],
744
+ "239": [
745
+ 5.8226165771484375
746
+ ],
747
+ "240": [
748
+ 5.824166774749756
749
+ ],
750
+ "241": [
751
+ 5.814944744110107
752
+ ],
753
+ "242": [
754
+ 5.805344581604004
755
+ ],
756
+ "243": [
757
+ 5.818417072296143
758
+ ],
759
+ "244": [
760
+ 5.806392669677734
761
+ ],
762
+ "245": [
763
+ 5.788371562957764
764
+ ],
765
+ "246": [
766
+ 5.786664009094238
767
+ ],
768
+ "247": [
769
+ 5.797480583190918
770
+ ],
771
+ "248": [
772
+ 5.783918380737305
773
+ ],
774
+ "249": [
775
+ 5.789022922515869
776
+ ],
777
+ "250": [
778
+ 5.773997783660889
779
+ ],
780
+ "251": [
781
+ 5.763557434082031
782
+ ],
783
+ "252": [
784
+ 5.7692742347717285
785
+ ],
786
+ "253": [
787
+ 5.75090217590332
788
+ ],
789
+ "254": [
790
+ 5.740006446838379
791
+ ],
792
+ "255": [
793
+ 5.724453449249268
794
+ ],
795
+ "256": [
796
+ 5.720920562744141
797
+ ],
798
+ "257": [
799
+ 5.73279333114624
800
+ ],
801
+ "258": [
802
+ 5.729687213897705
803
+ ],
804
+ "259": [
805
+ 5.7120490074157715
806
+ ],
807
+ "260": [
808
+ 5.714480876922607
809
+ ],
810
+ "261": [
811
+ 5.696575164794922
812
+ ],
813
+ "262": [
814
+ 5.698047637939453
815
+ ],
816
+ "265": [
817
+ 5.6771955490112305
818
+ ],
819
+ "266": [
820
+ 5.667380332946777
821
+ ],
822
+ "267": [
823
+ 5.671542167663574
824
+ ],
825
+ "268": [
826
+ 5.668306827545166
827
+ ],
828
+ "269": [
829
+ 5.6464457511901855
830
+ ],
831
+ "270": [
832
+ 5.64121150970459
833
+ ],
834
+ "271": [
835
+ 5.644558906555176
836
+ ],
837
+ "273": [
838
+ 5.6484503746032715
839
+ ],
840
+ "274": [
841
+ 5.6280317306518555
842
+ ],
843
+ "275": [
844
+ 5.62814998626709
845
+ ],
846
+ "276": [
847
+ 5.619859218597412
848
+ ],
849
+ "277": [
850
+ 5.630714416503906
851
+ ],
852
+ "278": [
853
+ 5.615391254425049
854
+ ],
855
+ "279": [
856
+ 5.617112159729004
857
+ ],
858
+ "281": [
859
+ 5.614068031311035
860
+ ],
861
+ "282": [
862
+ 5.601541996002197
863
+ ],
864
+ "283": [
865
+ 5.580329895019531
866
+ ],
867
+ "284": [
868
+ 5.59044885635376
869
+ ],
870
+ "286": [
871
+ 5.579657554626465
872
+ ],
873
+ "287": [
874
+ 5.57890510559082
875
+ ],
876
+ "288": [
877
+ 5.560153961181641
878
+ ],
879
+ "289": [
880
+ 5.553445816040039
881
+ ],
882
+ "290": [
883
+ 5.554251670837402
884
+ ],
885
+ "291": [
886
+ 5.555505275726318
887
+ ],
888
+ "292": [
889
+ 5.54575252532959
890
+ ],
891
+ "293": [
892
+ 5.546602249145508
893
+ ],
894
+ "294": [
895
+ 5.53740119934082
896
+ ],
897
+ "295": [
898
+ 5.533825874328613
899
+ ],
900
+ "296": [
901
+ 5.521933078765869
902
+ ],
903
+ "297": [
904
+ 5.5187578201293945
905
+ ],
906
+ "298": [
907
+ 5.502842903137207
908
+ ],
909
+ "299": [
910
+ 5.518270969390869
911
+ ],
912
+ "300": [
913
+ 5.511235237121582
914
+ ],
915
+ "301": [
916
+ 5.525973320007324
917
+ ],
918
+ "302": [
919
+ 5.51053524017334
920
+ ],
921
+ "303": [
922
+ 5.495884418487549
923
+ ],
924
+ "304": [
925
+ 5.51646089553833
926
+ ],
927
+ "305": [
928
+ 5.510878562927246
929
+ ],
930
+ "306": [
931
+ 5.489213466644287
932
+ ],
933
+ "307": [
934
+ 5.518331050872803
935
+ ],
936
+ "308": [
937
+ 5.494318008422852
938
+ ],
939
+ "309": [
940
+ 5.477028846740723
941
+ ],
942
+ "310": [
943
+ 5.4960198402404785
944
+ ],
945
+ "311": [
946
+ 5.474133014678955
947
+ ],
948
+ "312": [
949
+ 5.462413787841797
950
+ ],
951
+ "313": [
952
+ 5.479360580444336
953
+ ],
954
+ "315": [
955
+ 5.466599464416504
956
+ ],
957
+ "316": [
958
+ 5.469489097595215
959
+ ],
960
+ "317": [
961
+ 5.439362049102783
962
+ ],
963
+ "318": [
964
+ 5.458652496337891
965
+ ],
966
+ "319": [
967
+ 5.435719013214111
968
+ ],
969
+ "320": [
970
+ 5.415310859680176
971
+ ],
972
+ "321": [
973
+ 5.428353786468506
974
+ ],
975
+ "322": [
976
+ 5.423825740814209
977
+ ],
978
+ "323": [
979
+ 5.4025774002075195
980
+ ],
981
+ "324": [
982
+ 5.4182281494140625
983
+ ],
984
+ "325": [
985
+ 5.417865753173828
986
+ ],
987
+ "326": [
988
+ 5.392971992492676
989
+ ],
990
+ "327": [
991
+ 5.405820369720459
992
+ ],
993
+ "328": [
994
+ 5.3887529373168945
995
+ ],
996
+ "329": [
997
+ 5.363739967346191
998
+ ],
999
+ "331": [
1000
+ 5.380855083465576
1001
+ ],
1002
+ "332": [
1003
+ 5.363964080810547
1004
+ ],
1005
+ "333": [
1006
+ 5.389106750488281
1007
+ ],
1008
+ "334": [
1009
+ 5.364814758300781
1010
+ ],
1011
+ "335": [
1012
+ 5.350942134857178
1013
+ ],
1014
+ "336": [
1015
+ 5.369415760040283
1016
+ ],
1017
+ "337": [
1018
+ 5.346657752990723
1019
+ ],
1020
+ "338": [
1021
+ 5.350274085998535
1022
+ ],
1023
+ "339": [
1024
+ 5.348207473754883
1025
+ ],
1026
+ "341": [
1027
+ 5.331037998199463
1028
+ ],
1029
+ "343": [
1030
+ 5.329416275024414
1031
+ ],
1032
+ "344": [
1033
+ 5.3085455894470215
1034
+ ],
1035
+ "345": [
1036
+ 5.32960844039917
1037
+ ],
1038
+ "346": [
1039
+ 5.308642864227295
1040
+ ],
1041
+ "347": [
1042
+ 5.305500507354736
1043
+ ],
1044
+ "348": [
1045
+ 5.307600975036621
1046
+ ],
1047
+ "349": [
1048
+ 5.2924089431762695
1049
+ ],
1050
+ "350": [
1051
+ 5.274683952331543
1052
+ ],
1053
+ "351": [
1054
+ 5.283298015594482
1055
+ ],
1056
+ "353": [
1057
+ 5.275749206542969
1058
+ ],
1059
+ "354": [
1060
+ 5.286045074462891
1061
+ ],
1062
+ "355": [
1063
+ 5.267706871032715
1064
+ ],
1065
+ "356": [
1066
+ 5.260513782501221
1067
+ ],
1068
+ "357": [
1069
+ 5.2767839431762695
1070
+ ],
1071
+ "359": [
1072
+ 5.251471519470215
1073
+ ],
1074
+ "360": [
1075
+ 5.26442289352417
1076
+ ],
1077
+ "361": [
1078
+ 5.246307373046875
1079
+ ],
1080
+ "363": [
1081
+ 5.2540435791015625
1082
+ ],
1083
+ "364": [
1084
+ 5.2316975593566895
1085
+ ],
1086
+ "365": [
1087
+ 5.229036808013916
1088
+ ],
1089
+ "366": [
1090
+ 5.228911399841309
1091
+ ],
1092
+ "367": [
1093
+ 5.215038776397705
1094
+ ],
1095
+ "368": [
1096
+ 5.209632396697998
1097
+ ],
1098
+ "369": [
1099
+ 5.231753349304199
1100
+ ],
1101
+ "370": [
1102
+ 5.198577404022217
1103
+ ],
1104
+ "371": [
1105
+ 5.20541524887085
1106
+ ],
1107
+ "372": [
1108
+ 5.218658447265625
1109
+ ],
1110
+ "373": [
1111
+ 5.183835029602051
1112
+ ],
1113
+ "374": [
1114
+ 5.1883649826049805
1115
+ ],
1116
+ "375": [
1117
+ 5.19450569152832
1118
+ ],
1119
+ "376": [
1120
+ 5.174581050872803
1121
+ ],
1122
+ "378": [
1123
+ 5.185816764831543
1124
+ ],
1125
+ "379": [
1126
+ 5.172260284423828
1127
+ ],
1128
+ "381": [
1129
+ 5.175004005432129
1130
+ ],
1131
+ "382": [
1132
+ 5.149728775024414
1133
+ ],
1134
+ "383": [
1135
+ 5.154256820678711
1136
+ ],
1137
+ "384": [
1138
+ 5.159426212310791
1139
+ ],
1140
+ "385": [
1141
+ 5.133786678314209
1142
+ ],
1143
+ "386": [
1144
+ 5.163707733154297
1145
+ ],
1146
+ "387": [
1147
+ 5.137426853179932
1148
+ ],
1149
+ "388": [
1150
+ 5.133244514465332
1151
+ ],
1152
+ "389": [
1153
+ 5.133027076721191
1154
+ ],
1155
+ "390": [
1156
+ 5.118992805480957
1157
+ ],
1158
+ "391": [
1159
+ 5.10985803604126
1160
+ ],
1161
+ "392": [
1162
+ 5.125600337982178
1163
+ ],
1164
+ "393": [
1165
+ 5.116215705871582
1166
+ ],
1167
+ "394": [
1168
+ 5.131166458129883
1169
+ ],
1170
+ "395": [
1171
+ 5.149313926696777
1172
+ ],
1173
+ "396": [
1174
+ 5.135613441467285
1175
+ ],
1176
+ "397": [
1177
+ 5.145551681518555
1178
+ ],
1179
+ "398": [
1180
+ 5.140324592590332
1181
+ ],
1182
+ "399": [
1183
+ 5.138005256652832
1184
+ ],
1185
+ "401": [
1186
+ 5.123149394989014
1187
+ ],
1188
+ "402": [
1189
+ 5.106956958770752
1190
+ ],
1191
+ "403": [
1192
+ 5.122385501861572
1193
+ ],
1194
+ "404": [
1195
+ 5.121047019958496
1196
+ ],
1197
+ "405": [
1198
+ 5.121511936187744
1199
+ ],
1200
+ "406": [
1201
+ 5.116922378540039
1202
+ ],
1203
+ "407": [
1204
+ 5.099788665771484
1205
+ ],
1206
+ "408": [
1207
+ 5.088689804077148
1208
+ ],
1209
+ "409": [
1210
+ 5.092028617858887
1211
+ ],
1212
+ "410": [
1213
+ 5.092405319213867
1214
+ ],
1215
+ "411": [
1216
+ 5.0852813720703125
1217
+ ],
1218
+ "412": [
1219
+ 5.081229209899902
1220
+ ],
1221
+ "413": [
1222
+ 5.071894645690918
1223
+ ],
1224
+ "414": [
1225
+ 5.084445953369141
1226
+ ],
1227
+ "415": [
1228
+ 5.073363304138184
1229
+ ],
1230
+ "416": [
1231
+ 5.067659378051758
1232
+ ],
1233
+ "417": [
1234
+ 5.063205718994141
1235
+ ],
1236
+ "419": [
1237
+ 5.064387321472168
1238
+ ],
1239
+ "420": [
1240
+ 5.066856384277344
1241
+ ],
1242
+ "421": [
1243
+ 5.065526962280273
1244
+ ],
1245
+ "422": [
1246
+ 5.055660247802734
1247
+ ],
1248
+ "423": [
1249
+ 5.058163166046143
1250
+ ],
1251
+ "424": [
1252
+ 5.062191486358643
1253
+ ],
1254
+ "425": [
1255
+ 5.046815395355225
1256
+ ],
1257
+ "428": [
1258
+ 5.036874771118164
1259
+ ],
1260
+ "429": [
1261
+ 5.036855697631836
1262
+ ],
1263
+ "430": [
1264
+ 5.046374320983887
1265
+ ],
1266
+ "431": [
1267
+ 5.042652130126953
1268
+ ],
1269
+ "432": [
1270
+ 5.024091720581055
1271
+ ],
1272
+ "434": [
1273
+ 5.019966125488281
1274
+ ],
1275
+ "435": [
1276
+ 5.007455825805664
1277
+ ],
1278
+ "436": [
1279
+ 5.0079145431518555
1280
+ ],
1281
+ "437": [
1282
+ 5.002538681030273
1283
+ ],
1284
+ "438": [
1285
+ 4.993525505065918
1286
+ ],
1287
+ "439": [
1288
+ 4.990423202514648
1289
+ ],
1290
+ "440": [
1291
+ 5.000260829925537
1292
+ ],
1293
+ "441": [
1294
+ 4.989344596862793
1295
+ ],
1296
+ "442": [
1297
+ 4.99100923538208
1298
+ ],
1299
+ "443": [
1300
+ 4.988770008087158
1301
+ ],
1302
+ "445": [
1303
+ 4.984315872192383
1304
+ ],
1305
+ "446": [
1306
+ 4.979765892028809
1307
+ ],
1308
+ "447": [
1309
+ 4.968349456787109
1310
+ ],
1311
+ "449": [
1312
+ 4.981423377990723
1313
+ ],
1314
+ "450": [
1315
+ 4.969783306121826
1316
+ ],
1317
+ "452": [
1318
+ 4.952669143676758
1319
+ ],
1320
+ "453": [
1321
+ 4.952358245849609
1322
+ ],
1323
+ "454": [
1324
+ 4.945185661315918
1325
+ ],
1326
+ "455": [
1327
+ 4.937941551208496
1328
+ ],
1329
+ "456": [
1330
+ 4.941512107849121
1331
+ ],
1332
+ "459": [
1333
+ 4.9204840660095215
1334
+ ],
1335
+ "461": [
1336
+ 4.9134039878845215
1337
+ ],
1338
+ "462": [
1339
+ 4.912925720214844
1340
+ ],
1341
+ "463": [
1342
+ 4.922518730163574
1343
+ ],
1344
+ "464": [
1345
+ 4.932413101196289
1346
+ ],
1347
+ "465": [
1348
+ 4.912574291229248
1349
+ ],
1350
+ "466": [
1351
+ 4.899024486541748
1352
+ ],
1353
+ "467": [
1354
+ 4.911117076873779
1355
+ ],
1356
+ "468": [
1357
+ 4.915473937988281
1358
+ ],
1359
+ "469": [
1360
+ 4.901583194732666
1361
+ ],
1362
+ "470": [
1363
+ 4.9034271240234375
1364
+ ],
1365
+ "471": [
1366
+ 4.890704154968262
1367
+ ],
1368
+ "472": [
1369
+ 4.894222259521484
1370
+ ],
1371
+ "473": [
1372
+ 4.892629146575928
1373
+ ],
1374
+ "474": [
1375
+ 4.871220111846924
1376
+ ],
1377
+ "475": [
1378
+ 4.869009971618652
1379
+ ],
1380
+ "476": [
1381
+ 4.8729329109191895
1382
+ ],
1383
+ "478": [
1384
+ 4.874856948852539
1385
+ ],
1386
+ "479": [
1387
+ 4.863500595092773
1388
+ ],
1389
+ "480": [
1390
+ 4.859533309936523
1391
+ ],
1392
+ "481": [
1393
+ 4.857326984405518
1394
+ ],
1395
+ "482": [
1396
+ 4.837072372436523
1397
+ ],
1398
+ "483": [
1399
+ 4.8351850509643555
1400
+ ],
1401
+ "484": [
1402
+ 4.837536334991455
1403
+ ],
1404
+ "485": [
1405
+ 4.84002685546875
1406
+ ],
1407
+ "486": [
1408
+ 4.834524154663086
1409
+ ],
1410
+ "487": [
1411
+ 4.8294677734375
1412
+ ],
1413
+ "488": [
1414
+ 4.830111980438232
1415
+ ],
1416
+ "489": [
1417
+ 4.821319580078125
1418
+ ],
1419
+ "490": [
1420
+ 4.809113502502441
1421
+ ],
1422
+ "491": [
1423
+ 4.8010783195495605
1424
+ ],
1425
+ "492": [
1426
+ 4.79583215713501
1427
+ ],
1428
+ "493": [
1429
+ 4.800057888031006
1430
+ ],
1431
+ "494": [
1432
+ 4.798526287078857
1433
+ ],
1434
+ "495": [
1435
+ 4.804708957672119
1436
+ ],
1437
+ "496": [
1438
+ 4.80340576171875
1439
+ ],
1440
+ "497": [
1441
+ 4.8040056228637695
1442
+ ],
1443
+ "499": [
1444
+ 4.7900896072387695
1445
+ ],
1446
+ "500": [
1447
+ 4.795309066772461
1448
+ ],
1449
+ "501": [
1450
+ 4.778487205505371
1451
+ ],
1452
+ "502": [
1453
+ 4.790122032165527
1454
+ ],
1455
+ "503": [
1456
+ 4.781085014343262
1457
+ ],
1458
+ "504": [
1459
+ 4.7819695472717285
1460
+ ],
1461
+ "505": [
1462
+ 4.769318103790283
1463
+ ],
1464
+ "506": [
1465
+ 4.775773048400879
1466
+ ],
1467
+ "507": [
1468
+ 4.765681266784668
1469
+ ],
1470
+ "508": [
1471
+ 4.7639479637146
1472
+ ],
1473
+ "509": [
1474
+ 4.754333972930908
1475
+ ],
1476
+ "510": [
1477
+ 4.764067649841309
1478
+ ],
1479
+ "511": [
1480
+ 4.751704692840576
1481
+ ],
1482
+ "512": [
1483
+ 4.746877193450928
1484
+ ],
1485
+ "513": [
1486
+ 4.74250602722168
1487
+ ],
1488
+ "514": [
1489
+ 4.745611190795898
1490
+ ],
1491
+ "515": [
1492
+ 4.738706588745117
1493
+ ],
1494
+ "516": [
1495
+ 4.7285308837890625
1496
+ ],
1497
+ "517": [
1498
+ 4.73089599609375
1499
+ ],
1500
+ "518": [
1501
+ 4.723514556884766
1502
+ ],
1503
+ "519": [
1504
+ 4.7326250076293945
1505
+ ],
1506
+ "520": [
1507
+ 4.712192535400391
1508
+ ],
1509
+ "521": [
1510
+ 4.719448566436768
1511
+ ],
1512
+ "522": [
1513
+ 4.711329936981201
1514
+ ],
1515
+ "524": [
1516
+ 4.710899829864502
1517
+ ],
1518
+ "526": [
1519
+ 4.709956169128418
1520
+ ],
1521
+ "528": [
1522
+ 4.695399761199951
1523
+ ],
1524
+ "529": [
1525
+ 4.689852714538574
1526
+ ],
1527
+ "530": [
1528
+ 4.6963276863098145
1529
+ ],
1530
+ "531": [
1531
+ 4.693183898925781
1532
+ ],
1533
+ "532": [
1534
+ 4.681169033050537
1535
+ ],
1536
+ "533": [
1537
+ 4.680347919464111
1538
+ ],
1539
+ "534": [
1540
+ 4.674761772155762
1541
+ ],
1542
+ "535": [
1543
+ 4.67693567276001
1544
+ ],
1545
+ "536": [
1546
+ 4.6697611808776855
1547
+ ],
1548
+ "538": [
1549
+ 4.6624298095703125
1550
+ ],
1551
+ "539": [
1552
+ 4.665920257568359
1553
+ ],
1554
+ "540": [
1555
+ 4.664849758148193
1556
+ ],
1557
+ "541": [
1558
+ 4.655454158782959
1559
+ ],
1560
+ "542": [
1561
+ 4.658844947814941
1562
+ ],
1563
+ "544": [
1564
+ 4.644007682800293
1565
+ ],
1566
+ "545": [
1567
+ 4.638642311096191
1568
+ ],
1569
+ "546": [
1570
+ 4.647057056427002
1571
+ ],
1572
+ "547": [
1573
+ 4.650745391845703
1574
+ ],
1575
+ "548": [
1576
+ 4.638507843017578
1577
+ ],
1578
+ "550": [
1579
+ 4.635471820831299
1580
+ ],
1581
+ "551": [
1582
+ 4.636885643005371
1583
+ ],
1584
+ "552": [
1585
+ 4.623069763183594
1586
+ ],
1587
+ "553": [
1588
+ 4.620236396789551
1589
+ ],
1590
+ "554": [
1591
+ 4.61091423034668
1592
+ ],
1593
+ "555": [
1594
+ 4.603527069091797
1595
+ ],
1596
+ "556": [
1597
+ 4.603853702545166
1598
+ ],
1599
+ "557": [
1600
+ 4.599881172180176
1601
+ ],
1602
+ "558": [
1603
+ 4.604748725891113
1604
+ ]
1605
+ }
1606
+ },
1607
  "distributed/optimized-gpt2-250m": {
1608
  "main-net": {
1609
  "0": [