--- license: mit tags: - generated_from_trainer model-index: - name: finetuned-xlm-r-masakhaner-swa-whole-word-phonetic results: [] --- # finetuned-xlm-r-masakhaner-swa-whole-word-phonetic This model is a fine-tuned version of [xlm-roberta-base](https://huggingface.co/xlm-roberta-base) on the None dataset. It achieves the following results on the evaluation set: - Loss: 10.9759 ## Model description More information needed ## Intended uses & limitations More information needed ## Training and evaluation data More information needed ## Training procedure ### Training hyperparameters The following hyperparameters were used during training: - learning_rate: 7e-08 - train_batch_size: 8 - eval_batch_size: 8 - seed: 42 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08 - lr_scheduler_type: linear - num_epochs: 500 ### Training results | Training Loss | Epoch | Step | Validation Loss | |:-------------:|:-----:|:-----:|:---------------:| | No log | 1.0 | 62 | 40.0624 | | No log | 2.0 | 124 | 39.4729 | | No log | 3.0 | 186 | 39.0082 | | No log | 4.0 | 248 | 38.2032 | | No log | 5.0 | 310 | 37.3358 | | No log | 6.0 | 372 | 36.1574 | | No log | 7.0 | 434 | 35.1500 | | No log | 8.0 | 496 | 33.6943 | | 39.2118 | 9.0 | 558 | 32.3968 | | 39.2118 | 10.0 | 620 | 30.7308 | | 39.2118 | 11.0 | 682 | 29.2279 | | 39.2118 | 12.0 | 744 | 27.8274 | | 39.2118 | 13.0 | 806 | 26.4941 | | 39.2118 | 14.0 | 868 | 24.6593 | | 39.2118 | 15.0 | 930 | 23.4405 | | 39.2118 | 16.0 | 992 | 21.9994 | | 27.5423 | 17.0 | 1054 | 21.0274 | | 27.5423 | 18.0 | 1116 | 19.8907 | | 27.5423 | 19.0 | 1178 | 19.3347 | | 27.5423 | 20.0 | 1240 | 18.3241 | | 27.5423 | 21.0 | 1302 | 17.5215 | | 27.5423 | 22.0 | 1364 | 16.9689 | | 27.5423 | 23.0 | 1426 | 16.2983 | | 27.5423 | 24.0 | 1488 | 15.8707 | | 18.4542 | 25.0 | 1550 | 15.4655 | | 18.4542 | 26.0 | 1612 | 15.1849 | | 18.4542 | 27.0 | 1674 | 14.7801 | | 18.4542 | 28.0 | 1736 | 14.5576 | | 18.4542 | 29.0 | 1798 | 14.4215 | | 18.4542 | 30.0 | 1860 | 13.9318 | | 18.4542 | 31.0 | 1922 | 13.9801 | | 18.4542 | 32.0 | 1984 | 13.7096 | | 13.9556 | 33.0 | 2046 | 13.4639 | | 13.9556 | 34.0 | 2108 | 13.2987 | | 13.9556 | 35.0 | 2170 | 13.2303 | | 13.9556 | 36.0 | 2232 | 13.2450 | | 13.9556 | 37.0 | 2294 | 13.0574 | | 13.9556 | 38.0 | 2356 | 12.9022 | | 13.9556 | 39.0 | 2418 | 12.8200 | | 13.9556 | 40.0 | 2480 | 12.7295 | | 12.111 | 41.0 | 2542 | 12.8402 | | 12.111 | 42.0 | 2604 | 12.6906 | | 12.111 | 43.0 | 2666 | 12.5422 | | 12.111 | 44.0 | 2728 | 12.5032 | | 12.111 | 45.0 | 2790 | 12.2968 | | 12.111 | 46.0 | 2852 | 12.3324 | | 12.111 | 47.0 | 2914 | 12.2543 | | 12.111 | 48.0 | 2976 | 12.2434 | | 11.3304 | 49.0 | 3038 | 12.2519 | | 11.3304 | 50.0 | 3100 | 12.1120 | | 11.3304 | 51.0 | 3162 | 12.1969 | | 11.3304 | 52.0 | 3224 | 11.9977 | | 11.3304 | 53.0 | 3286 | 12.1759 | | 11.3304 | 54.0 | 3348 | 11.9808 | | 11.3304 | 55.0 | 3410 | 12.1498 | | 11.3304 | 56.0 | 3472 | 11.9851 | | 10.9471 | 57.0 | 3534 | 12.0800 | | 10.9471 | 58.0 | 3596 | 11.8819 | | 10.9471 | 59.0 | 3658 | 12.0099 | | 10.9471 | 60.0 | 3720 | 11.8616 | | 10.9471 | 61.0 | 3782 | 11.8950 | | 10.9471 | 62.0 | 3844 | 11.8301 | | 10.9471 | 63.0 | 3906 | 12.0967 | | 10.9471 | 64.0 | 3968 | 11.8379 | | 10.6841 | 65.0 | 4030 | 11.9093 | | 10.6841 | 66.0 | 4092 | 11.9175 | | 10.6841 | 67.0 | 4154 | 11.7318 | | 10.6841 | 68.0 | 4216 | 11.8300 | | 10.6841 | 69.0 | 4278 | 11.5992 | | 10.6841 | 70.0 | 4340 | 11.6044 | | 10.6841 | 71.0 | 4402 | 11.6937 | | 10.6841 | 72.0 | 4464 | 11.5960 | | 10.542 | 73.0 | 4526 | 11.5451 | | 10.542 | 74.0 | 4588 | 11.4033 | | 10.542 | 75.0 | 4650 | 11.4805 | | 10.542 | 76.0 | 4712 | 11.5396 | | 10.542 | 77.0 | 4774 | 11.4924 | | 10.542 | 78.0 | 4836 | 11.4289 | | 10.542 | 79.0 | 4898 | 11.3646 | | 10.542 | 80.0 | 4960 | 11.3624 | | 10.4457 | 81.0 | 5022 | 11.4623 | | 10.4457 | 82.0 | 5084 | 11.5224 | | 10.4457 | 83.0 | 5146 | 11.4196 | | 10.4457 | 84.0 | 5208 | 11.4359 | | 10.4457 | 85.0 | 5270 | 11.4346 | | 10.4457 | 86.0 | 5332 | 11.4639 | | 10.4457 | 87.0 | 5394 | 11.2307 | | 10.4457 | 88.0 | 5456 | 11.5262 | | 10.3854 | 89.0 | 5518 | 11.6653 | | 10.3854 | 90.0 | 5580 | 11.3471 | | 10.3854 | 91.0 | 5642 | 11.3048 | | 10.3854 | 92.0 | 5704 | 11.3633 | | 10.3854 | 93.0 | 5766 | 11.3434 | | 10.3854 | 94.0 | 5828 | 11.2580 | | 10.3854 | 95.0 | 5890 | 11.2709 | | 10.3854 | 96.0 | 5952 | 11.1983 | | 10.324 | 97.0 | 6014 | 11.2218 | | 10.324 | 98.0 | 6076 | 11.3307 | | 10.324 | 99.0 | 6138 | 11.2036 | | 10.324 | 100.0 | 6200 | 11.3724 | | 10.324 | 101.0 | 6262 | 11.3443 | | 10.324 | 102.0 | 6324 | 11.2646 | | 10.324 | 103.0 | 6386 | 11.2717 | | 10.324 | 104.0 | 6448 | 11.3106 | | 10.2981 | 105.0 | 6510 | 11.2435 | | 10.2981 | 106.0 | 6572 | 11.2492 | | 10.2981 | 107.0 | 6634 | 11.1113 | | 10.2981 | 108.0 | 6696 | 11.2106 | | 10.2981 | 109.0 | 6758 | 11.2143 | | 10.2981 | 110.0 | 6820 | 11.0152 | | 10.2981 | 111.0 | 6882 | 11.0871 | | 10.2981 | 112.0 | 6944 | 11.0981 | | 10.2536 | 113.0 | 7006 | 11.2439 | | 10.2536 | 114.0 | 7068 | 11.1562 | | 10.2536 | 115.0 | 7130 | 11.1186 | | 10.2536 | 116.0 | 7192 | 11.2282 | | 10.2536 | 117.0 | 7254 | 11.2892 | | 10.2536 | 118.0 | 7316 | 11.1659 | | 10.2536 | 119.0 | 7378 | 11.3439 | | 10.2536 | 120.0 | 7440 | 11.1999 | | 10.2336 | 121.0 | 7502 | 11.2504 | | 10.2336 | 122.0 | 7564 | 11.2896 | | 10.2336 | 123.0 | 7626 | 11.0688 | | 10.2336 | 124.0 | 7688 | 11.1674 | | 10.2336 | 125.0 | 7750 | 11.2072 | | 10.2336 | 126.0 | 7812 | 11.0353 | | 10.2336 | 127.0 | 7874 | 11.0488 | | 10.2336 | 128.0 | 7936 | 11.0932 | | 10.2336 | 129.0 | 7998 | 11.0705 | | 10.2101 | 130.0 | 8060 | 11.2193 | | 10.2101 | 131.0 | 8122 | 11.2278 | | 10.2101 | 132.0 | 8184 | 11.1365 | | 10.2101 | 133.0 | 8246 | 11.0353 | | 10.2101 | 134.0 | 8308 | 11.0146 | | 10.2101 | 135.0 | 8370 | 11.2372 | | 10.2101 | 136.0 | 8432 | 11.1044 | | 10.2101 | 137.0 | 8494 | 11.1340 | | 10.1991 | 138.0 | 8556 | 11.0753 | | 10.1991 | 139.0 | 8618 | 11.0211 | | 10.1991 | 140.0 | 8680 | 10.9309 | | 10.1991 | 141.0 | 8742 | 10.9770 | | 10.1991 | 142.0 | 8804 | 11.0791 | | 10.1991 | 143.0 | 8866 | 11.1165 | | 10.1991 | 144.0 | 8928 | 10.9369 | | 10.1991 | 145.0 | 8990 | 11.1211 | | 10.1925 | 146.0 | 9052 | 11.0745 | | 10.1925 | 147.0 | 9114 | 11.1046 | | 10.1925 | 148.0 | 9176 | 11.0258 | | 10.1925 | 149.0 | 9238 | 11.0266 | | 10.1925 | 150.0 | 9300 | 11.2540 | | 10.1925 | 151.0 | 9362 | 10.9704 | | 10.1925 | 152.0 | 9424 | 11.0341 | | 10.1925 | 153.0 | 9486 | 11.1114 | | 10.1538 | 154.0 | 9548 | 11.0224 | | 10.1538 | 155.0 | 9610 | 10.9150 | | 10.1538 | 156.0 | 9672 | 10.9305 | | 10.1538 | 157.0 | 9734 | 11.0699 | | 10.1538 | 158.0 | 9796 | 10.9901 | | 10.1538 | 159.0 | 9858 | 11.0688 | | 10.1538 | 160.0 | 9920 | 10.9334 | | 10.1538 | 161.0 | 9982 | 10.9852 | | 10.1494 | 162.0 | 10044 | 10.9032 | | 10.1494 | 163.0 | 10106 | 10.9618 | | 10.1494 | 164.0 | 10168 | 10.9473 | | 10.1494 | 165.0 | 10230 | 11.1531 | | 10.1494 | 166.0 | 10292 | 10.8462 | | 10.1494 | 167.0 | 10354 | 10.9577 | | 10.1494 | 168.0 | 10416 | 10.9351 | | 10.1494 | 169.0 | 10478 | 11.2125 | | 10.1424 | 170.0 | 10540 | 11.0546 | | 10.1424 | 171.0 | 10602 | 10.9934 | | 10.1424 | 172.0 | 10664 | 10.8918 | | 10.1424 | 173.0 | 10726 | 10.8868 | | 10.1424 | 174.0 | 10788 | 11.0400 | | 10.1424 | 175.0 | 10850 | 11.1198 | | 10.1424 | 176.0 | 10912 | 11.1595 | | 10.1424 | 177.0 | 10974 | 11.1137 | | 10.1181 | 178.0 | 11036 | 11.1998 | | 10.1181 | 179.0 | 11098 | 11.0494 | | 10.1181 | 180.0 | 11160 | 10.9489 | | 10.1181 | 181.0 | 11222 | 11.0248 | | 10.1181 | 182.0 | 11284 | 10.9912 | | 10.1181 | 183.0 | 11346 | 10.9221 | | 10.1181 | 184.0 | 11408 | 11.0553 | | 10.1181 | 185.0 | 11470 | 11.0055 | | 10.1165 | 186.0 | 11532 | 11.1129 | | 10.1165 | 187.0 | 11594 | 11.0822 | | 10.1165 | 188.0 | 11656 | 11.0509 | | 10.1165 | 189.0 | 11718 | 11.0881 | | 10.1165 | 190.0 | 11780 | 10.8909 | | 10.1165 | 191.0 | 11842 | 11.0489 | | 10.1165 | 192.0 | 11904 | 10.9349 | | 10.1165 | 193.0 | 11966 | 10.8821 | | 10.1021 | 194.0 | 12028 | 11.0552 | | 10.1021 | 195.0 | 12090 | 11.1524 | | 10.1021 | 196.0 | 12152 | 11.0084 | | 10.1021 | 197.0 | 12214 | 11.0870 | | 10.1021 | 198.0 | 12276 | 10.8429 | | 10.1021 | 199.0 | 12338 | 11.0104 | | 10.1021 | 200.0 | 12400 | 10.9269 | | 10.1021 | 201.0 | 12462 | 10.9873 | | 10.1022 | 202.0 | 12524 | 10.9878 | | 10.1022 | 203.0 | 12586 | 10.8828 | | 10.1022 | 204.0 | 12648 | 11.0434 | | 10.1022 | 205.0 | 12710 | 10.9539 | | 10.1022 | 206.0 | 12772 | 10.6848 | | 10.1022 | 207.0 | 12834 | 11.1773 | | 10.1022 | 208.0 | 12896 | 10.9967 | | 10.1022 | 209.0 | 12958 | 10.9989 | | 10.0962 | 210.0 | 13020 | 11.2001 | | 10.0962 | 211.0 | 13082 | 10.9658 | | 10.0962 | 212.0 | 13144 | 11.0099 | | 10.0962 | 213.0 | 13206 | 11.0534 | | 10.0962 | 214.0 | 13268 | 11.1858 | | 10.0962 | 215.0 | 13330 | 11.0441 | | 10.0962 | 216.0 | 13392 | 11.1819 | | 10.0962 | 217.0 | 13454 | 11.0100 | | 10.0861 | 218.0 | 13516 | 11.0071 | | 10.0861 | 219.0 | 13578 | 11.1453 | | 10.0861 | 220.0 | 13640 | 10.9854 | | 10.0861 | 221.0 | 13702 | 11.1206 | | 10.0861 | 222.0 | 13764 | 11.0695 | | 10.0861 | 223.0 | 13826 | 11.0700 | | 10.0861 | 224.0 | 13888 | 10.9683 | | 10.0861 | 225.0 | 13950 | 10.9319 | | 10.0808 | 226.0 | 14012 | 10.9934 | | 10.0808 | 227.0 | 14074 | 10.8787 | | 10.0808 | 228.0 | 14136 | 10.9051 | | 10.0808 | 229.0 | 14198 | 11.0375 | | 10.0808 | 230.0 | 14260 | 11.0259 | | 10.0808 | 231.0 | 14322 | 11.0635 | | 10.0808 | 232.0 | 14384 | 10.8822 | | 10.0808 | 233.0 | 14446 | 10.8910 | | 10.0768 | 234.0 | 14508 | 10.9744 | | 10.0768 | 235.0 | 14570 | 11.0422 | | 10.0768 | 236.0 | 14632 | 11.0398 | | 10.0768 | 237.0 | 14694 | 10.8507 | | 10.0768 | 238.0 | 14756 | 11.0227 | | 10.0768 | 239.0 | 14818 | 11.0273 | | 10.0768 | 240.0 | 14880 | 11.0778 | | 10.0768 | 241.0 | 14942 | 11.0777 | | 10.0792 | 242.0 | 15004 | 10.9423 | | 10.0792 | 243.0 | 15066 | 11.2267 | | 10.0792 | 244.0 | 15128 | 10.8529 | | 10.0792 | 245.0 | 15190 | 11.0566 | | 10.0792 | 246.0 | 15252 | 10.8876 | | 10.0792 | 247.0 | 15314 | 11.1441 | | 10.0792 | 248.0 | 15376 | 10.9090 | | 10.0792 | 249.0 | 15438 | 10.9756 | | 10.0832 | 250.0 | 15500 | 10.9538 | | 10.0832 | 251.0 | 15562 | 10.8424 | | 10.0832 | 252.0 | 15624 | 10.7671 | | 10.0832 | 253.0 | 15686 | 10.9635 | | 10.0832 | 254.0 | 15748 | 10.8490 | | 10.0832 | 255.0 | 15810 | 11.1349 | | 10.0832 | 256.0 | 15872 | 10.8844 | | 10.0832 | 257.0 | 15934 | 10.8656 | | 10.0832 | 258.0 | 15996 | 10.8234 | | 10.0747 | 259.0 | 16058 | 10.9503 | | 10.0747 | 260.0 | 16120 | 10.8856 | | 10.0747 | 261.0 | 16182 | 11.0519 | | 10.0747 | 262.0 | 16244 | 10.8862 | | 10.0747 | 263.0 | 16306 | 10.8974 | | 10.0747 | 264.0 | 16368 | 10.8464 | | 10.0747 | 265.0 | 16430 | 10.9659 | | 10.0747 | 266.0 | 16492 | 10.7426 | | 10.0678 | 267.0 | 16554 | 10.9852 | | 10.0678 | 268.0 | 16616 | 11.0498 | | 10.0678 | 269.0 | 16678 | 10.7894 | | 10.0678 | 270.0 | 16740 | 11.1073 | | 10.0678 | 271.0 | 16802 | 10.8264 | | 10.0678 | 272.0 | 16864 | 10.9315 | | 10.0678 | 273.0 | 16926 | 10.7760 | | 10.0678 | 274.0 | 16988 | 10.9723 | | 10.0631 | 275.0 | 17050 | 10.7482 | | 10.0631 | 276.0 | 17112 | 11.0491 | | 10.0631 | 277.0 | 17174 | 10.7516 | | 10.0631 | 278.0 | 17236 | 10.9505 | | 10.0631 | 279.0 | 17298 | 10.8899 | | 10.0631 | 280.0 | 17360 | 10.7864 | | 10.0631 | 281.0 | 17422 | 10.8660 | | 10.0631 | 282.0 | 17484 | 10.9755 | | 10.0464 | 283.0 | 17546 | 10.9702 | | 10.0464 | 284.0 | 17608 | 10.9664 | | 10.0464 | 285.0 | 17670 | 10.9413 | | 10.0464 | 286.0 | 17732 | 10.9662 | | 10.0464 | 287.0 | 17794 | 10.9511 | | 10.0464 | 288.0 | 17856 | 10.8648 | | 10.0464 | 289.0 | 17918 | 10.8867 | | 10.0464 | 290.0 | 17980 | 11.0379 | | 10.059 | 291.0 | 18042 | 10.9587 | | 10.059 | 292.0 | 18104 | 10.8715 | | 10.059 | 293.0 | 18166 | 11.0329 | | 10.059 | 294.0 | 18228 | 10.9934 | | 10.059 | 295.0 | 18290 | 11.0318 | | 10.059 | 296.0 | 18352 | 10.9496 | | 10.059 | 297.0 | 18414 | 10.9851 | | 10.059 | 298.0 | 18476 | 10.9042 | | 10.0478 | 299.0 | 18538 | 10.8483 | | 10.0478 | 300.0 | 18600 | 11.1284 | | 10.0478 | 301.0 | 18662 | 10.9656 | | 10.0478 | 302.0 | 18724 | 10.9622 | | 10.0478 | 303.0 | 18786 | 11.0226 | | 10.0478 | 304.0 | 18848 | 10.9982 | | 10.0478 | 305.0 | 18910 | 10.9646 | | 10.0478 | 306.0 | 18972 | 11.0949 | | 10.0513 | 307.0 | 19034 | 11.0740 | | 10.0513 | 308.0 | 19096 | 10.8888 | | 10.0513 | 309.0 | 19158 | 11.2476 | | 10.0513 | 310.0 | 19220 | 10.9996 | | 10.0513 | 311.0 | 19282 | 10.8044 | | 10.0513 | 312.0 | 19344 | 10.9493 | | 10.0513 | 313.0 | 19406 | 10.9460 | | 10.0513 | 314.0 | 19468 | 10.9664 | | 10.0363 | 315.0 | 19530 | 10.9196 | | 10.0363 | 316.0 | 19592 | 10.9218 | | 10.0363 | 317.0 | 19654 | 10.8009 | | 10.0363 | 318.0 | 19716 | 11.1215 | | 10.0363 | 319.0 | 19778 | 10.9651 | | 10.0363 | 320.0 | 19840 | 10.9957 | | 10.0363 | 321.0 | 19902 | 11.1449 | | 10.0363 | 322.0 | 19964 | 11.0132 | | 10.0503 | 323.0 | 20026 | 11.1194 | | 10.0503 | 324.0 | 20088 | 10.9650 | | 10.0503 | 325.0 | 20150 | 10.8414 | | 10.0503 | 326.0 | 20212 | 10.8668 | | 10.0503 | 327.0 | 20274 | 11.0100 | | 10.0503 | 328.0 | 20336 | 10.8759 | | 10.0503 | 329.0 | 20398 | 10.9656 | | 10.0503 | 330.0 | 20460 | 11.0078 | | 10.0223 | 331.0 | 20522 | 11.0198 | | 10.0223 | 332.0 | 20584 | 11.0888 | | 10.0223 | 333.0 | 20646 | 11.1058 | | 10.0223 | 334.0 | 20708 | 10.9423 | | 10.0223 | 335.0 | 20770 | 11.1030 | | 10.0223 | 336.0 | 20832 | 11.0819 | | 10.0223 | 337.0 | 20894 | 10.9060 | | 10.0223 | 338.0 | 20956 | 11.0750 | | 10.0321 | 339.0 | 21018 | 11.1101 | | 10.0321 | 340.0 | 21080 | 10.9711 | | 10.0321 | 341.0 | 21142 | 10.9287 | | 10.0321 | 342.0 | 21204 | 10.7962 | | 10.0321 | 343.0 | 21266 | 11.1362 | | 10.0321 | 344.0 | 21328 | 11.1022 | | 10.0321 | 345.0 | 21390 | 10.9997 | | 10.0321 | 346.0 | 21452 | 10.8761 | | 10.0226 | 347.0 | 21514 | 10.9343 | | 10.0226 | 348.0 | 21576 | 10.9110 | | 10.0226 | 349.0 | 21638 | 11.0345 | | 10.0226 | 350.0 | 21700 | 10.8872 | | 10.0226 | 351.0 | 21762 | 10.7667 | | 10.0226 | 352.0 | 21824 | 11.0568 | | 10.0226 | 353.0 | 21886 | 11.0288 | | 10.0226 | 354.0 | 21948 | 11.0664 | | 10.033 | 355.0 | 22010 | 10.9751 | | 10.033 | 356.0 | 22072 | 10.8561 | | 10.033 | 357.0 | 22134 | 10.9609 | | 10.033 | 358.0 | 22196 | 11.0002 | | 10.033 | 359.0 | 22258 | 11.0568 | | 10.033 | 360.0 | 22320 | 10.9586 | | 10.033 | 361.0 | 22382 | 10.9254 | | 10.033 | 362.0 | 22444 | 11.0652 | | 10.0084 | 363.0 | 22506 | 10.9656 | | 10.0084 | 364.0 | 22568 | 11.0611 | | 10.0084 | 365.0 | 22630 | 10.8335 | | 10.0084 | 366.0 | 22692 | 10.9809 | | 10.0084 | 367.0 | 22754 | 11.0209 | | 10.0084 | 368.0 | 22816 | 10.9149 | | 10.0084 | 369.0 | 22878 | 11.0207 | | 10.0084 | 370.0 | 22940 | 10.8774 | | 10.024 | 371.0 | 23002 | 10.9855 | | 10.024 | 372.0 | 23064 | 10.9064 | | 10.024 | 373.0 | 23126 | 10.9518 | | 10.024 | 374.0 | 23188 | 10.8775 | | 10.024 | 375.0 | 23250 | 10.9193 | | 10.024 | 376.0 | 23312 | 11.1098 | | 10.024 | 377.0 | 23374 | 11.1486 | | 10.024 | 378.0 | 23436 | 11.0895 | | 10.024 | 379.0 | 23498 | 10.9159 | | 10.0052 | 380.0 | 23560 | 11.1095 | | 10.0052 | 381.0 | 23622 | 11.0949 | | 10.0052 | 382.0 | 23684 | 10.9837 | | 10.0052 | 383.0 | 23746 | 10.9433 | | 10.0052 | 384.0 | 23808 | 10.9104 | | 10.0052 | 385.0 | 23870 | 10.9512 | | 10.0052 | 386.0 | 23932 | 11.1075 | | 10.0052 | 387.0 | 23994 | 10.8660 | | 10.0218 | 388.0 | 24056 | 11.0521 | | 10.0218 | 389.0 | 24118 | 10.8989 | | 10.0218 | 390.0 | 24180 | 10.9139 | | 10.0218 | 391.0 | 24242 | 11.1079 | | 10.0218 | 392.0 | 24304 | 10.9063 | | 10.0218 | 393.0 | 24366 | 11.0851 | | 10.0218 | 394.0 | 24428 | 10.9809 | | 10.0218 | 395.0 | 24490 | 10.9320 | | 10.0039 | 396.0 | 24552 | 11.0525 | | 10.0039 | 397.0 | 24614 | 11.0378 | | 10.0039 | 398.0 | 24676 | 11.0006 | | 10.0039 | 399.0 | 24738 | 11.0284 | | 10.0039 | 400.0 | 24800 | 11.0055 | | 10.0039 | 401.0 | 24862 | 11.0104 | | 10.0039 | 402.0 | 24924 | 11.1168 | | 10.0039 | 403.0 | 24986 | 10.8311 | | 10.0186 | 404.0 | 25048 | 10.8904 | | 10.0186 | 405.0 | 25110 | 10.8615 | | 10.0186 | 406.0 | 25172 | 10.9520 | | 10.0186 | 407.0 | 25234 | 10.9112 | | 10.0186 | 408.0 | 25296 | 11.0280 | | 10.0186 | 409.0 | 25358 | 10.8281 | | 10.0186 | 410.0 | 25420 | 11.1875 | | 10.0186 | 411.0 | 25482 | 11.0089 | | 10.0146 | 412.0 | 25544 | 11.0386 | | 10.0146 | 413.0 | 25606 | 10.8152 | | 10.0146 | 414.0 | 25668 | 10.9460 | | 10.0146 | 415.0 | 25730 | 10.9922 | | 10.0146 | 416.0 | 25792 | 11.0850 | | 10.0146 | 417.0 | 25854 | 11.0024 | | 10.0146 | 418.0 | 25916 | 11.0934 | | 10.0146 | 419.0 | 25978 | 11.0953 | | 10.0251 | 420.0 | 26040 | 10.8996 | | 10.0251 | 421.0 | 26102 | 10.9833 | | 10.0251 | 422.0 | 26164 | 10.7546 | | 10.0251 | 423.0 | 26226 | 10.9770 | | 10.0251 | 424.0 | 26288 | 11.0632 | | 10.0251 | 425.0 | 26350 | 10.9244 | | 10.0251 | 426.0 | 26412 | 10.9376 | | 10.0251 | 427.0 | 26474 | 11.0441 | | 9.9776 | 428.0 | 26536 | 11.0679 | | 9.9776 | 429.0 | 26598 | 11.0663 | | 9.9776 | 430.0 | 26660 | 10.9885 | | 9.9776 | 431.0 | 26722 | 10.9566 | | 9.9776 | 432.0 | 26784 | 11.1560 | | 9.9776 | 433.0 | 26846 | 11.0590 | | 9.9776 | 434.0 | 26908 | 11.0154 | | 9.9776 | 435.0 | 26970 | 10.9648 | | 10.0079 | 436.0 | 27032 | 11.0840 | | 10.0079 | 437.0 | 27094 | 10.8103 | | 10.0079 | 438.0 | 27156 | 10.8994 | | 10.0079 | 439.0 | 27218 | 11.0360 | | 10.0079 | 440.0 | 27280 | 10.9094 | | 10.0079 | 441.0 | 27342 | 10.9402 | | 10.0079 | 442.0 | 27404 | 10.8771 | | 10.0079 | 443.0 | 27466 | 11.0934 | | 10.0049 | 444.0 | 27528 | 11.0897 | | 10.0049 | 445.0 | 27590 | 11.0493 | | 10.0049 | 446.0 | 27652 | 11.0395 | | 10.0049 | 447.0 | 27714 | 10.8990 | | 10.0049 | 448.0 | 27776 | 11.1673 | | 10.0049 | 449.0 | 27838 | 11.1582 | | 10.0049 | 450.0 | 27900 | 10.8591 | | 10.0049 | 451.0 | 27962 | 11.0792 | | 9.9924 | 452.0 | 28024 | 11.1450 | | 9.9924 | 453.0 | 28086 | 10.9819 | | 9.9924 | 454.0 | 28148 | 10.8871 | | 9.9924 | 455.0 | 28210 | 10.9915 | | 9.9924 | 456.0 | 28272 | 11.0373 | | 9.9924 | 457.0 | 28334 | 10.9383 | | 9.9924 | 458.0 | 28396 | 11.1292 | | 9.9924 | 459.0 | 28458 | 11.1688 | | 9.9918 | 460.0 | 28520 | 11.0430 | | 9.9918 | 461.0 | 28582 | 11.0710 | | 9.9918 | 462.0 | 28644 | 11.0110 | | 9.9918 | 463.0 | 28706 | 11.0876 | | 9.9918 | 464.0 | 28768 | 11.0982 | | 9.9918 | 465.0 | 28830 | 10.9625 | | 9.9918 | 466.0 | 28892 | 10.9642 | | 9.9918 | 467.0 | 28954 | 10.7989 | | 9.9799 | 468.0 | 29016 | 11.0038 | | 9.9799 | 469.0 | 29078 | 11.1245 | | 9.9799 | 470.0 | 29140 | 10.9135 | | 9.9799 | 471.0 | 29202 | 10.9432 | | 9.9799 | 472.0 | 29264 | 10.8295 | | 9.9799 | 473.0 | 29326 | 10.9277 | | 9.9799 | 474.0 | 29388 | 11.0949 | | 9.9799 | 475.0 | 29450 | 11.0374 | | 9.9961 | 476.0 | 29512 | 10.9588 | | 9.9961 | 477.0 | 29574 | 11.0341 | | 9.9961 | 478.0 | 29636 | 10.9541 | | 9.9961 | 479.0 | 29698 | 10.9343 | | 9.9961 | 480.0 | 29760 | 10.9599 | | 9.9961 | 481.0 | 29822 | 10.9533 | | 9.9961 | 482.0 | 29884 | 11.2046 | | 9.9961 | 483.0 | 29946 | 10.9352 | | 10.006 | 484.0 | 30008 | 11.1727 | | 10.006 | 485.0 | 30070 | 10.9956 | | 10.006 | 486.0 | 30132 | 11.1664 | | 10.006 | 487.0 | 30194 | 11.0949 | | 10.006 | 488.0 | 30256 | 10.9489 | | 10.006 | 489.0 | 30318 | 11.0049 | | 10.006 | 490.0 | 30380 | 11.1852 | | 10.006 | 491.0 | 30442 | 11.1018 | | 10.0083 | 492.0 | 30504 | 10.9130 | | 10.0083 | 493.0 | 30566 | 10.9352 | | 10.0083 | 494.0 | 30628 | 10.9716 | | 10.0083 | 495.0 | 30690 | 11.1115 | | 10.0083 | 496.0 | 30752 | 10.9810 | | 10.0083 | 497.0 | 30814 | 10.9703 | | 10.0083 | 498.0 | 30876 | 10.9395 | | 10.0083 | 499.0 | 30938 | 11.0189 | | 10.0106 | 500.0 | 31000 | 10.9759 | ### Framework versions - Transformers 4.20.1 - Pytorch 1.11.0 - Datasets 2.1.0 - Tokenizers 0.12.1