BERiT_2000_custom_architecture_150_epochs_2_heb_am_vocalized
This model is a fine-tuned version of roberta-base on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 3.6490
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0005
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 150
Training results
Training Loss | Epoch | Step | Validation Loss |
---|---|---|---|
6.8292 | 0.1936 | 500 | 6.6653 |
6.6081 | 0.3873 | 1000 | 6.4747 |
6.4639 | 0.5809 | 1500 | 6.3805 |
6.3724 | 0.7746 | 2000 | 6.2879 |
6.3267 | 0.9682 | 2500 | 6.2524 |
6.314 | 1.1619 | 3000 | 6.2107 |
6.2862 | 1.3555 | 3500 | 6.2337 |
6.2405 | 1.5492 | 4000 | 6.2512 |
6.2335 | 1.7428 | 4500 | 6.1942 |
6.2097 | 1.9365 | 5000 | 6.2115 |
6.2179 | 2.1301 | 5500 | 6.2054 |
6.201 | 2.3238 | 6000 | 6.1903 |
6.2105 | 2.5174 | 6500 | 6.1802 |
6.2065 | 2.7111 | 7000 | 6.2193 |
6.2057 | 2.9047 | 7500 | 6.2172 |
6.1816 | 3.0984 | 8000 | 6.1880 |
6.1766 | 3.2920 | 8500 | 6.2251 |
6.1566 | 3.4857 | 9000 | 6.2344 |
6.2125 | 3.6793 | 9500 | 6.2343 |
6.1936 | 3.8730 | 10000 | 6.1873 |
6.1538 | 4.0666 | 10500 | 6.2016 |
6.1762 | 4.2603 | 11000 | 6.2031 |
6.202 | 4.4539 | 11500 | 6.2060 |
6.1426 | 4.6476 | 12000 | 6.2382 |
6.1568 | 4.8412 | 12500 | 6.2447 |
6.1514 | 5.0349 | 13000 | 6.2607 |
6.185 | 5.2285 | 13500 | 6.2460 |
6.1544 | 5.4222 | 14000 | 6.1895 |
6.1269 | 5.6158 | 14500 | 6.2177 |
6.1391 | 5.8095 | 15000 | 6.1928 |
6.1389 | 6.0031 | 15500 | 6.2240 |
6.1263 | 6.1967 | 16000 | 6.2199 |
6.1636 | 6.3904 | 16500 | 6.1996 |
6.1293 | 6.5840 | 17000 | 6.1859 |
6.106 | 6.7777 | 17500 | 6.2058 |
6.1583 | 6.9713 | 18000 | 6.2068 |
6.1227 | 7.1650 | 18500 | 6.2075 |
6.1166 | 7.3586 | 19000 | 6.1952 |
6.1264 | 7.5523 | 19500 | 6.1783 |
6.1459 | 7.7459 | 20000 | 6.1819 |
6.1582 | 7.9396 | 20500 | 6.1375 |
6.1428 | 8.1332 | 21000 | 6.1926 |
6.0972 | 8.3269 | 21500 | 6.1695 |
6.0948 | 8.5205 | 22000 | 6.2274 |
6.1044 | 8.7142 | 22500 | 6.1639 |
6.0811 | 8.9078 | 23000 | 6.1646 |
6.1358 | 9.1015 | 23500 | 6.1854 |
6.0932 | 9.2951 | 24000 | 6.1404 |
6.0982 | 9.4888 | 24500 | 6.1456 |
6.0979 | 9.6824 | 25000 | 6.1634 |
6.1137 | 9.8761 | 25500 | 6.1626 |
6.1216 | 10.0697 | 26000 | 6.1513 |
6.0751 | 10.2634 | 26500 | 6.1691 |
6.0998 | 10.4570 | 27000 | 6.1323 |
6.0763 | 10.6507 | 27500 | 6.0996 |
6.0575 | 10.8443 | 28000 | 6.1790 |
6.0892 | 11.0380 | 28500 | 6.1181 |
6.1017 | 11.2316 | 29000 | 6.1925 |
6.0808 | 11.4253 | 29500 | 6.2045 |
6.0338 | 11.6189 | 30000 | 6.1933 |
6.0737 | 11.8125 | 30500 | 6.1264 |
6.1021 | 12.0062 | 31000 | 6.0902 |
6.0583 | 12.1998 | 31500 | 6.1725 |
6.0776 | 12.3935 | 32000 | 6.1291 |
6.0649 | 12.5871 | 32500 | 6.1939 |
6.0382 | 12.7808 | 33000 | 6.1385 |
6.0644 | 12.9744 | 33500 | 6.1369 |
6.0667 | 13.1681 | 34000 | 6.1513 |
6.0553 | 13.3617 | 34500 | 6.1462 |
6.0492 | 13.5554 | 35000 | 6.1388 |
6.0536 | 13.7490 | 35500 | 6.1052 |
6.0772 | 13.9427 | 36000 | 6.1079 |
6.0968 | 14.1363 | 36500 | 6.0717 |
6.059 | 14.3300 | 37000 | 6.1146 |
6.0597 | 14.5236 | 37500 | 6.1459 |
6.0655 | 14.7173 | 38000 | 6.0903 |
6.0571 | 14.9109 | 38500 | 6.0758 |
6.0299 | 15.1046 | 39000 | 6.1276 |
6.0502 | 15.2982 | 39500 | 6.1508 |
6.0169 | 15.4919 | 40000 | 6.0623 |
6.0277 | 15.6855 | 40500 | 6.0366 |
6.0745 | 15.8792 | 41000 | 6.1786 |
6.0639 | 16.0728 | 41500 | 6.1268 |
6.0131 | 16.2665 | 42000 | 6.0677 |
6.0467 | 16.4601 | 42500 | 6.0779 |
6.024 | 16.6538 | 43000 | 6.1133 |
6.0391 | 16.8474 | 43500 | 6.1201 |
6.038 | 17.0411 | 44000 | 6.1148 |
6.0244 | 17.2347 | 44500 | 6.1200 |
6.0234 | 17.4284 | 45000 | 6.0953 |
6.016 | 17.6220 | 45500 | 6.0500 |
5.9708 | 17.8156 | 46000 | 6.1189 |
6.0058 | 18.0093 | 46500 | 6.0646 |
6.0324 | 18.2029 | 47000 | 6.1335 |
6.0199 | 18.3966 | 47500 | 6.0839 |
5.9983 | 18.5902 | 48000 | 6.0985 |
6.0116 | 18.7839 | 48500 | 6.0716 |
6.0287 | 18.9775 | 49000 | 6.0477 |
5.9992 | 19.1712 | 49500 | 6.0525 |
6.0038 | 19.3648 | 50000 | 5.9906 |
5.9815 | 19.5585 | 50500 | 6.0704 |
5.9819 | 19.7521 | 51000 | 6.0696 |
5.9733 | 19.9458 | 51500 | 6.0512 |
5.9831 | 20.1394 | 52000 | 6.0353 |
5.9525 | 20.3331 | 52500 | 6.0279 |
6.0209 | 20.5267 | 53000 | 6.0384 |
6.0105 | 20.7204 | 53500 | 6.0467 |
5.9657 | 20.9140 | 54000 | 6.0295 |
5.9734 | 21.1077 | 54500 | 6.0251 |
5.9896 | 21.3013 | 55000 | 6.0677 |
5.9876 | 21.4950 | 55500 | 6.0247 |
5.9599 | 21.6886 | 56000 | 6.0182 |
5.9876 | 21.8823 | 56500 | 5.9948 |
5.9769 | 22.0759 | 57000 | 5.9918 |
5.985 | 22.2696 | 57500 | 5.9939 |
5.9549 | 22.4632 | 58000 | 6.0447 |
5.9571 | 22.6569 | 58500 | 6.0326 |
5.9648 | 22.8505 | 59000 | 6.0003 |
5.9414 | 23.0442 | 59500 | 5.9473 |
5.9561 | 23.2378 | 60000 | 5.9609 |
5.938 | 23.4314 | 60500 | 6.0111 |
5.9646 | 23.6251 | 61000 | 5.9694 |
5.91 | 23.8187 | 61500 | 5.9625 |
5.9178 | 24.0124 | 62000 | 5.9925 |
5.9175 | 24.2060 | 62500 | 5.9258 |
5.9237 | 24.3997 | 63000 | 5.9175 |
5.9211 | 24.5933 | 63500 | 5.8894 |
5.9044 | 24.7870 | 64000 | 5.9770 |
5.9209 | 24.9806 | 64500 | 5.9092 |
5.9206 | 25.1743 | 65000 | 5.9483 |
5.9155 | 25.3679 | 65500 | 5.9513 |
5.8903 | 25.5616 | 66000 | 5.9066 |
5.8957 | 25.7552 | 66500 | 5.9230 |
5.9178 | 25.9489 | 67000 | 5.8969 |
5.854 | 26.1425 | 67500 | 5.9792 |
5.8999 | 26.3362 | 68000 | 5.9164 |
5.8916 | 26.5298 | 68500 | 5.9135 |
5.8743 | 26.7235 | 69000 | 5.8661 |
5.8695 | 26.9171 | 69500 | 5.8496 |
5.8577 | 27.1108 | 70000 | 5.8879 |
5.8483 | 27.3044 | 70500 | 5.8503 |
5.8185 | 27.4981 | 71000 | 5.8294 |
5.8446 | 27.6917 | 71500 | 5.8073 |
5.8814 | 27.8854 | 72000 | 5.8238 |
5.8356 | 28.0790 | 72500 | 5.8217 |
5.8024 | 28.2727 | 73000 | 5.8453 |
5.8639 | 28.4663 | 73500 | 5.8210 |
5.8335 | 28.6600 | 74000 | 5.7947 |
5.8275 | 28.8536 | 74500 | 5.8086 |
5.824 | 29.0473 | 75000 | 5.7778 |
5.799 | 29.2409 | 75500 | 5.8068 |
5.8135 | 29.4345 | 76000 | 5.7777 |
5.8005 | 29.6282 | 76500 | 5.7950 |
5.7752 | 29.8218 | 77000 | 5.7633 |
5.7837 | 30.0155 | 77500 | 5.8382 |
5.7848 | 30.2091 | 78000 | 5.6831 |
5.7792 | 30.4028 | 78500 | 5.6924 |
5.7801 | 30.5964 | 79000 | 5.7232 |
5.7618 | 30.7901 | 79500 | 5.6490 |
5.8056 | 30.9837 | 80000 | 5.6914 |
5.7634 | 31.1774 | 80500 | 5.7227 |
5.785 | 31.3710 | 81000 | 5.7027 |
5.7636 | 31.5647 | 81500 | 5.6681 |
5.7335 | 31.7583 | 82000 | 5.6583 |
5.758 | 31.9520 | 82500 | 5.6327 |
5.7189 | 32.1456 | 83000 | 5.6554 |
5.6934 | 32.3393 | 83500 | 5.6172 |
5.7224 | 32.5329 | 84000 | 5.5835 |
5.6718 | 32.7266 | 84500 | 5.5725 |
5.7006 | 32.9202 | 85000 | 5.5804 |
5.7237 | 33.1139 | 85500 | 5.5397 |
5.6662 | 33.3075 | 86000 | 5.5788 |
5.6902 | 33.5012 | 86500 | 5.5304 |
5.6489 | 33.6948 | 87000 | 5.5039 |
5.6962 | 33.8885 | 87500 | 5.5039 |
5.6443 | 34.0821 | 88000 | 5.4401 |
5.6406 | 34.2758 | 88500 | 5.4268 |
5.627 | 34.4694 | 89000 | 5.4615 |
5.6488 | 34.6631 | 89500 | 5.4192 |
5.6195 | 34.8567 | 90000 | 5.3049 |
5.5708 | 35.0503 | 90500 | 5.4265 |
5.5911 | 35.2440 | 91000 | 5.2762 |
5.5866 | 35.4376 | 91500 | 5.3317 |
5.5857 | 35.6313 | 92000 | 5.2564 |
5.563 | 35.8249 | 92500 | 5.3021 |
5.5481 | 36.0186 | 93000 | 5.2022 |
5.5227 | 36.2122 | 93500 | 5.1294 |
5.4793 | 36.4059 | 94000 | 5.1087 |
5.4838 | 36.5995 | 94500 | 5.1437 |
5.4792 | 36.7932 | 95000 | 5.1284 |
5.4879 | 36.9868 | 95500 | 5.0501 |
5.4839 | 37.1805 | 96000 | 5.0108 |
5.4517 | 37.3741 | 96500 | 5.0410 |
5.4196 | 37.5678 | 97000 | 5.0196 |
5.4324 | 37.7614 | 97500 | 4.9257 |
5.4333 | 37.9551 | 98000 | 4.9084 |
5.4007 | 38.1487 | 98500 | 4.8744 |
5.3932 | 38.3424 | 99000 | 4.9698 |
5.3815 | 38.5360 | 99500 | 4.9262 |
5.3665 | 38.7297 | 100000 | 4.9391 |
5.3895 | 38.9233 | 100500 | 4.8432 |
5.3374 | 39.1170 | 101000 | 4.7807 |
5.3052 | 39.3106 | 101500 | 4.7828 |
5.3363 | 39.5043 | 102000 | 4.8032 |
5.2916 | 39.6979 | 102500 | 4.7303 |
5.3287 | 39.8916 | 103000 | 4.7817 |
5.2972 | 40.0852 | 103500 | 4.7316 |
5.2912 | 40.2789 | 104000 | 4.7483 |
5.2687 | 40.4725 | 104500 | 4.6831 |
5.2889 | 40.6662 | 105000 | 4.7307 |
5.2696 | 40.8598 | 105500 | 4.6318 |
5.2522 | 41.0534 | 106000 | 4.6295 |
5.2154 | 41.2471 | 106500 | 4.5981 |
5.2259 | 41.4407 | 107000 | 4.5960 |
5.2265 | 41.6344 | 107500 | 4.5883 |
5.2329 | 41.8280 | 108000 | 4.5900 |
5.2137 | 42.0217 | 108500 | 4.6289 |
5.2099 | 42.2153 | 109000 | 4.5895 |
5.2189 | 42.4090 | 109500 | 4.5477 |
5.2096 | 42.6026 | 110000 | 4.5973 |
5.2003 | 42.7963 | 110500 | 4.5600 |
5.1946 | 42.9899 | 111000 | 4.5769 |
5.1581 | 43.1836 | 111500 | 4.5390 |
5.1412 | 43.3772 | 112000 | 4.5388 |
5.1894 | 43.5709 | 112500 | 4.5477 |
5.169 | 43.7645 | 113000 | 4.5633 |
5.1428 | 43.9582 | 113500 | 4.5124 |
5.1314 | 44.1518 | 114000 | 4.5104 |
5.1484 | 44.3455 | 114500 | 4.5105 |
5.1354 | 44.5391 | 115000 | 4.4692 |
5.123 | 44.7328 | 115500 | 4.4487 |
5.1076 | 44.9264 | 116000 | 4.4673 |
5.1249 | 45.1201 | 116500 | 4.4148 |
5.1134 | 45.3137 | 117000 | 4.4427 |
5.1182 | 45.5074 | 117500 | 4.4064 |
5.1113 | 45.7010 | 118000 | 4.3928 |
5.0943 | 45.8947 | 118500 | 4.4398 |
5.1024 | 46.0883 | 119000 | 4.4041 |
5.0489 | 46.2820 | 119500 | 4.4397 |
5.0226 | 46.4756 | 120000 | 4.3907 |
5.1199 | 46.6692 | 120500 | 4.3906 |
5.0533 | 46.8629 | 121000 | 4.4336 |
5.0266 | 47.0565 | 121500 | 4.3855 |
5.0777 | 47.2502 | 122000 | 4.3777 |
5.0288 | 47.4438 | 122500 | 4.3883 |
5.0279 | 47.6375 | 123000 | 4.3357 |
5.064 | 47.8311 | 123500 | 4.3728 |
5.019 | 48.0248 | 124000 | 4.3189 |
5.0072 | 48.2184 | 124500 | 4.3528 |
5.0046 | 48.4121 | 125000 | 4.2882 |
5.0348 | 48.6057 | 125500 | 4.3147 |
5.0184 | 48.7994 | 126000 | 4.3294 |
5.0284 | 48.9930 | 126500 | 4.2760 |
5.0051 | 49.1867 | 127000 | 4.2928 |
5.0328 | 49.3803 | 127500 | 4.3105 |
5.0404 | 49.5740 | 128000 | 4.2637 |
5.0 | 49.7676 | 128500 | 4.3090 |
4.9966 | 49.9613 | 129000 | 4.2247 |
4.9961 | 50.1549 | 129500 | 4.2761 |
5.0104 | 50.3486 | 130000 | 4.2644 |
4.9573 | 50.5422 | 130500 | 4.2952 |
4.9814 | 50.7359 | 131000 | 4.2671 |
4.9644 | 50.9295 | 131500 | 4.2593 |
4.9565 | 51.1232 | 132000 | 4.2320 |
4.9438 | 51.3168 | 132500 | 4.2728 |
4.9541 | 51.5105 | 133000 | 4.3011 |
4.964 | 51.7041 | 133500 | 4.2579 |
4.9672 | 51.8978 | 134000 | 4.2718 |
4.9769 | 52.0914 | 134500 | 4.2479 |
4.9342 | 52.2851 | 135000 | 4.2368 |
4.9299 | 52.4787 | 135500 | 4.2070 |
4.9359 | 52.6723 | 136000 | 4.1851 |
4.9527 | 52.8660 | 136500 | 4.1856 |
4.9595 | 53.0596 | 137000 | 4.1904 |
4.8905 | 53.2533 | 137500 | 4.2284 |
4.8959 | 53.4469 | 138000 | 4.2043 |
4.9117 | 53.6406 | 138500 | 4.2046 |
4.9455 | 53.8342 | 139000 | 4.1601 |
4.924 | 54.0279 | 139500 | 4.1897 |
4.9095 | 54.2215 | 140000 | 4.1883 |
4.9301 | 54.4152 | 140500 | 4.2107 |
4.9245 | 54.6088 | 141000 | 4.1843 |
4.8943 | 54.8025 | 141500 | 4.1660 |
4.9389 | 54.9961 | 142000 | 4.1003 |
4.8923 | 55.1898 | 142500 | 4.1336 |
4.8744 | 55.3834 | 143000 | 4.1473 |
4.881 | 55.5771 | 143500 | 4.1421 |
4.9113 | 55.7707 | 144000 | 4.1281 |
4.9092 | 55.9644 | 144500 | 4.1598 |
4.9196 | 56.1580 | 145000 | 4.1527 |
4.8645 | 56.3517 | 145500 | 4.1509 |
4.8909 | 56.5453 | 146000 | 4.1260 |
4.9075 | 56.7390 | 146500 | 4.0816 |
4.8808 | 56.9326 | 147000 | 4.1153 |
4.8699 | 57.1263 | 147500 | 4.1395 |
4.9228 | 57.3199 | 148000 | 4.0929 |
4.8921 | 57.5136 | 148500 | 4.0634 |
4.8373 | 57.7072 | 149000 | 4.0886 |
4.8811 | 57.9009 | 149500 | 4.1376 |
4.8302 | 58.0945 | 150000 | 4.1601 |
4.8658 | 58.2881 | 150500 | 4.0687 |
4.8583 | 58.4818 | 151000 | 4.0568 |
4.8335 | 58.6754 | 151500 | 4.0947 |
4.8738 | 58.8691 | 152000 | 4.0730 |
4.8236 | 59.0627 | 152500 | 4.0980 |
4.8524 | 59.2564 | 153000 | 4.0692 |
4.8234 | 59.4500 | 153500 | 4.0992 |
4.8628 | 59.6437 | 154000 | 4.0811 |
4.8245 | 59.8373 | 154500 | 4.1100 |
4.8642 | 60.0310 | 155000 | 4.0195 |
4.8005 | 60.2246 | 155500 | 4.0788 |
4.8715 | 60.4183 | 156000 | 4.0182 |
4.7888 | 60.6119 | 156500 | 4.0454 |
4.8026 | 60.8056 | 157000 | 4.0185 |
4.8607 | 60.9992 | 157500 | 4.0626 |
4.8332 | 61.1929 | 158000 | 4.0101 |
4.8283 | 61.3865 | 158500 | 4.0159 |
4.8275 | 61.5802 | 159000 | 4.0750 |
4.8242 | 61.7738 | 159500 | 4.0017 |
4.7877 | 61.9675 | 160000 | 4.1124 |
4.832 | 62.1611 | 160500 | 4.0515 |
4.8158 | 62.3548 | 161000 | 4.0083 |
4.842 | 62.5484 | 161500 | 3.9895 |
4.8079 | 62.7421 | 162000 | 4.0212 |
4.8223 | 62.9357 | 162500 | 3.9834 |
4.785 | 63.1294 | 163000 | 4.0595 |
4.8286 | 63.3230 | 163500 | 3.9496 |
4.7848 | 63.5167 | 164000 | 4.0207 |
4.8145 | 63.7103 | 164500 | 3.9480 |
4.7748 | 63.9040 | 165000 | 3.9902 |
4.8046 | 64.0976 | 165500 | 3.9718 |
4.7521 | 64.2912 | 166000 | 4.0421 |
4.7875 | 64.4849 | 166500 | 3.9574 |
4.7952 | 64.6785 | 167000 | 3.9784 |
4.833 | 64.8722 | 167500 | 3.9668 |
4.8252 | 65.0658 | 168000 | 3.9914 |
4.7502 | 65.2595 | 168500 | 3.9608 |
4.77 | 65.4531 | 169000 | 3.9212 |
4.8152 | 65.6468 | 169500 | 3.9697 |
4.7886 | 65.8404 | 170000 | 4.0165 |
4.7859 | 66.0341 | 170500 | 3.9606 |
4.7845 | 66.2277 | 171000 | 3.9947 |
4.7338 | 66.4214 | 171500 | 3.9398 |
4.7833 | 66.6150 | 172000 | 3.9577 |
4.7549 | 66.8087 | 172500 | 3.9581 |
4.7849 | 67.0023 | 173000 | 3.9250 |
4.7385 | 67.1960 | 173500 | 3.9278 |
4.7453 | 67.3896 | 174000 | 3.9429 |
4.7567 | 67.5833 | 174500 | 3.9960 |
4.7871 | 67.7769 | 175000 | 3.9168 |
4.7572 | 67.9706 | 175500 | 3.8975 |
4.7468 | 68.1642 | 176000 | 3.9798 |
4.7336 | 68.3579 | 176500 | 3.9709 |
4.7613 | 68.5515 | 177000 | 3.9041 |
4.7582 | 68.7452 | 177500 | 3.9456 |
4.7528 | 68.9388 | 178000 | 3.9854 |
4.7766 | 69.1325 | 178500 | 3.9155 |
4.7667 | 69.3261 | 179000 | 3.9173 |
4.7464 | 69.5198 | 179500 | 3.9317 |
4.7393 | 69.7134 | 180000 | 3.9443 |
4.7764 | 69.9070 | 180500 | 3.8960 |
4.7131 | 70.1007 | 181000 | 3.9430 |
4.7639 | 70.2943 | 181500 | 3.9493 |
4.7078 | 70.4880 | 182000 | 3.8614 |
4.7255 | 70.6816 | 182500 | 3.9380 |
4.7739 | 70.8753 | 183000 | 3.9162 |
4.751 | 71.0689 | 183500 | 3.9651 |
4.7336 | 71.2626 | 184000 | 3.8497 |
4.7358 | 71.4562 | 184500 | 3.9524 |
4.7196 | 71.6499 | 185000 | 3.9017 |
4.7505 | 71.8435 | 185500 | 3.8546 |
4.7361 | 72.0372 | 186000 | 3.8973 |
4.7095 | 72.2308 | 186500 | 3.9193 |
4.7294 | 72.4245 | 187000 | 3.9343 |
4.7286 | 72.6181 | 187500 | 3.8865 |
4.7248 | 72.8118 | 188000 | 3.9182 |
4.7232 | 73.0054 | 188500 | 3.9105 |
4.7562 | 73.1991 | 189000 | 3.8870 |
4.7051 | 73.3927 | 189500 | 3.9733 |
4.6903 | 73.5864 | 190000 | 3.8708 |
4.726 | 73.7800 | 190500 | 3.8900 |
4.7158 | 73.9737 | 191000 | 3.8977 |
4.6848 | 74.1673 | 191500 | 3.9057 |
4.7354 | 74.3610 | 192000 | 3.8246 |
4.6949 | 74.5546 | 192500 | 3.8850 |
4.7441 | 74.7483 | 193000 | 3.8742 |
4.7149 | 74.9419 | 193500 | 3.8777 |
4.7138 | 75.1356 | 194000 | 3.9410 |
4.7283 | 75.3292 | 194500 | 3.8757 |
4.7062 | 75.5229 | 195000 | 3.8598 |
4.6882 | 75.7165 | 195500 | 3.8663 |
4.676 | 75.9101 | 196000 | 3.8612 |
4.7012 | 76.1038 | 196500 | 3.8605 |
4.7067 | 76.2974 | 197000 | 3.8449 |
4.6741 | 76.4911 | 197500 | 3.8367 |
4.7081 | 76.6847 | 198000 | 3.8917 |
4.6722 | 76.8784 | 198500 | 3.8330 |
4.7121 | 77.0720 | 199000 | 3.9040 |
4.7001 | 77.2657 | 199500 | 3.8497 |
4.6488 | 77.4593 | 200000 | 3.8355 |
4.6881 | 77.6530 | 200500 | 3.8505 |
4.6576 | 77.8466 | 201000 | 3.8649 |
4.6987 | 78.0403 | 201500 | 3.8702 |
4.699 | 78.2339 | 202000 | 3.8523 |
4.6646 | 78.4276 | 202500 | 3.8136 |
4.725 | 78.6212 | 203000 | 3.8068 |
4.6583 | 78.8149 | 203500 | 3.8316 |
4.6897 | 79.0085 | 204000 | 3.8243 |
4.6709 | 79.2022 | 204500 | 3.8413 |
4.6668 | 79.3958 | 205000 | 3.8540 |
4.6595 | 79.5895 | 205500 | 3.8325 |
4.7162 | 79.7831 | 206000 | 3.8456 |
4.6463 | 79.9768 | 206500 | 3.8372 |
4.6587 | 80.1704 | 207000 | 3.8282 |
4.6469 | 80.3641 | 207500 | 3.8994 |
4.6703 | 80.5577 | 208000 | 3.8414 |
4.6663 | 80.7514 | 208500 | 3.8616 |
4.6452 | 80.9450 | 209000 | 3.7995 |
4.6579 | 81.1387 | 209500 | 3.8125 |
4.6931 | 81.3323 | 210000 | 3.8220 |
4.6515 | 81.5259 | 210500 | 3.8243 |
4.6705 | 81.7196 | 211000 | 3.8334 |
4.6678 | 81.9132 | 211500 | 3.8118 |
4.6621 | 82.1069 | 212000 | 3.8572 |
4.6666 | 82.3005 | 212500 | 3.9069 |
4.6537 | 82.4942 | 213000 | 3.8049 |
4.6639 | 82.6878 | 213500 | 3.8360 |
4.6864 | 82.8815 | 214000 | 3.7987 |
4.649 | 83.0751 | 214500 | 3.8088 |
4.6414 | 83.2688 | 215000 | 3.8258 |
4.6554 | 83.4624 | 215500 | 3.7669 |
4.6534 | 83.6561 | 216000 | 3.8019 |
4.6297 | 83.8497 | 216500 | 3.7960 |
4.6351 | 84.0434 | 217000 | 3.7918 |
4.6586 | 84.2370 | 217500 | 3.7566 |
4.6369 | 84.4307 | 218000 | 3.8534 |
4.6499 | 84.6243 | 218500 | 3.8371 |
4.6741 | 84.8180 | 219000 | 3.8186 |
4.6346 | 85.0116 | 219500 | 3.8050 |
4.661 | 85.2053 | 220000 | 3.8452 |
4.6378 | 85.3989 | 220500 | 3.8106 |
4.5802 | 85.5926 | 221000 | 3.8536 |
4.6573 | 85.7862 | 221500 | 3.8201 |
4.6531 | 85.9799 | 222000 | 3.8553 |
4.6177 | 86.1735 | 222500 | 3.8140 |
4.6294 | 86.3672 | 223000 | 3.7528 |
4.6577 | 86.5608 | 223500 | 3.7969 |
4.6377 | 86.7545 | 224000 | 3.7863 |
4.6142 | 86.9481 | 224500 | 3.7430 |
4.6587 | 87.1418 | 225000 | 3.8328 |
4.6301 | 87.3354 | 225500 | 3.7709 |
4.6446 | 87.5290 | 226000 | 3.7589 |
4.6138 | 87.7227 | 226500 | 3.8317 |
4.6317 | 87.9163 | 227000 | 3.8261 |
4.6504 | 88.1100 | 227500 | 3.8125 |
4.6191 | 88.3036 | 228000 | 3.8123 |
4.6499 | 88.4973 | 228500 | 3.7895 |
4.6377 | 88.6909 | 229000 | 3.7598 |
4.5823 | 88.8846 | 229500 | 3.7732 |
4.6007 | 89.0782 | 230000 | 3.7635 |
4.5884 | 89.2719 | 230500 | 3.7985 |
4.6334 | 89.4655 | 231000 | 3.8107 |
4.5976 | 89.6592 | 231500 | 3.7952 |
4.6039 | 89.8528 | 232000 | 3.7160 |
4.633 | 90.0465 | 232500 | 3.7798 |
4.6219 | 90.2401 | 233000 | 3.7862 |
4.5949 | 90.4338 | 233500 | 3.7855 |
4.6236 | 90.6274 | 234000 | 3.7827 |
4.6188 | 90.8211 | 234500 | 3.7882 |
4.6282 | 91.0147 | 235000 | 3.7647 |
4.6289 | 91.2084 | 235500 | 3.7740 |
4.6559 | 91.4020 | 236000 | 3.7900 |
4.5826 | 91.5957 | 236500 | 3.7688 |
4.616 | 91.7893 | 237000 | 3.7678 |
4.6308 | 91.9830 | 237500 | 3.7804 |
4.5802 | 92.1766 | 238000 | 3.8273 |
4.5688 | 92.3703 | 238500 | 3.7194 |
4.596 | 92.5639 | 239000 | 3.7914 |
4.664 | 92.7576 | 239500 | 3.7324 |
4.6125 | 92.9512 | 240000 | 3.7870 |
4.6129 | 93.1448 | 240500 | 3.7922 |
4.6308 | 93.3385 | 241000 | 3.7172 |
4.6091 | 93.5321 | 241500 | 3.7225 |
4.5945 | 93.7258 | 242000 | 3.7369 |
4.6058 | 93.9194 | 242500 | 3.7861 |
4.5489 | 94.1131 | 243000 | 3.7666 |
4.544 | 94.3067 | 243500 | 3.7964 |
4.6205 | 94.5004 | 244000 | 3.7842 |
4.5884 | 94.6940 | 244500 | 3.8102 |
4.5919 | 94.8877 | 245000 | 3.7659 |
4.5958 | 95.0813 | 245500 | 3.7296 |
4.6027 | 95.2750 | 246000 | 3.7448 |
4.6031 | 95.4686 | 246500 | 3.7389 |
4.6148 | 95.6623 | 247000 | 3.6923 |
4.5812 | 95.8559 | 247500 | 3.7429 |
4.6202 | 96.0496 | 248000 | 3.7531 |
4.5903 | 96.2432 | 248500 | 3.7326 |
4.591 | 96.4369 | 249000 | 3.7347 |
4.5847 | 96.6305 | 249500 | 3.7999 |
4.6262 | 96.8242 | 250000 | 3.7363 |
4.5983 | 97.0178 | 250500 | 3.7809 |
4.539 | 97.2115 | 251000 | 3.7407 |
4.6164 | 97.4051 | 251500 | 3.7369 |
4.5595 | 97.5988 | 252000 | 3.6946 |
4.6193 | 97.7924 | 252500 | 3.7787 |
4.5731 | 97.9861 | 253000 | 3.7257 |
4.5523 | 98.1797 | 253500 | 3.7258 |
4.5504 | 98.3734 | 254000 | 3.7532 |
4.5967 | 98.5670 | 254500 | 3.7516 |
4.5568 | 98.7607 | 255000 | 3.7304 |
4.5801 | 98.9543 | 255500 | 3.7364 |
4.5803 | 99.1479 | 256000 | 3.7572 |
4.5515 | 99.3416 | 256500 | 3.7176 |
4.5977 | 99.5352 | 257000 | 3.7380 |
4.5637 | 99.7289 | 257500 | 3.7538 |
4.561 | 99.9225 | 258000 | 3.7304 |
4.5661 | 100.1162 | 258500 | 3.7380 |
4.5814 | 100.3098 | 259000 | 3.7056 |
4.5592 | 100.5035 | 259500 | 3.6908 |
4.56 | 100.6971 | 260000 | 3.7220 |
4.5749 | 100.8908 | 260500 | 3.7628 |
4.5831 | 101.0844 | 261000 | 3.7377 |
4.5268 | 101.2781 | 261500 | 3.7249 |
4.6085 | 101.4717 | 262000 | 3.7908 |
4.577 | 101.6654 | 262500 | 3.7288 |
4.5897 | 101.8590 | 263000 | 3.7190 |
4.5671 | 102.0527 | 263500 | 3.7330 |
4.5656 | 102.2463 | 264000 | 3.7167 |
4.5679 | 102.4400 | 264500 | 3.7392 |
4.5352 | 102.6336 | 265000 | 3.7013 |
4.5959 | 102.8273 | 265500 | 3.6983 |
4.618 | 103.0209 | 266000 | 3.7244 |
4.5011 | 103.2146 | 266500 | 3.7342 |
4.5965 | 103.4082 | 267000 | 3.6866 |
4.541 | 103.6019 | 267500 | 3.6922 |
4.5516 | 103.7955 | 268000 | 3.7084 |
4.5559 | 103.9892 | 268500 | 3.6680 |
4.5007 | 104.1828 | 269000 | 3.6800 |
4.5871 | 104.3765 | 269500 | 3.7037 |
4.5187 | 104.5701 | 270000 | 3.7447 |
4.5274 | 104.7637 | 270500 | 3.7530 |
4.6156 | 104.9574 | 271000 | 3.7121 |
4.5471 | 105.1510 | 271500 | 3.6840 |
4.5361 | 105.3447 | 272000 | 3.6854 |
4.5572 | 105.5383 | 272500 | 3.6806 |
4.5396 | 105.7320 | 273000 | 3.7692 |
4.5822 | 105.9256 | 273500 | 3.7231 |
4.5498 | 106.1193 | 274000 | 3.7022 |
4.548 | 106.3129 | 274500 | 3.7241 |
4.5746 | 106.5066 | 275000 | 3.7106 |
4.5449 | 106.7002 | 275500 | 3.6764 |
4.5531 | 106.8939 | 276000 | 3.7384 |
4.5603 | 107.0875 | 276500 | 3.7046 |
4.5211 | 107.2812 | 277000 | 3.7242 |
4.5286 | 107.4748 | 277500 | 3.6576 |
4.5478 | 107.6685 | 278000 | 3.7496 |
4.5739 | 107.8621 | 278500 | 3.7430 |
4.5063 | 108.0558 | 279000 | 3.7133 |
4.5211 | 108.2494 | 279500 | 3.6906 |
4.54 | 108.4431 | 280000 | 3.6701 |
4.5778 | 108.6367 | 280500 | 3.7431 |
4.5244 | 108.8304 | 281000 | 3.6858 |
4.5156 | 109.0240 | 281500 | 3.7200 |
4.5313 | 109.2177 | 282000 | 3.6986 |
4.542 | 109.4113 | 282500 | 3.6794 |
4.5367 | 109.6050 | 283000 | 3.6701 |
4.5329 | 109.7986 | 283500 | 3.7172 |
4.5036 | 109.9923 | 284000 | 3.6961 |
4.5117 | 110.1859 | 284500 | 3.6419 |
4.5144 | 110.3796 | 285000 | 3.6579 |
4.5342 | 110.5732 | 285500 | 3.7301 |
4.5211 | 110.7668 | 286000 | 3.6857 |
4.5413 | 110.9605 | 286500 | 3.6918 |
4.5415 | 111.1541 | 287000 | 3.6801 |
4.51 | 111.3478 | 287500 | 3.6741 |
4.5429 | 111.5414 | 288000 | 3.6782 |
4.5442 | 111.7351 | 288500 | 3.6892 |
4.5165 | 111.9287 | 289000 | 3.6598 |
4.5014 | 112.1224 | 289500 | 3.7337 |
4.4981 | 112.3160 | 290000 | 3.6983 |
4.5243 | 112.5097 | 290500 | 3.6609 |
4.5369 | 112.7033 | 291000 | 3.6898 |
4.524 | 112.8970 | 291500 | 3.7025 |
4.5282 | 113.0906 | 292000 | 3.6845 |
4.5253 | 113.2843 | 292500 | 3.6544 |
4.5303 | 113.4779 | 293000 | 3.6866 |
4.5204 | 113.6716 | 293500 | 3.6719 |
4.5137 | 113.8652 | 294000 | 3.6420 |
4.5103 | 114.0589 | 294500 | 3.6299 |
4.5344 | 114.2525 | 295000 | 3.6793 |
4.4998 | 114.4462 | 295500 | 3.7115 |
4.5126 | 114.6398 | 296000 | 3.6806 |
4.4933 | 114.8335 | 296500 | 3.6392 |
4.506 | 115.0271 | 297000 | 3.6033 |
4.5182 | 115.2208 | 297500 | 3.6528 |
4.4912 | 115.4144 | 298000 | 3.6632 |
4.5346 | 115.6081 | 298500 | 3.6911 |
4.5431 | 115.8017 | 299000 | 3.6657 |
4.5468 | 115.9954 | 299500 | 3.6870 |
4.4543 | 116.1890 | 300000 | 3.6812 |
4.4892 | 116.3826 | 300500 | 3.6619 |
4.4987 | 116.5763 | 301000 | 3.6451 |
4.5404 | 116.7699 | 301500 | 3.6796 |
4.5301 | 116.9636 | 302000 | 3.6434 |
4.4981 | 117.1572 | 302500 | 3.6867 |
4.4746 | 117.3509 | 303000 | 3.6593 |
4.5167 | 117.5445 | 303500 | 3.7036 |
4.4976 | 117.7382 | 304000 | 3.6595 |
4.5221 | 117.9318 | 304500 | 3.7371 |
4.5494 | 118.1255 | 305000 | 3.6908 |
4.5158 | 118.3191 | 305500 | 3.6809 |
4.499 | 118.5128 | 306000 | 3.6736 |
4.4808 | 118.7064 | 306500 | 3.7138 |
4.5171 | 118.9001 | 307000 | 3.6348 |
4.516 | 119.0937 | 307500 | 3.6692 |
4.4944 | 119.2874 | 308000 | 3.6473 |
4.5338 | 119.4810 | 308500 | 3.6489 |
4.4601 | 119.6747 | 309000 | 3.6188 |
4.4808 | 119.8683 | 309500 | 3.6355 |
4.4806 | 120.0620 | 310000 | 3.6587 |
4.4842 | 120.2556 | 310500 | 3.6396 |
4.5136 | 120.4493 | 311000 | 3.6757 |
4.522 | 120.6429 | 311500 | 3.6864 |
4.4852 | 120.8366 | 312000 | 3.6019 |
4.5112 | 121.0302 | 312500 | 3.7107 |
4.4743 | 121.2239 | 313000 | 3.6578 |
4.5084 | 121.4175 | 313500 | 3.6126 |
4.5103 | 121.6112 | 314000 | 3.7097 |
4.4729 | 121.8048 | 314500 | 3.6640 |
4.4865 | 121.9985 | 315000 | 3.6766 |
4.495 | 122.1921 | 315500 | 3.6611 |
4.5203 | 122.3857 | 316000 | 3.6146 |
4.4671 | 122.5794 | 316500 | 3.6730 |
4.496 | 122.7730 | 317000 | 3.6845 |
4.5151 | 122.9667 | 317500 | 3.6581 |
4.5078 | 123.1603 | 318000 | 3.6863 |
4.5032 | 123.3540 | 318500 | 3.6235 |
4.5037 | 123.5476 | 319000 | 3.6368 |
4.4952 | 123.7413 | 319500 | 3.6806 |
4.4284 | 123.9349 | 320000 | 3.6088 |
4.5178 | 124.1286 | 320500 | 3.6788 |
4.4868 | 124.3222 | 321000 | 3.7301 |
4.4802 | 124.5159 | 321500 | 3.6470 |
4.5059 | 124.7095 | 322000 | 3.6565 |
4.5436 | 124.9032 | 322500 | 3.6283 |
4.477 | 125.0968 | 323000 | 3.6366 |
4.4911 | 125.2905 | 323500 | 3.6788 |
4.4639 | 125.4841 | 324000 | 3.6453 |
4.4943 | 125.6778 | 324500 | 3.6304 |
4.4467 | 125.8714 | 325000 | 3.6861 |
4.5158 | 126.0651 | 325500 | 3.6044 |
4.4889 | 126.2587 | 326000 | 3.6097 |
4.4662 | 126.4524 | 326500 | 3.6589 |
4.4902 | 126.6460 | 327000 | 3.6667 |
4.5259 | 126.8397 | 327500 | 3.6207 |
4.5227 | 127.0333 | 328000 | 3.6796 |
4.5387 | 127.2270 | 328500 | 3.6576 |
4.4337 | 127.4206 | 329000 | 3.6374 |
4.4871 | 127.6143 | 329500 | 3.6183 |
4.4436 | 127.8079 | 330000 | 3.6419 |
4.466 | 128.0015 | 330500 | 3.6817 |
4.5177 | 128.1952 | 331000 | 3.6503 |
4.515 | 128.3888 | 331500 | 3.6152 |
4.4625 | 128.5825 | 332000 | 3.6743 |
4.5254 | 128.7761 | 332500 | 3.6511 |
4.4522 | 128.9698 | 333000 | 3.6524 |
4.4406 | 129.1634 | 333500 | 3.6470 |
4.467 | 129.3571 | 334000 | 3.6100 |
4.456 | 129.5507 | 334500 | 3.6418 |
4.4371 | 129.7444 | 335000 | 3.6337 |
4.4772 | 129.9380 | 335500 | 3.6196 |
4.485 | 130.1317 | 336000 | 3.6077 |
4.4904 | 130.3253 | 336500 | 3.6653 |
4.4878 | 130.5190 | 337000 | 3.5970 |
4.4769 | 130.7126 | 337500 | 3.6289 |
4.428 | 130.9063 | 338000 | 3.6799 |
4.4622 | 131.0999 | 338500 | 3.6463 |
4.4446 | 131.2936 | 339000 | 3.6383 |
4.4723 | 131.4872 | 339500 | 3.6245 |
4.4858 | 131.6809 | 340000 | 3.6645 |
4.4585 | 131.8745 | 340500 | 3.6164 |
4.4679 | 132.0682 | 341000 | 3.6587 |
4.4774 | 132.2618 | 341500 | 3.6614 |
4.4663 | 132.4555 | 342000 | 3.6414 |
4.4723 | 132.6491 | 342500 | 3.5997 |
4.4829 | 132.8428 | 343000 | 3.6350 |
4.4239 | 133.0364 | 343500 | 3.6355 |
4.458 | 133.2301 | 344000 | 3.6044 |
4.4815 | 133.4237 | 344500 | 3.6359 |
4.4941 | 133.6174 | 345000 | 3.6511 |
4.4624 | 133.8110 | 345500 | 3.6280 |
4.4922 | 134.0046 | 346000 | 3.6182 |
4.4197 | 134.1983 | 346500 | 3.6440 |
4.4063 | 134.3919 | 347000 | 3.5909 |
4.4581 | 134.5856 | 347500 | 3.6017 |
4.4858 | 134.7792 | 348000 | 3.6888 |
4.4734 | 134.9729 | 348500 | 3.6265 |
4.4551 | 135.1665 | 349000 | 3.6756 |
4.463 | 135.3602 | 349500 | 3.6207 |
4.451 | 135.5538 | 350000 | 3.6168 |
4.4237 | 135.7475 | 350500 | 3.5949 |
4.5363 | 135.9411 | 351000 | 3.5992 |
4.4469 | 136.1348 | 351500 | 3.6196 |
4.4419 | 136.3284 | 352000 | 3.6028 |
4.4436 | 136.5221 | 352500 | 3.5895 |
4.4831 | 136.7157 | 353000 | 3.5875 |
4.4807 | 136.9094 | 353500 | 3.6075 |
4.4925 | 137.1030 | 354000 | 3.6787 |
4.425 | 137.2967 | 354500 | 3.6184 |
4.4912 | 137.4903 | 355000 | 3.6283 |
4.4129 | 137.6840 | 355500 | 3.6303 |
4.4713 | 137.8776 | 356000 | 3.6243 |
4.4519 | 138.0713 | 356500 | 3.6761 |
4.4445 | 138.2649 | 357000 | 3.6118 |
4.4625 | 138.4586 | 357500 | 3.5876 |
4.4335 | 138.6522 | 358000 | 3.6654 |
4.44 | 138.8459 | 358500 | 3.6132 |
4.459 | 139.0395 | 359000 | 3.6271 |
4.4649 | 139.2332 | 359500 | 3.6139 |
4.4442 | 139.4268 | 360000 | 3.6708 |
4.4559 | 139.6204 | 360500 | 3.6543 |
4.4634 | 139.8141 | 361000 | 3.6305 |
4.4627 | 140.0077 | 361500 | 3.6459 |
4.4311 | 140.2014 | 362000 | 3.6116 |
4.4782 | 140.3950 | 362500 | 3.6371 |
4.4322 | 140.5887 | 363000 | 3.6725 |
4.4589 | 140.7823 | 363500 | 3.6144 |
4.4408 | 140.9760 | 364000 | 3.6776 |
4.4476 | 141.1696 | 364500 | 3.6225 |
4.4611 | 141.3633 | 365000 | 3.6122 |
4.4862 | 141.5569 | 365500 | 3.5576 |
4.4195 | 141.7506 | 366000 | 3.6787 |
4.4268 | 141.9442 | 366500 | 3.6185 |
4.461 | 142.1379 | 367000 | 3.5568 |
4.4477 | 142.3315 | 367500 | 3.6153 |
4.4425 | 142.5252 | 368000 | 3.6649 |
4.4511 | 142.7188 | 368500 | 3.6379 |
4.4047 | 142.9125 | 369000 | 3.6177 |
4.4156 | 143.1061 | 369500 | 3.5783 |
4.4484 | 143.2998 | 370000 | 3.6435 |
4.44 | 143.4934 | 370500 | 3.6386 |
4.436 | 143.6871 | 371000 | 3.6438 |
4.4867 | 143.8807 | 371500 | 3.6714 |
4.4251 | 144.0744 | 372000 | 3.5955 |
4.4698 | 144.2680 | 372500 | 3.5736 |
4.4363 | 144.4617 | 373000 | 3.6886 |
4.4354 | 144.6553 | 373500 | 3.6063 |
4.3851 | 144.8490 | 374000 | 3.6600 |
4.4397 | 145.0426 | 374500 | 3.6089 |
4.4084 | 145.2363 | 375000 | 3.5522 |
4.4454 | 145.4299 | 375500 | 3.6098 |
4.4226 | 145.6235 | 376000 | 3.5841 |
4.4413 | 145.8172 | 376500 | 3.6255 |
4.4223 | 146.0108 | 377000 | 3.5746 |
4.4433 | 146.2045 | 377500 | 3.6371 |
4.391 | 146.3981 | 378000 | 3.6469 |
4.4443 | 146.5918 | 378500 | 3.6030 |
4.4636 | 146.7854 | 379000 | 3.6249 |
4.4505 | 146.9791 | 379500 | 3.6323 |
4.4688 | 147.1727 | 380000 | 3.6407 |
4.4417 | 147.3664 | 380500 | 3.5906 |
4.442 | 147.5600 | 381000 | 3.5921 |
4.4419 | 147.7537 | 381500 | 3.6379 |
4.4009 | 147.9473 | 382000 | 3.6362 |
4.4655 | 148.1410 | 382500 | 3.5332 |
4.4454 | 148.3346 | 383000 | 3.6197 |
4.4046 | 148.5283 | 383500 | 3.6369 |
4.4717 | 148.7219 | 384000 | 3.6059 |
4.3967 | 148.9156 | 384500 | 3.6484 |
4.4381 | 149.1092 | 385000 | 3.6019 |
4.4152 | 149.3029 | 385500 | 3.5978 |
4.4381 | 149.4965 | 386000 | 3.6166 |
4.4352 | 149.6902 | 386500 | 3.5988 |
4.4 | 149.8838 | 387000 | 3.6490 |
Framework versions
- Transformers 4.47.1
- Pytorch 2.5.1+cu118
- Datasets 3.2.0
- Tokenizers 0.21.0
- Downloads last month
- 23
Model tree for martijn75/BERiT_2000_custom_architecture_150_epochs_2_heb_am_vocalized
Base model
FacebookAI/roberta-base