BERiT_2000_custom_architecture_150_epochs_2
This model is a fine-tuned version of roberta-base on an unknown dataset. It achieves the following results on the evaluation set:
- Loss: 3.7086
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 0.0005
- train_batch_size: 8
- eval_batch_size: 8
- seed: 42
- optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
- lr_scheduler_type: linear
- num_epochs: 150
Training results
Training Loss | Epoch | Step | Validation Loss |
---|---|---|---|
6.8868 | 0.1936 | 500 | 6.7070 |
6.6448 | 0.3873 | 1000 | 6.5616 |
6.5323 | 0.5809 | 1500 | 6.4429 |
6.4701 | 0.7746 | 2000 | 6.3770 |
6.3883 | 0.9682 | 2500 | 6.3049 |
6.3555 | 1.1619 | 3000 | 6.2705 |
6.3077 | 1.3555 | 3500 | 6.2761 |
6.3386 | 1.5492 | 4000 | 6.2023 |
6.2871 | 1.7428 | 4500 | 6.2713 |
6.2897 | 1.9365 | 5000 | 6.2780 |
6.2832 | 2.1301 | 5500 | 6.2535 |
6.2552 | 2.3238 | 6000 | 6.3123 |
6.2995 | 2.5174 | 6500 | 6.2744 |
6.2368 | 2.7111 | 7000 | 6.2724 |
6.2639 | 2.9047 | 7500 | 6.2560 |
6.266 | 3.0984 | 8000 | 6.2958 |
6.219 | 3.2920 | 8500 | 6.2938 |
6.2541 | 3.4857 | 9000 | 6.2563 |
6.2855 | 3.6793 | 9500 | 6.2499 |
6.2448 | 3.8730 | 10000 | 6.3143 |
6.2235 | 4.0666 | 10500 | 6.2578 |
6.2474 | 4.2603 | 11000 | 6.3330 |
6.2232 | 4.4539 | 11500 | 6.2581 |
6.2514 | 4.6476 | 12000 | 6.3125 |
6.2309 | 4.8412 | 12500 | 6.3137 |
6.2183 | 5.0349 | 13000 | 6.2347 |
6.2041 | 5.2285 | 13500 | 6.2453 |
6.1978 | 5.4222 | 14000 | 6.2341 |
6.2054 | 5.6158 | 14500 | 6.2934 |
6.2159 | 5.8095 | 15000 | 6.2136 |
6.1844 | 6.0031 | 15500 | 6.2032 |
6.2098 | 6.1967 | 16000 | 6.2985 |
6.1944 | 6.3904 | 16500 | 6.2668 |
6.1837 | 6.5840 | 17000 | 6.2535 |
6.2042 | 6.7777 | 17500 | 6.3233 |
6.1849 | 6.9713 | 18000 | 6.2884 |
6.1395 | 7.1650 | 18500 | 6.2714 |
6.1798 | 7.3586 | 19000 | 6.2043 |
6.1734 | 7.5523 | 19500 | 6.2788 |
6.1601 | 7.7459 | 20000 | 6.2435 |
6.1738 | 7.9396 | 20500 | 6.2596 |
6.1661 | 8.1332 | 21000 | 6.2192 |
6.1638 | 8.3269 | 21500 | 6.1830 |
6.1811 | 8.5205 | 22000 | 6.2074 |
6.1518 | 8.7142 | 22500 | 6.1835 |
6.1671 | 8.9078 | 23000 | 6.2070 |
6.1541 | 9.1015 | 23500 | 6.1587 |
6.1536 | 9.2951 | 24000 | 6.1745 |
6.147 | 9.4888 | 24500 | 6.1859 |
6.1517 | 9.6824 | 25000 | 6.2295 |
6.13 | 9.8761 | 25500 | 6.1952 |
6.1361 | 10.0697 | 26000 | 6.1824 |
6.0979 | 10.2634 | 26500 | 6.2135 |
6.1144 | 10.4570 | 27000 | 6.1729 |
6.137 | 10.6507 | 27500 | 6.2487 |
6.1254 | 10.8443 | 28000 | 6.1702 |
6.1222 | 11.0380 | 28500 | 6.2088 |
6.1201 | 11.2316 | 29000 | 6.1939 |
6.1276 | 11.4253 | 29500 | 6.1961 |
6.1153 | 11.6189 | 30000 | 6.2243 |
6.1124 | 11.8125 | 30500 | 6.1715 |
6.16 | 12.0062 | 31000 | 6.2016 |
6.0978 | 12.1998 | 31500 | 6.1400 |
6.1419 | 12.3935 | 32000 | 6.2060 |
6.1448 | 12.5871 | 32500 | 6.2001 |
6.1379 | 12.7808 | 33000 | 6.1248 |
6.1373 | 12.9744 | 33500 | 6.1806 |
6.1099 | 13.1681 | 34000 | 6.1869 |
6.1188 | 13.3617 | 34500 | 6.1455 |
6.1335 | 13.5554 | 35000 | 6.1902 |
6.1279 | 13.7490 | 35500 | 6.1918 |
6.1129 | 13.9427 | 36000 | 6.2420 |
6.1375 | 14.1363 | 36500 | 6.1943 |
6.072 | 14.3300 | 37000 | 6.1802 |
6.0921 | 14.5236 | 37500 | 6.1914 |
6.099 | 14.7173 | 38000 | 6.2459 |
6.104 | 14.9109 | 38500 | 6.2501 |
6.1318 | 15.1046 | 39000 | 6.1563 |
6.0896 | 15.2982 | 39500 | 6.1671 |
6.101 | 15.4919 | 40000 | 6.2030 |
6.0962 | 15.6855 | 40500 | 6.1562 |
6.1057 | 15.8792 | 41000 | 6.1785 |
6.1048 | 16.0728 | 41500 | 6.1160 |
6.0995 | 16.2665 | 42000 | 6.1107 |
6.1175 | 16.4601 | 42500 | 6.1319 |
6.0681 | 16.6538 | 43000 | 6.1529 |
6.0591 | 16.8474 | 43500 | 6.1259 |
6.0692 | 17.0411 | 44000 | 6.1538 |
6.0593 | 17.2347 | 44500 | 6.1277 |
6.0712 | 17.4284 | 45000 | 6.1243 |
6.0596 | 17.6220 | 45500 | 6.1098 |
6.0586 | 17.8156 | 46000 | 6.0875 |
6.0717 | 18.0093 | 46500 | 6.1570 |
6.0522 | 18.2029 | 47000 | 6.1173 |
6.0569 | 18.3966 | 47500 | 6.1580 |
6.0401 | 18.5902 | 48000 | 6.0758 |
6.0546 | 18.7839 | 48500 | 6.1418 |
6.0225 | 18.9775 | 49000 | 6.0902 |
6.0845 | 19.1712 | 49500 | 6.1283 |
6.0466 | 19.3648 | 50000 | 6.1172 |
6.0467 | 19.5585 | 50500 | 6.1024 |
6.0313 | 19.7521 | 51000 | 6.1173 |
6.0413 | 19.9458 | 51500 | 6.0835 |
6.0347 | 20.1394 | 52000 | 6.1334 |
6.0426 | 20.3331 | 52500 | 6.0819 |
6.0491 | 20.5267 | 53000 | 6.0309 |
6.0325 | 20.7204 | 53500 | 6.1063 |
6.037 | 20.9140 | 54000 | 6.0734 |
6.0388 | 21.1077 | 54500 | 6.0478 |
6.037 | 21.3013 | 55000 | 5.9943 |
6.0579 | 21.4950 | 55500 | 6.1310 |
6.0455 | 21.6886 | 56000 | 6.1323 |
6.0141 | 21.8823 | 56500 | 6.0897 |
6.0256 | 22.0759 | 57000 | 6.0588 |
6.0093 | 22.2696 | 57500 | 6.1040 |
6.0071 | 22.4632 | 58000 | 6.0895 |
6.0118 | 22.6569 | 58500 | 6.0427 |
6.0022 | 22.8505 | 59000 | 6.0596 |
6.002 | 23.0442 | 59500 | 6.0977 |
6.0441 | 23.2378 | 60000 | 6.0568 |
6.0142 | 23.4314 | 60500 | 6.0891 |
6.0381 | 23.6251 | 61000 | 6.0849 |
6.0492 | 23.8187 | 61500 | 6.0143 |
6.0039 | 24.0124 | 62000 | 6.0824 |
6.0215 | 24.2060 | 62500 | 6.0602 |
6.002 | 24.3997 | 63000 | 6.0639 |
5.9936 | 24.5933 | 63500 | 6.0548 |
6.0293 | 24.7870 | 64000 | 6.0061 |
6.0462 | 24.9806 | 64500 | 6.0159 |
6.0022 | 25.1743 | 65000 | 6.0415 |
5.9754 | 25.3679 | 65500 | 6.0789 |
6.0413 | 25.5616 | 66000 | 6.0670 |
6.0156 | 25.7552 | 66500 | 6.0283 |
6.0124 | 25.9489 | 67000 | 6.0798 |
6.0331 | 26.1425 | 67500 | 6.0177 |
6.0124 | 26.3362 | 68000 | 6.0933 |
5.9807 | 26.5298 | 68500 | 6.0987 |
5.9943 | 26.7235 | 69000 | 5.9948 |
5.9894 | 26.9171 | 69500 | 6.0897 |
5.9957 | 27.1108 | 70000 | 6.0432 |
6.0227 | 27.3044 | 70500 | 6.0381 |
5.9931 | 27.4981 | 71000 | 6.0084 |
5.9887 | 27.6917 | 71500 | 5.9928 |
5.9902 | 27.8854 | 72000 | 5.9932 |
5.9952 | 28.0790 | 72500 | 5.9591 |
6.0243 | 28.2727 | 73000 | 6.0242 |
5.9671 | 28.4663 | 73500 | 6.0334 |
5.9679 | 28.6600 | 74000 | 6.0409 |
5.9732 | 28.8536 | 74500 | 6.0303 |
5.9882 | 29.0473 | 75000 | 6.0031 |
5.9852 | 29.2409 | 75500 | 6.0295 |
5.9745 | 29.4345 | 76000 | 6.0318 |
6.0094 | 29.6282 | 76500 | 5.9779 |
5.943 | 29.8218 | 77000 | 6.0571 |
5.971 | 30.0155 | 77500 | 5.9929 |
5.9537 | 30.2091 | 78000 | 5.9899 |
6.0035 | 30.4028 | 78500 | 5.9902 |
5.9711 | 30.5964 | 79000 | 6.0642 |
5.9596 | 30.7901 | 79500 | 6.1029 |
5.949 | 30.9837 | 80000 | 6.0346 |
5.9672 | 31.1774 | 80500 | 5.9386 |
5.9961 | 31.3710 | 81000 | 6.0025 |
5.937 | 31.5647 | 81500 | 6.0043 |
5.9607 | 31.7583 | 82000 | 5.9461 |
5.9787 | 31.9520 | 82500 | 6.0050 |
5.9281 | 32.1456 | 83000 | 6.0074 |
5.9393 | 32.3393 | 83500 | 5.9896 |
5.9616 | 32.5329 | 84000 | 5.9943 |
5.935 | 32.7266 | 84500 | 5.9669 |
5.9225 | 32.9202 | 85000 | 6.0164 |
5.9487 | 33.1139 | 85500 | 6.0167 |
5.9407 | 33.3075 | 86000 | 5.9504 |
5.9202 | 33.5012 | 86500 | 5.9375 |
5.9312 | 33.6948 | 87000 | 5.9740 |
5.9695 | 33.8885 | 87500 | 5.9803 |
5.9328 | 34.0821 | 88000 | 5.9981 |
5.9458 | 34.2758 | 88500 | 5.9877 |
5.9108 | 34.4694 | 89000 | 5.9726 |
5.9292 | 34.6631 | 89500 | 6.0048 |
5.9393 | 34.8567 | 90000 | 5.9371 |
5.9075 | 35.0503 | 90500 | 5.9322 |
5.9569 | 35.2440 | 91000 | 5.8930 |
5.9283 | 35.4376 | 91500 | 5.9293 |
5.9137 | 35.6313 | 92000 | 5.9345 |
5.9088 | 35.8249 | 92500 | 6.0019 |
5.9298 | 36.0186 | 93000 | 5.9135 |
5.8934 | 36.2122 | 93500 | 5.8897 |
5.9261 | 36.4059 | 94000 | 5.9464 |
5.9616 | 36.5995 | 94500 | 5.9007 |
5.9355 | 36.7932 | 95000 | 5.9731 |
5.9351 | 36.9868 | 95500 | 5.9000 |
5.8848 | 37.1805 | 96000 | 5.9153 |
5.9509 | 37.3741 | 96500 | 5.8593 |
5.9377 | 37.5678 | 97000 | 5.9312 |
5.9123 | 37.7614 | 97500 | 5.9220 |
5.9072 | 37.9551 | 98000 | 5.9025 |
5.9171 | 38.1487 | 98500 | 5.9045 |
5.9058 | 38.3424 | 99000 | 5.9257 |
5.8724 | 38.5360 | 99500 | 5.8890 |
5.9044 | 38.7297 | 100000 | 5.8842 |
5.8825 | 38.9233 | 100500 | 5.9243 |
5.8896 | 39.1170 | 101000 | 5.8916 |
5.8703 | 39.3106 | 101500 | 5.8239 |
5.8995 | 39.5043 | 102000 | 5.8519 |
5.8749 | 39.6979 | 102500 | 5.9181 |
5.829 | 39.8916 | 103000 | 5.8810 |
5.8845 | 40.0852 | 103500 | 5.8536 |
5.8612 | 40.2789 | 104000 | 5.8568 |
5.8809 | 40.4725 | 104500 | 5.8300 |
5.8486 | 40.6662 | 105000 | 5.8324 |
5.8185 | 40.8598 | 105500 | 5.8311 |
5.8588 | 41.0534 | 106000 | 5.8350 |
5.8414 | 41.2471 | 106500 | 5.8538 |
5.8269 | 41.4407 | 107000 | 5.8113 |
5.8499 | 41.6344 | 107500 | 5.8206 |
5.8121 | 41.8280 | 108000 | 5.8496 |
5.824 | 42.0217 | 108500 | 5.7722 |
5.8134 | 42.2153 | 109000 | 5.8506 |
5.8237 | 42.4090 | 109500 | 5.7293 |
5.8205 | 42.6026 | 110000 | 5.7201 |
5.8149 | 42.7963 | 110500 | 5.7584 |
5.8287 | 42.9899 | 111000 | 5.7390 |
5.7979 | 43.1836 | 111500 | 5.6923 |
5.7912 | 43.3772 | 112000 | 5.7010 |
5.7989 | 43.5709 | 112500 | 5.6561 |
5.7939 | 43.7645 | 113000 | 5.6634 |
5.8073 | 43.9582 | 113500 | 5.6587 |
5.7655 | 44.1518 | 114000 | 5.7106 |
5.7636 | 44.3455 | 114500 | 5.6446 |
5.7753 | 44.5391 | 115000 | 5.5850 |
5.7335 | 44.7328 | 115500 | 5.7055 |
5.7579 | 44.9264 | 116000 | 5.6142 |
5.7321 | 45.1201 | 116500 | 5.6193 |
5.7486 | 45.3137 | 117000 | 5.6181 |
5.7493 | 45.5074 | 117500 | 5.5911 |
5.7576 | 45.7010 | 118000 | 5.5257 |
5.6826 | 45.8947 | 118500 | 5.5426 |
5.7138 | 46.0883 | 119000 | 5.5164 |
5.6917 | 46.2820 | 119500 | 5.4740 |
5.7062 | 46.4756 | 120000 | 5.4761 |
5.6774 | 46.6692 | 120500 | 5.4150 |
5.6817 | 46.8629 | 121000 | 5.4204 |
5.6402 | 47.0565 | 121500 | 5.3808 |
5.672 | 47.2502 | 122000 | 5.3832 |
5.6192 | 47.4438 | 122500 | 5.3092 |
5.6274 | 47.6375 | 123000 | 5.2867 |
5.5956 | 47.8311 | 123500 | 5.2730 |
5.628 | 48.0248 | 124000 | 5.2721 |
5.5747 | 48.2184 | 124500 | 5.3099 |
5.5864 | 48.4121 | 125000 | 5.1926 |
5.6026 | 48.6057 | 125500 | 5.2517 |
5.565 | 48.7994 | 126000 | 5.1896 |
5.5401 | 48.9930 | 126500 | 5.1752 |
5.5585 | 49.1867 | 127000 | 5.1345 |
5.4725 | 49.3803 | 127500 | 5.0217 |
5.5341 | 49.5740 | 128000 | 5.0441 |
5.4843 | 49.7676 | 128500 | 5.0549 |
5.4929 | 49.9613 | 129000 | 5.0234 |
5.5027 | 50.1549 | 129500 | 4.9486 |
5.4838 | 50.3486 | 130000 | 5.0121 |
5.4258 | 50.5422 | 130500 | 5.0021 |
5.444 | 50.7359 | 131000 | 4.9507 |
5.4608 | 50.9295 | 131500 | 4.9458 |
5.4179 | 51.1232 | 132000 | 4.9408 |
5.4395 | 51.3168 | 132500 | 4.8974 |
5.4085 | 51.5105 | 133000 | 4.8364 |
5.394 | 51.7041 | 133500 | 4.8886 |
5.4182 | 51.8978 | 134000 | 4.8247 |
5.3921 | 52.0914 | 134500 | 4.8603 |
5.3544 | 52.2851 | 135000 | 4.8630 |
5.3395 | 52.4787 | 135500 | 4.7975 |
5.3422 | 52.6723 | 136000 | 4.7869 |
5.361 | 52.8660 | 136500 | 4.7595 |
5.3215 | 53.0596 | 137000 | 4.7637 |
5.3284 | 53.2533 | 137500 | 4.8026 |
5.3268 | 53.4469 | 138000 | 4.7542 |
5.2775 | 53.6406 | 138500 | 4.7015 |
5.2891 | 53.8342 | 139000 | 4.7523 |
5.2883 | 54.0279 | 139500 | 4.6897 |
5.3205 | 54.2215 | 140000 | 4.6383 |
5.2865 | 54.4152 | 140500 | 4.6780 |
5.2957 | 54.6088 | 141000 | 4.6293 |
5.2599 | 54.8025 | 141500 | 4.7128 |
5.2845 | 54.9961 | 142000 | 4.6624 |
5.3046 | 55.1898 | 142500 | 4.6206 |
5.2851 | 55.3834 | 143000 | 4.6395 |
5.275 | 55.5771 | 143500 | 4.6267 |
5.2309 | 55.7707 | 144000 | 4.6122 |
5.2393 | 55.9644 | 144500 | 4.5066 |
5.2371 | 56.1580 | 145000 | 4.5565 |
5.1807 | 56.3517 | 145500 | 4.5561 |
5.2319 | 56.5453 | 146000 | 4.5561 |
5.1892 | 56.7390 | 146500 | 4.4883 |
5.2152 | 56.9326 | 147000 | 4.5307 |
5.2107 | 57.1263 | 147500 | 4.5945 |
5.1763 | 57.3199 | 148000 | 4.5088 |
5.1736 | 57.5136 | 148500 | 4.5025 |
5.1873 | 57.7072 | 149000 | 4.4684 |
5.1682 | 57.9009 | 149500 | 4.4901 |
5.1833 | 58.0945 | 150000 | 4.5007 |
5.158 | 58.2881 | 150500 | 4.4998 |
5.1566 | 58.4818 | 151000 | 4.4881 |
5.1396 | 58.6754 | 151500 | 4.4606 |
5.1398 | 58.8691 | 152000 | 4.4361 |
5.1647 | 59.0627 | 152500 | 4.4626 |
5.1351 | 59.2564 | 153000 | 4.4948 |
5.1394 | 59.4500 | 153500 | 4.4111 |
5.1387 | 59.6437 | 154000 | 4.3942 |
5.1642 | 59.8373 | 154500 | 4.4141 |
5.1081 | 60.0310 | 155000 | 4.3727 |
5.1328 | 60.2246 | 155500 | 4.3766 |
5.0907 | 60.4183 | 156000 | 4.3632 |
5.1057 | 60.6119 | 156500 | 4.3955 |
5.08 | 60.8056 | 157000 | 4.4171 |
5.1116 | 60.9992 | 157500 | 4.3444 |
5.0831 | 61.1929 | 158000 | 4.3946 |
5.0864 | 61.3865 | 158500 | 4.3487 |
5.0735 | 61.5802 | 159000 | 4.3562 |
5.0809 | 61.7738 | 159500 | 4.3267 |
5.104 | 61.9675 | 160000 | 4.2980 |
5.1043 | 62.1611 | 160500 | 4.3379 |
5.0554 | 62.3548 | 161000 | 4.2956 |
5.0798 | 62.5484 | 161500 | 4.3001 |
5.0637 | 62.7421 | 162000 | 4.3058 |
5.0607 | 62.9357 | 162500 | 4.2794 |
4.9913 | 63.1294 | 163000 | 4.3044 |
5.0665 | 63.3230 | 163500 | 4.2583 |
5.0363 | 63.5167 | 164000 | 4.2888 |
5.0401 | 63.7103 | 164500 | 4.2464 |
5.0487 | 63.9040 | 165000 | 4.3617 |
5.0087 | 64.0976 | 165500 | 4.3334 |
4.9814 | 64.2912 | 166000 | 4.3458 |
5.0555 | 64.4849 | 166500 | 4.2564 |
5.0706 | 64.6785 | 167000 | 4.2172 |
5.0155 | 64.8722 | 167500 | 4.2284 |
5.0289 | 65.0658 | 168000 | 4.2368 |
4.9922 | 65.2595 | 168500 | 4.2776 |
4.9848 | 65.4531 | 169000 | 4.3008 |
4.9705 | 65.6468 | 169500 | 4.2868 |
5.0126 | 65.8404 | 170000 | 4.2298 |
5.0099 | 66.0341 | 170500 | 4.2782 |
4.9837 | 66.2277 | 171000 | 4.1804 |
4.9841 | 66.4214 | 171500 | 4.1778 |
4.9999 | 66.6150 | 172000 | 4.2152 |
4.9876 | 66.8087 | 172500 | 4.1993 |
4.9864 | 67.0023 | 173000 | 4.1639 |
5.0106 | 67.1960 | 173500 | 4.2633 |
4.9833 | 67.3896 | 174000 | 4.1903 |
4.9842 | 67.5833 | 174500 | 4.2170 |
4.9695 | 67.7769 | 175000 | 4.2309 |
4.992 | 67.9706 | 175500 | 4.1767 |
4.9473 | 68.1642 | 176000 | 4.1994 |
4.936 | 68.3579 | 176500 | 4.1183 |
4.9581 | 68.5515 | 177000 | 4.1612 |
4.9441 | 68.7452 | 177500 | 4.1299 |
4.9747 | 68.9388 | 178000 | 4.1837 |
4.9322 | 69.1325 | 178500 | 4.1572 |
4.9377 | 69.3261 | 179000 | 4.1488 |
4.9228 | 69.5198 | 179500 | 4.1453 |
4.9412 | 69.7134 | 180000 | 4.0973 |
4.9501 | 69.9070 | 180500 | 4.1720 |
4.9369 | 70.1007 | 181000 | 4.1441 |
4.9242 | 70.2943 | 181500 | 4.1967 |
4.9355 | 70.4880 | 182000 | 4.1208 |
4.9401 | 70.6816 | 182500 | 4.1091 |
4.9395 | 70.8753 | 183000 | 4.1355 |
4.9221 | 71.0689 | 183500 | 4.0999 |
4.9008 | 71.2626 | 184000 | 4.1455 |
4.8807 | 71.4562 | 184500 | 4.1684 |
4.9128 | 71.6499 | 185000 | 4.0571 |
4.9078 | 71.8435 | 185500 | 4.0767 |
4.8991 | 72.0372 | 186000 | 4.1127 |
4.9177 | 72.2308 | 186500 | 4.1166 |
4.9247 | 72.4245 | 187000 | 4.0771 |
4.906 | 72.6181 | 187500 | 4.0526 |
4.9361 | 72.8118 | 188000 | 4.0953 |
4.9581 | 73.0054 | 188500 | 4.0640 |
4.8981 | 73.1991 | 189000 | 4.0934 |
4.9457 | 73.3927 | 189500 | 4.0980 |
4.9249 | 73.5864 | 190000 | 4.0671 |
4.8865 | 73.7800 | 190500 | 4.0816 |
4.8828 | 73.9737 | 191000 | 4.0691 |
4.8967 | 74.1673 | 191500 | 4.0782 |
4.9032 | 74.3610 | 192000 | 4.0839 |
4.8789 | 74.5546 | 192500 | 4.0712 |
4.8944 | 74.7483 | 193000 | 4.0187 |
4.9096 | 74.9419 | 193500 | 4.0808 |
4.8429 | 75.1356 | 194000 | 4.0106 |
4.8775 | 75.3292 | 194500 | 4.0984 |
4.863 | 75.5229 | 195000 | 4.0104 |
4.8575 | 75.7165 | 195500 | 3.9864 |
4.8819 | 75.9101 | 196000 | 4.0558 |
4.8985 | 76.1038 | 196500 | 4.0369 |
4.8853 | 76.2974 | 197000 | 3.9930 |
4.8392 | 76.4911 | 197500 | 4.0604 |
4.8742 | 76.6847 | 198000 | 4.0091 |
4.8611 | 76.8784 | 198500 | 4.0029 |
4.8393 | 77.0720 | 199000 | 4.0112 |
4.8662 | 77.2657 | 199500 | 4.0549 |
4.8659 | 77.4593 | 200000 | 4.0337 |
4.8198 | 77.6530 | 200500 | 4.0421 |
4.8654 | 77.8466 | 201000 | 4.0336 |
4.8539 | 78.0403 | 201500 | 3.9776 |
4.7931 | 78.2339 | 202000 | 4.0168 |
4.8445 | 78.4276 | 202500 | 4.0413 |
4.8048 | 78.6212 | 203000 | 4.0021 |
4.8476 | 78.8149 | 203500 | 4.0144 |
4.8557 | 79.0085 | 204000 | 4.0271 |
4.8457 | 79.2022 | 204500 | 3.9408 |
4.8034 | 79.3958 | 205000 | 4.0106 |
4.8476 | 79.5895 | 205500 | 3.9310 |
4.8346 | 79.7831 | 206000 | 3.9709 |
4.7913 | 79.9768 | 206500 | 3.9937 |
4.8253 | 80.1704 | 207000 | 3.9839 |
4.8246 | 80.3641 | 207500 | 3.9717 |
4.7904 | 80.5577 | 208000 | 3.9263 |
4.8269 | 80.7514 | 208500 | 3.9984 |
4.7991 | 80.9450 | 209000 | 3.9680 |
4.8378 | 81.1387 | 209500 | 3.9557 |
4.83 | 81.3323 | 210000 | 3.9280 |
4.7694 | 81.5259 | 210500 | 3.9483 |
4.8151 | 81.7196 | 211000 | 3.9656 |
4.8282 | 81.9132 | 211500 | 3.9697 |
4.8631 | 82.1069 | 212000 | 3.9448 |
4.8044 | 82.3005 | 212500 | 3.9849 |
4.8155 | 82.4942 | 213000 | 3.9435 |
4.7965 | 82.6878 | 213500 | 3.8979 |
4.8069 | 82.8815 | 214000 | 3.9085 |
4.8252 | 83.0751 | 214500 | 3.9218 |
4.762 | 83.2688 | 215000 | 3.9617 |
4.7842 | 83.4624 | 215500 | 3.9540 |
4.8076 | 83.6561 | 216000 | 3.9465 |
4.8019 | 83.8497 | 216500 | 3.9200 |
4.7958 | 84.0434 | 217000 | 3.9550 |
4.7947 | 84.2370 | 217500 | 3.9857 |
4.8109 | 84.4307 | 218000 | 3.9198 |
4.8178 | 84.6243 | 218500 | 3.9423 |
4.7649 | 84.8180 | 219000 | 3.9103 |
4.7559 | 85.0116 | 219500 | 3.9250 |
4.7792 | 85.2053 | 220000 | 3.9626 |
4.7578 | 85.3989 | 220500 | 3.8806 |
4.7701 | 85.5926 | 221000 | 3.9409 |
4.7803 | 85.7862 | 221500 | 3.9369 |
4.7756 | 85.9799 | 222000 | 3.9061 |
4.7906 | 86.1735 | 222500 | 3.8850 |
4.8195 | 86.3672 | 223000 | 3.9319 |
4.7531 | 86.5608 | 223500 | 3.9645 |
4.7917 | 86.7545 | 224000 | 3.9014 |
4.7783 | 86.9481 | 224500 | 3.9249 |
4.8038 | 87.1418 | 225000 | 3.8761 |
4.7864 | 87.3354 | 225500 | 3.9172 |
4.7387 | 87.5290 | 226000 | 3.9330 |
4.751 | 87.7227 | 226500 | 3.9367 |
4.7706 | 87.9163 | 227000 | 3.8731 |
4.7646 | 88.1100 | 227500 | 3.8751 |
4.7694 | 88.3036 | 228000 | 3.9415 |
4.7458 | 88.4973 | 228500 | 3.8654 |
4.78 | 88.6909 | 229000 | 3.9060 |
4.7249 | 88.8846 | 229500 | 3.9265 |
4.7284 | 89.0782 | 230000 | 3.8787 |
4.7569 | 89.2719 | 230500 | 3.8888 |
4.7515 | 89.4655 | 231000 | 3.9081 |
4.7387 | 89.6592 | 231500 | 3.9272 |
4.7555 | 89.8528 | 232000 | 3.9006 |
4.7465 | 90.0465 | 232500 | 3.8434 |
4.7488 | 90.2401 | 233000 | 3.9222 |
4.7562 | 90.4338 | 233500 | 3.8346 |
4.7359 | 90.6274 | 234000 | 3.8507 |
4.7353 | 90.8211 | 234500 | 3.8747 |
4.7835 | 91.0147 | 235000 | 3.8328 |
4.7442 | 91.2084 | 235500 | 3.8706 |
4.7468 | 91.4020 | 236000 | 3.8672 |
4.7558 | 91.5957 | 236500 | 3.8647 |
4.7153 | 91.7893 | 237000 | 3.9158 |
4.7553 | 91.9830 | 237500 | 3.8684 |
4.7464 | 92.1766 | 238000 | 3.9153 |
4.7151 | 92.3703 | 238500 | 3.8628 |
4.7428 | 92.5639 | 239000 | 3.8418 |
4.7229 | 92.7576 | 239500 | 3.8911 |
4.7178 | 92.9512 | 240000 | 3.8601 |
4.7518 | 93.1448 | 240500 | 3.8147 |
4.752 | 93.3385 | 241000 | 3.8884 |
4.715 | 93.5321 | 241500 | 3.9119 |
4.7415 | 93.7258 | 242000 | 3.8425 |
4.7572 | 93.9194 | 242500 | 3.8463 |
4.7544 | 94.1131 | 243000 | 3.8629 |
4.7166 | 94.3067 | 243500 | 3.8720 |
4.7218 | 94.5004 | 244000 | 3.8587 |
4.724 | 94.6940 | 244500 | 3.8072 |
4.7123 | 94.8877 | 245000 | 3.8483 |
4.7392 | 95.0813 | 245500 | 3.8386 |
4.7127 | 95.2750 | 246000 | 3.8685 |
4.7118 | 95.4686 | 246500 | 3.8794 |
4.7051 | 95.6623 | 247000 | 3.8956 |
4.7467 | 95.8559 | 247500 | 3.7999 |
4.7058 | 96.0496 | 248000 | 3.8690 |
4.7424 | 96.2432 | 248500 | 3.8902 |
4.7042 | 96.4369 | 249000 | 3.8347 |
4.7557 | 96.6305 | 249500 | 3.7776 |
4.7253 | 96.8242 | 250000 | 3.7926 |
4.7589 | 97.0178 | 250500 | 3.8752 |
4.7026 | 97.2115 | 251000 | 3.8167 |
4.7013 | 97.4051 | 251500 | 3.8199 |
4.7637 | 97.5988 | 252000 | 3.8675 |
4.7567 | 97.7924 | 252500 | 3.8418 |
4.6953 | 97.9861 | 253000 | 3.8107 |
4.6791 | 98.1797 | 253500 | 3.9028 |
4.7162 | 98.3734 | 254000 | 3.8539 |
4.7166 | 98.5670 | 254500 | 3.7957 |
4.7201 | 98.7607 | 255000 | 3.8412 |
4.6552 | 98.9543 | 255500 | 3.8594 |
4.682 | 99.1479 | 256000 | 3.8301 |
4.7292 | 99.3416 | 256500 | 3.8633 |
4.7118 | 99.5352 | 257000 | 3.8581 |
4.7162 | 99.7289 | 257500 | 3.7835 |
4.6683 | 99.9225 | 258000 | 3.7783 |
4.7009 | 100.1162 | 258500 | 3.8311 |
4.6679 | 100.3098 | 259000 | 3.8113 |
4.695 | 100.5035 | 259500 | 3.8186 |
4.6719 | 100.6971 | 260000 | 3.8066 |
4.6982 | 100.8908 | 260500 | 3.8290 |
4.6605 | 101.0844 | 261000 | 3.7510 |
4.675 | 101.2781 | 261500 | 3.8263 |
4.6971 | 101.4717 | 262000 | 3.8458 |
4.7219 | 101.6654 | 262500 | 3.8182 |
4.6784 | 101.8590 | 263000 | 3.8135 |
4.7001 | 102.0527 | 263500 | 3.7773 |
4.67 | 102.2463 | 264000 | 3.7956 |
4.6908 | 102.4400 | 264500 | 3.8218 |
4.6953 | 102.6336 | 265000 | 3.8411 |
4.7078 | 102.8273 | 265500 | 3.8306 |
4.6597 | 103.0209 | 266000 | 3.7743 |
4.6572 | 103.2146 | 266500 | 3.8610 |
4.6801 | 103.4082 | 267000 | 3.7968 |
4.6827 | 103.6019 | 267500 | 3.8202 |
4.6762 | 103.7955 | 268000 | 3.8346 |
4.6458 | 103.9892 | 268500 | 3.7855 |
4.6811 | 104.1828 | 269000 | 3.8155 |
4.6445 | 104.3765 | 269500 | 3.8253 |
4.6913 | 104.5701 | 270000 | 3.7689 |
4.6895 | 104.7637 | 270500 | 3.8603 |
4.6828 | 104.9574 | 271000 | 3.8007 |
4.6875 | 105.1510 | 271500 | 3.7676 |
4.6528 | 105.3447 | 272000 | 3.7843 |
4.6421 | 105.5383 | 272500 | 3.7994 |
4.6198 | 105.7320 | 273000 | 3.8169 |
4.6739 | 105.9256 | 273500 | 3.7897 |
4.694 | 106.1193 | 274000 | 3.7714 |
4.6541 | 106.3129 | 274500 | 3.8299 |
4.6641 | 106.5066 | 275000 | 3.7344 |
4.649 | 106.7002 | 275500 | 3.8130 |
4.6469 | 106.8939 | 276000 | 3.8375 |
4.6574 | 107.0875 | 276500 | 3.7787 |
4.6652 | 107.2812 | 277000 | 3.7915 |
4.6648 | 107.4748 | 277500 | 3.7578 |
4.6794 | 107.6685 | 278000 | 3.8065 |
4.6937 | 107.8621 | 278500 | 3.7662 |
4.6682 | 108.0558 | 279000 | 3.8089 |
4.6587 | 108.2494 | 279500 | 3.7752 |
4.6876 | 108.4431 | 280000 | 3.8045 |
4.6944 | 108.6367 | 280500 | 3.7525 |
4.6804 | 108.8304 | 281000 | 3.7625 |
4.6475 | 109.0240 | 281500 | 3.7785 |
4.6564 | 109.2177 | 282000 | 3.7453 |
4.6728 | 109.4113 | 282500 | 3.7700 |
4.6344 | 109.6050 | 283000 | 3.7199 |
4.6778 | 109.7986 | 283500 | 3.7812 |
4.6588 | 109.9923 | 284000 | 3.7576 |
4.6607 | 110.1859 | 284500 | 3.7719 |
4.6251 | 110.3796 | 285000 | 3.7599 |
4.6661 | 110.5732 | 285500 | 3.8074 |
4.6469 | 110.7668 | 286000 | 3.7438 |
4.6629 | 110.9605 | 286500 | 3.8015 |
4.6479 | 111.1541 | 287000 | 3.7722 |
4.618 | 111.3478 | 287500 | 3.7962 |
4.6438 | 111.5414 | 288000 | 3.8119 |
4.6699 | 111.7351 | 288500 | 3.7647 |
4.6262 | 111.9287 | 289000 | 3.7741 |
4.6714 | 112.1224 | 289500 | 3.7578 |
4.6311 | 112.3160 | 290000 | 3.7750 |
4.6057 | 112.5097 | 290500 | 3.7887 |
4.6717 | 112.7033 | 291000 | 3.7575 |
4.6402 | 112.8970 | 291500 | 3.7424 |
4.6149 | 113.0906 | 292000 | 3.7796 |
4.6361 | 113.2843 | 292500 | 3.7285 |
4.6566 | 113.4779 | 293000 | 3.7092 |
4.6505 | 113.6716 | 293500 | 3.7384 |
4.6127 | 113.8652 | 294000 | 3.7305 |
4.6174 | 114.0589 | 294500 | 3.7333 |
4.6135 | 114.2525 | 295000 | 3.7716 |
4.6154 | 114.4462 | 295500 | 3.7259 |
4.6334 | 114.6398 | 296000 | 3.7626 |
4.6114 | 114.8335 | 296500 | 3.7427 |
4.6392 | 115.0271 | 297000 | 3.7727 |
4.6619 | 115.2208 | 297500 | 3.7563 |
4.63 | 115.4144 | 298000 | 3.7082 |
4.6282 | 115.6081 | 298500 | 3.7154 |
4.6183 | 115.8017 | 299000 | 3.7101 |
4.6328 | 115.9954 | 299500 | 3.7494 |
4.645 | 116.1890 | 300000 | 3.7429 |
4.6307 | 116.3826 | 300500 | 3.7517 |
4.6224 | 116.5763 | 301000 | 3.7962 |
4.6145 | 116.7699 | 301500 | 3.7107 |
4.6294 | 116.9636 | 302000 | 3.7305 |
4.5994 | 117.1572 | 302500 | 3.6940 |
4.6218 | 117.3509 | 303000 | 3.7549 |
4.6225 | 117.5445 | 303500 | 3.7319 |
4.6298 | 117.7382 | 304000 | 3.7824 |
4.6201 | 117.9318 | 304500 | 3.7393 |
4.6064 | 118.1255 | 305000 | 3.7613 |
4.6153 | 118.3191 | 305500 | 3.7583 |
4.6246 | 118.5128 | 306000 | 3.7516 |
4.6356 | 118.7064 | 306500 | 3.7834 |
4.6168 | 118.9001 | 307000 | 3.7646 |
4.5474 | 119.0937 | 307500 | 3.7309 |
4.6467 | 119.2874 | 308000 | 3.7212 |
4.6513 | 119.4810 | 308500 | 3.7652 |
4.6227 | 119.6747 | 309000 | 3.7691 |
4.6034 | 119.8683 | 309500 | 3.7352 |
4.6937 | 120.0620 | 310000 | 3.6963 |
4.6218 | 120.2556 | 310500 | 3.7241 |
4.6162 | 120.4493 | 311000 | 3.7976 |
4.608 | 120.6429 | 311500 | 3.7357 |
4.6211 | 120.8366 | 312000 | 3.7653 |
4.6231 | 121.0302 | 312500 | 3.7318 |
4.6117 | 121.2239 | 313000 | 3.7524 |
4.6188 | 121.4175 | 313500 | 3.7321 |
4.6181 | 121.6112 | 314000 | 3.7188 |
4.6215 | 121.8048 | 314500 | 3.7390 |
4.6056 | 121.9985 | 315000 | 3.7006 |
4.6393 | 122.1921 | 315500 | 3.7423 |
4.5621 | 122.3857 | 316000 | 3.7304 |
4.6031 | 122.5794 | 316500 | 3.7062 |
4.6109 | 122.7730 | 317000 | 3.7790 |
4.6049 | 122.9667 | 317500 | 3.7121 |
4.642 | 123.1603 | 318000 | 3.7241 |
4.598 | 123.3540 | 318500 | 3.7458 |
4.6057 | 123.5476 | 319000 | 3.7063 |
4.5618 | 123.7413 | 319500 | 3.6761 |
4.6008 | 123.9349 | 320000 | 3.6925 |
4.6102 | 124.1286 | 320500 | 3.7336 |
4.6096 | 124.3222 | 321000 | 3.7103 |
4.6008 | 124.5159 | 321500 | 3.7582 |
4.6322 | 124.7095 | 322000 | 3.7897 |
4.5663 | 124.9032 | 322500 | 3.7906 |
4.6251 | 125.0968 | 323000 | 3.7678 |
4.5944 | 125.2905 | 323500 | 3.7000 |
4.6272 | 125.4841 | 324000 | 3.7221 |
4.5765 | 125.6778 | 324500 | 3.7144 |
4.5754 | 125.8714 | 325000 | 3.6959 |
4.5685 | 126.0651 | 325500 | 3.7358 |
4.5857 | 126.2587 | 326000 | 3.7428 |
4.5889 | 126.4524 | 326500 | 3.7053 |
4.652 | 126.6460 | 327000 | 3.7306 |
4.5626 | 126.8397 | 327500 | 3.7719 |
4.6089 | 127.0333 | 328000 | 3.7200 |
4.5978 | 127.2270 | 328500 | 3.7663 |
4.6246 | 127.4206 | 329000 | 3.7715 |
4.604 | 127.6143 | 329500 | 3.6921 |
4.5977 | 127.8079 | 330000 | 3.7427 |
4.5994 | 128.0015 | 330500 | 3.7166 |
4.5899 | 128.1952 | 331000 | 3.7018 |
4.61 | 128.3888 | 331500 | 3.7714 |
4.5653 | 128.5825 | 332000 | 3.6923 |
4.5698 | 128.7761 | 332500 | 3.6933 |
4.589 | 128.9698 | 333000 | 3.7179 |
4.6172 | 129.1634 | 333500 | 3.7033 |
4.5908 | 129.3571 | 334000 | 3.6470 |
4.5768 | 129.5507 | 334500 | 3.7318 |
4.6137 | 129.7444 | 335000 | 3.6916 |
4.5693 | 129.9380 | 335500 | 3.7140 |
4.6215 | 130.1317 | 336000 | 3.7091 |
4.6185 | 130.3253 | 336500 | 3.6844 |
4.5689 | 130.5190 | 337000 | 3.6518 |
4.5695 | 130.7126 | 337500 | 3.6887 |
4.5761 | 130.9063 | 338000 | 3.7216 |
4.593 | 131.0999 | 338500 | 3.7494 |
4.5771 | 131.2936 | 339000 | 3.6970 |
4.586 | 131.4872 | 339500 | 3.7544 |
4.5285 | 131.6809 | 340000 | 3.6398 |
4.5641 | 131.8745 | 340500 | 3.7860 |
4.5782 | 132.0682 | 341000 | 3.6788 |
4.5549 | 132.2618 | 341500 | 3.7033 |
4.5597 | 132.4555 | 342000 | 3.6954 |
4.5965 | 132.6491 | 342500 | 3.6745 |
4.5864 | 132.8428 | 343000 | 3.7014 |
4.5816 | 133.0364 | 343500 | 3.7761 |
4.5478 | 133.2301 | 344000 | 3.7553 |
4.5595 | 133.4237 | 344500 | 3.7169 |
4.5566 | 133.6174 | 345000 | 3.6721 |
4.5924 | 133.8110 | 345500 | 3.6583 |
4.5797 | 134.0046 | 346000 | 3.6642 |
4.5853 | 134.1983 | 346500 | 3.7348 |
4.5477 | 134.3919 | 347000 | 3.6423 |
4.5494 | 134.5856 | 347500 | 3.7266 |
4.579 | 134.7792 | 348000 | 3.7068 |
4.5639 | 134.9729 | 348500 | 3.7131 |
4.5848 | 135.1665 | 349000 | 3.6627 |
4.5784 | 135.3602 | 349500 | 3.6788 |
4.5781 | 135.5538 | 350000 | 3.7183 |
4.5962 | 135.7475 | 350500 | 3.6869 |
4.5807 | 135.9411 | 351000 | 3.6202 |
4.5544 | 136.1348 | 351500 | 3.7059 |
4.5481 | 136.3284 | 352000 | 3.6852 |
4.5705 | 136.5221 | 352500 | 3.7093 |
4.5837 | 136.7157 | 353000 | 3.7166 |
4.5802 | 136.9094 | 353500 | 3.6635 |
4.5744 | 137.1030 | 354000 | 3.7243 |
4.5696 | 137.2967 | 354500 | 3.7676 |
4.5871 | 137.4903 | 355000 | 3.7007 |
4.5793 | 137.6840 | 355500 | 3.6838 |
4.574 | 137.8776 | 356000 | 3.7179 |
4.5983 | 138.0713 | 356500 | 3.6833 |
4.574 | 138.2649 | 357000 | 3.6532 |
4.5706 | 138.4586 | 357500 | 3.6384 |
4.5569 | 138.6522 | 358000 | 3.6487 |
4.5691 | 138.8459 | 358500 | 3.7456 |
4.5672 | 139.0395 | 359000 | 3.6334 |
4.538 | 139.2332 | 359500 | 3.7224 |
4.5933 | 139.4268 | 360000 | 3.6440 |
4.5756 | 139.6204 | 360500 | 3.6849 |
4.55 | 139.8141 | 361000 | 3.7071 |
4.5312 | 140.0077 | 361500 | 3.6154 |
4.5868 | 140.2014 | 362000 | 3.6840 |
4.5442 | 140.3950 | 362500 | 3.7073 |
4.539 | 140.5887 | 363000 | 3.6397 |
4.541 | 140.7823 | 363500 | 3.6674 |
4.5485 | 140.9760 | 364000 | 3.6542 |
4.5639 | 141.1696 | 364500 | 3.6646 |
4.5724 | 141.3633 | 365000 | 3.6958 |
4.5824 | 141.5569 | 365500 | 3.7227 |
4.5628 | 141.7506 | 366000 | 3.6795 |
4.5732 | 141.9442 | 366500 | 3.6331 |
4.5279 | 142.1379 | 367000 | 3.6702 |
4.5844 | 142.3315 | 367500 | 3.6354 |
4.5214 | 142.5252 | 368000 | 3.7116 |
4.5508 | 142.7188 | 368500 | 3.6504 |
4.5477 | 142.9125 | 369000 | 3.6904 |
4.5348 | 143.1061 | 369500 | 3.7545 |
4.5675 | 143.2998 | 370000 | 3.7282 |
4.5601 | 143.4934 | 370500 | 3.6360 |
4.554 | 143.6871 | 371000 | 3.6935 |
4.555 | 143.8807 | 371500 | 3.6268 |
4.5519 | 144.0744 | 372000 | 3.6654 |
4.5624 | 144.2680 | 372500 | 3.6822 |
4.5819 | 144.4617 | 373000 | 3.6621 |
4.5085 | 144.6553 | 373500 | 3.6854 |
4.555 | 144.8490 | 374000 | 3.6867 |
4.5754 | 145.0426 | 374500 | 3.7096 |
4.5303 | 145.2363 | 375000 | 3.6935 |
4.5657 | 145.4299 | 375500 | 3.7251 |
4.5602 | 145.6235 | 376000 | 3.6907 |
4.5498 | 145.8172 | 376500 | 3.6618 |
4.5127 | 146.0108 | 377000 | 3.6826 |
4.5193 | 146.2045 | 377500 | 3.6208 |
4.5199 | 146.3981 | 378000 | 3.7318 |
4.5774 | 146.5918 | 378500 | 3.6752 |
4.5465 | 146.7854 | 379000 | 3.6379 |
4.5368 | 146.9791 | 379500 | 3.6632 |
4.5281 | 147.1727 | 380000 | 3.6482 |
4.5769 | 147.3664 | 380500 | 3.6434 |
4.5432 | 147.5600 | 381000 | 3.6209 |
4.5413 | 147.7537 | 381500 | 3.6628 |
4.5764 | 147.9473 | 382000 | 3.6639 |
4.5284 | 148.1410 | 382500 | 3.6956 |
4.5576 | 148.3346 | 383000 | 3.6310 |
4.5386 | 148.5283 | 383500 | 3.6342 |
4.6008 | 148.7219 | 384000 | 3.7064 |
4.5307 | 148.9156 | 384500 | 3.6579 |
4.478 | 149.1092 | 385000 | 3.6114 |
4.5286 | 149.3029 | 385500 | 3.6452 |
4.5771 | 149.4965 | 386000 | 3.6616 |
4.5498 | 149.6902 | 386500 | 3.6681 |
4.5646 | 149.8838 | 387000 | 3.7086 |
Framework versions
- Transformers 4.47.1
- Pytorch 2.5.1+cu118
- Datasets 3.2.0
- Tokenizers 0.21.0
- Downloads last month
- 26
Model tree for martijn75/BERiT_2000_custom_architecture_150_epochs_2
Base model
FacebookAI/roberta-base