Hugging Face's logo

JEdward7777
/
finetuned-xlm-r-masakhaner-swa-whole-word-phonetic

Fill-Mask
Transformers
PyTorch
TensorBoard
xlm-roberta
Generated from Trainer
Inference Endpoints
Model card Files Metrics Community
finetuned-xlm-r-masakhaner-swa-whole-word-phonetic / README.md
JEdward7777's picture
JEdward7777
update model card README.md
c2a7b56
preview code
|
raw
history blame
27.3 kB
metadata
license: mit
tags:
  - generated_from_trainer
model-index:
  - name: finetuned-xlm-r-masakhaner-swa-whole-word-phonetic
    results: []

finetuned-xlm-r-masakhaner-swa-whole-word-phonetic

This model is a fine-tuned version of xlm-roberta-base on the None dataset. It achieves the following results on the evaluation set:

  • Loss: 10.9759

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

  • learning_rate: 7e-08
  • train_batch_size: 8
  • eval_batch_size: 8
  • seed: 42
  • optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
  • lr_scheduler_type: linear
  • num_epochs: 500

Training results

Training Loss Epoch Step Validation Loss
No log 1.0 62 40.0624
No log 2.0 124 39.4729
No log 3.0 186 39.0082
No log 4.0 248 38.2032
No log 5.0 310 37.3358
No log 6.0 372 36.1574
No log 7.0 434 35.1500
No log 8.0 496 33.6943
39.2118 9.0 558 32.3968
39.2118 10.0 620 30.7308
39.2118 11.0 682 29.2279
39.2118 12.0 744 27.8274
39.2118 13.0 806 26.4941
39.2118 14.0 868 24.6593
39.2118 15.0 930 23.4405
39.2118 16.0 992 21.9994
27.5423 17.0 1054 21.0274
27.5423 18.0 1116 19.8907
27.5423 19.0 1178 19.3347
27.5423 20.0 1240 18.3241
27.5423 21.0 1302 17.5215
27.5423 22.0 1364 16.9689
27.5423 23.0 1426 16.2983
27.5423 24.0 1488 15.8707
18.4542 25.0 1550 15.4655
18.4542 26.0 1612 15.1849
18.4542 27.0 1674 14.7801
18.4542 28.0 1736 14.5576
18.4542 29.0 1798 14.4215
18.4542 30.0 1860 13.9318
18.4542 31.0 1922 13.9801
18.4542 32.0 1984 13.7096
13.9556 33.0 2046 13.4639
13.9556 34.0 2108 13.2987
13.9556 35.0 2170 13.2303
13.9556 36.0 2232 13.2450
13.9556 37.0 2294 13.0574
13.9556 38.0 2356 12.9022
13.9556 39.0 2418 12.8200
13.9556 40.0 2480 12.7295
12.111 41.0 2542 12.8402
12.111 42.0 2604 12.6906
12.111 43.0 2666 12.5422
12.111 44.0 2728 12.5032
12.111 45.0 2790 12.2968
12.111 46.0 2852 12.3324
12.111 47.0 2914 12.2543
12.111 48.0 2976 12.2434
11.3304 49.0 3038 12.2519
11.3304 50.0 3100 12.1120
11.3304 51.0 3162 12.1969
11.3304 52.0 3224 11.9977
11.3304 53.0 3286 12.1759
11.3304 54.0 3348 11.9808
11.3304 55.0 3410 12.1498
11.3304 56.0 3472 11.9851
10.9471 57.0 3534 12.0800
10.9471 58.0 3596 11.8819
10.9471 59.0 3658 12.0099
10.9471 60.0 3720 11.8616
10.9471 61.0 3782 11.8950
10.9471 62.0 3844 11.8301
10.9471 63.0 3906 12.0967
10.9471 64.0 3968 11.8379
10.6841 65.0 4030 11.9093
10.6841 66.0 4092 11.9175
10.6841 67.0 4154 11.7318
10.6841 68.0 4216 11.8300
10.6841 69.0 4278 11.5992
10.6841 70.0 4340 11.6044
10.6841 71.0 4402 11.6937
10.6841 72.0 4464 11.5960
10.542 73.0 4526 11.5451
10.542 74.0 4588 11.4033
10.542 75.0 4650 11.4805
10.542 76.0 4712 11.5396
10.542 77.0 4774 11.4924
10.542 78.0 4836 11.4289
10.542 79.0 4898 11.3646
10.542 80.0 4960 11.3624
10.4457 81.0 5022 11.4623
10.4457 82.0 5084 11.5224
10.4457 83.0 5146 11.4196
10.4457 84.0 5208 11.4359
10.4457 85.0 5270 11.4346
10.4457 86.0 5332 11.4639
10.4457 87.0 5394 11.2307
10.4457 88.0 5456 11.5262
10.3854 89.0 5518 11.6653
10.3854 90.0 5580 11.3471
10.3854 91.0 5642 11.3048
10.3854 92.0 5704 11.3633
10.3854 93.0 5766 11.3434
10.3854 94.0 5828 11.2580
10.3854 95.0 5890 11.2709
10.3854 96.0 5952 11.1983
10.324 97.0 6014 11.2218
10.324 98.0 6076 11.3307
10.324 99.0 6138 11.2036
10.324 100.0 6200 11.3724
10.324 101.0 6262 11.3443
10.324 102.0 6324 11.2646
10.324 103.0 6386 11.2717
10.324 104.0 6448 11.3106
10.2981 105.0 6510 11.2435
10.2981 106.0 6572 11.2492
10.2981 107.0 6634 11.1113
10.2981 108.0 6696 11.2106
10.2981 109.0 6758 11.2143
10.2981 110.0 6820 11.0152
10.2981 111.0 6882 11.0871
10.2981 112.0 6944 11.0981
10.2536 113.0 7006 11.2439
10.2536 114.0 7068 11.1562
10.2536 115.0 7130 11.1186
10.2536 116.0 7192 11.2282
10.2536 117.0 7254 11.2892
10.2536 118.0 7316 11.1659
10.2536 119.0 7378 11.3439
10.2536 120.0 7440 11.1999
10.2336 121.0 7502 11.2504
10.2336 122.0 7564 11.2896
10.2336 123.0 7626 11.0688
10.2336 124.0 7688 11.1674
10.2336 125.0 7750 11.2072
10.2336 126.0 7812 11.0353
10.2336 127.0 7874 11.0488
10.2336 128.0 7936 11.0932
10.2336 129.0 7998 11.0705
10.2101 130.0 8060 11.2193
10.2101 131.0 8122 11.2278
10.2101 132.0 8184 11.1365
10.2101 133.0 8246 11.0353
10.2101 134.0 8308 11.0146
10.2101 135.0 8370 11.2372
10.2101 136.0 8432 11.1044
10.2101 137.0 8494 11.1340
10.1991 138.0 8556 11.0753
10.1991 139.0 8618 11.0211
10.1991 140.0 8680 10.9309
10.1991 141.0 8742 10.9770
10.1991 142.0 8804 11.0791
10.1991 143.0 8866 11.1165
10.1991 144.0 8928 10.9369
10.1991 145.0 8990 11.1211
10.1925 146.0 9052 11.0745
10.1925 147.0 9114 11.1046
10.1925 148.0 9176 11.0258
10.1925 149.0 9238 11.0266
10.1925 150.0 9300 11.2540
10.1925 151.0 9362 10.9704
10.1925 152.0 9424 11.0341
10.1925 153.0 9486 11.1114
10.1538 154.0 9548 11.0224
10.1538 155.0 9610 10.9150
10.1538 156.0 9672 10.9305
10.1538 157.0 9734 11.0699
10.1538 158.0 9796 10.9901
10.1538 159.0 9858 11.0688
10.1538 160.0 9920 10.9334
10.1538 161.0 9982 10.9852
10.1494 162.0 10044 10.9032
10.1494 163.0 10106 10.9618
10.1494 164.0 10168 10.9473
10.1494 165.0 10230 11.1531
10.1494 166.0 10292 10.8462
10.1494 167.0 10354 10.9577
10.1494 168.0 10416 10.9351
10.1494 169.0 10478 11.2125
10.1424 170.0 10540 11.0546
10.1424 171.0 10602 10.9934
10.1424 172.0 10664 10.8918
10.1424 173.0 10726 10.8868
10.1424 174.0 10788 11.0400
10.1424 175.0 10850 11.1198
10.1424 176.0 10912 11.1595
10.1424 177.0 10974 11.1137
10.1181 178.0 11036 11.1998
10.1181 179.0 11098 11.0494
10.1181 180.0 11160 10.9489
10.1181 181.0 11222 11.0248
10.1181 182.0 11284 10.9912
10.1181 183.0 11346 10.9221
10.1181 184.0 11408 11.0553
10.1181 185.0 11470 11.0055
10.1165 186.0 11532 11.1129
10.1165 187.0 11594 11.0822
10.1165 188.0 11656 11.0509
10.1165 189.0 11718 11.0881
10.1165 190.0 11780 10.8909
10.1165 191.0 11842 11.0489
10.1165 192.0 11904 10.9349
10.1165 193.0 11966 10.8821
10.1021 194.0 12028 11.0552
10.1021 195.0 12090 11.1524
10.1021 196.0 12152 11.0084
10.1021 197.0 12214 11.0870
10.1021 198.0 12276 10.8429
10.1021 199.0 12338 11.0104
10.1021 200.0 12400 10.9269
10.1021 201.0 12462 10.9873
10.1022 202.0 12524 10.9878
10.1022 203.0 12586 10.8828
10.1022 204.0 12648 11.0434
10.1022 205.0 12710 10.9539
10.1022 206.0 12772 10.6848
10.1022 207.0 12834 11.1773
10.1022 208.0 12896 10.9967
10.1022 209.0 12958 10.9989
10.0962 210.0 13020 11.2001
10.0962 211.0 13082 10.9658
10.0962 212.0 13144 11.0099
10.0962 213.0 13206 11.0534
10.0962 214.0 13268 11.1858
10.0962 215.0 13330 11.0441
10.0962 216.0 13392 11.1819
10.0962 217.0 13454 11.0100
10.0861 218.0 13516 11.0071
10.0861 219.0 13578 11.1453
10.0861 220.0 13640 10.9854
10.0861 221.0 13702 11.1206
10.0861 222.0 13764 11.0695
10.0861 223.0 13826 11.0700
10.0861 224.0 13888 10.9683
10.0861 225.0 13950 10.9319
10.0808 226.0 14012 10.9934
10.0808 227.0 14074 10.8787
10.0808 228.0 14136 10.9051
10.0808 229.0 14198 11.0375
10.0808 230.0 14260 11.0259
10.0808 231.0 14322 11.0635
10.0808 232.0 14384 10.8822
10.0808 233.0 14446 10.8910
10.0768 234.0 14508 10.9744
10.0768 235.0 14570 11.0422
10.0768 236.0 14632 11.0398
10.0768 237.0 14694 10.8507
10.0768 238.0 14756 11.0227
10.0768 239.0 14818 11.0273
10.0768 240.0 14880 11.0778
10.0768 241.0 14942 11.0777
10.0792 242.0 15004 10.9423
10.0792 243.0 15066 11.2267
10.0792 244.0 15128 10.8529
10.0792 245.0 15190 11.0566
10.0792 246.0 15252 10.8876
10.0792 247.0 15314 11.1441
10.0792 248.0 15376 10.9090
10.0792 249.0 15438 10.9756
10.0832 250.0 15500 10.9538
10.0832 251.0 15562 10.8424
10.0832 252.0 15624 10.7671
10.0832 253.0 15686 10.9635
10.0832 254.0 15748 10.8490
10.0832 255.0 15810 11.1349
10.0832 256.0 15872 10.8844
10.0832 257.0 15934 10.8656
10.0832 258.0 15996 10.8234
10.0747 259.0 16058 10.9503
10.0747 260.0 16120 10.8856
10.0747 261.0 16182 11.0519
10.0747 262.0 16244 10.8862
10.0747 263.0 16306 10.8974
10.0747 264.0 16368 10.8464
10.0747 265.0 16430 10.9659
10.0747 266.0 16492 10.7426
10.0678 267.0 16554 10.9852
10.0678 268.0 16616 11.0498
10.0678 269.0 16678 10.7894
10.0678 270.0 16740 11.1073
10.0678 271.0 16802 10.8264
10.0678 272.0 16864 10.9315
10.0678 273.0 16926 10.7760
10.0678 274.0 16988 10.9723
10.0631 275.0 17050 10.7482
10.0631 276.0 17112 11.0491
10.0631 277.0 17174 10.7516
10.0631 278.0 17236 10.9505
10.0631 279.0 17298 10.8899
10.0631 280.0 17360 10.7864
10.0631 281.0 17422 10.8660
10.0631 282.0 17484 10.9755
10.0464 283.0 17546 10.9702
10.0464 284.0 17608 10.9664
10.0464 285.0 17670 10.9413
10.0464 286.0 17732 10.9662
10.0464 287.0 17794 10.9511
10.0464 288.0 17856 10.8648
10.0464 289.0 17918 10.8867
10.0464 290.0 17980 11.0379
10.059 291.0 18042 10.9587
10.059 292.0 18104 10.8715
10.059 293.0 18166 11.0329
10.059 294.0 18228 10.9934
10.059 295.0 18290 11.0318
10.059 296.0 18352 10.9496
10.059 297.0 18414 10.9851
10.059 298.0 18476 10.9042
10.0478 299.0 18538 10.8483
10.0478 300.0 18600 11.1284
10.0478 301.0 18662 10.9656
10.0478 302.0 18724 10.9622
10.0478 303.0 18786 11.0226
10.0478 304.0 18848 10.9982
10.0478 305.0 18910 10.9646
10.0478 306.0 18972 11.0949
10.0513 307.0 19034 11.0740
10.0513 308.0 19096 10.8888
10.0513 309.0 19158 11.2476
10.0513 310.0 19220 10.9996
10.0513 311.0 19282 10.8044
10.0513 312.0 19344 10.9493
10.0513 313.0 19406 10.9460
10.0513 314.0 19468 10.9664
10.0363 315.0 19530 10.9196
10.0363 316.0 19592 10.9218
10.0363 317.0 19654 10.8009
10.0363 318.0 19716 11.1215
10.0363 319.0 19778 10.9651
10.0363 320.0 19840 10.9957
10.0363 321.0 19902 11.1449
10.0363 322.0 19964 11.0132
10.0503 323.0 20026 11.1194
10.0503 324.0 20088 10.9650
10.0503 325.0 20150 10.8414
10.0503 326.0 20212 10.8668
10.0503 327.0 20274 11.0100
10.0503 328.0 20336 10.8759
10.0503 329.0 20398 10.9656
10.0503 330.0 20460 11.0078
10.0223 331.0 20522 11.0198
10.0223 332.0 20584 11.0888
10.0223 333.0 20646 11.1058
10.0223 334.0 20708 10.9423
10.0223 335.0 20770 11.1030
10.0223 336.0 20832 11.0819
10.0223 337.0 20894 10.9060
10.0223 338.0 20956 11.0750
10.0321 339.0 21018 11.1101
10.0321 340.0 21080 10.9711
10.0321 341.0 21142 10.9287
10.0321 342.0 21204 10.7962
10.0321 343.0 21266 11.1362
10.0321 344.0 21328 11.1022
10.0321 345.0 21390 10.9997
10.0321 346.0 21452 10.8761
10.0226 347.0 21514 10.9343
10.0226 348.0 21576 10.9110
10.0226 349.0 21638 11.0345
10.0226 350.0 21700 10.8872
10.0226 351.0 21762 10.7667
10.0226 352.0 21824 11.0568
10.0226 353.0 21886 11.0288
10.0226 354.0 21948 11.0664
10.033 355.0 22010 10.9751
10.033 356.0 22072 10.8561
10.033 357.0 22134 10.9609
10.033 358.0 22196 11.0002
10.033 359.0 22258 11.0568
10.033 360.0 22320 10.9586
10.033 361.0 22382 10.9254
10.033 362.0 22444 11.0652
10.0084 363.0 22506 10.9656
10.0084 364.0 22568 11.0611
10.0084 365.0 22630 10.8335
10.0084 366.0 22692 10.9809
10.0084 367.0 22754 11.0209
10.0084 368.0 22816 10.9149
10.0084 369.0 22878 11.0207
10.0084 370.0 22940 10.8774
10.024 371.0 23002 10.9855
10.024 372.0 23064 10.9064
10.024 373.0 23126 10.9518
10.024 374.0 23188 10.8775
10.024 375.0 23250 10.9193
10.024 376.0 23312 11.1098
10.024 377.0 23374 11.1486
10.024 378.0 23436 11.0895
10.024 379.0 23498 10.9159
10.0052 380.0 23560 11.1095
10.0052 381.0 23622 11.0949
10.0052 382.0 23684 10.9837
10.0052 383.0 23746 10.9433
10.0052 384.0 23808 10.9104
10.0052 385.0 23870 10.9512
10.0052 386.0 23932 11.1075
10.0052 387.0 23994 10.8660
10.0218 388.0 24056 11.0521
10.0218 389.0 24118 10.8989
10.0218 390.0 24180 10.9139
10.0218 391.0 24242 11.1079
10.0218 392.0 24304 10.9063
10.0218 393.0 24366 11.0851
10.0218 394.0 24428 10.9809
10.0218 395.0 24490 10.9320
10.0039 396.0 24552 11.0525
10.0039 397.0 24614 11.0378
10.0039 398.0 24676 11.0006
10.0039 399.0 24738 11.0284
10.0039 400.0 24800 11.0055
10.0039 401.0 24862 11.0104
10.0039 402.0 24924 11.1168
10.0039 403.0 24986 10.8311
10.0186 404.0 25048 10.8904
10.0186 405.0 25110 10.8615
10.0186 406.0 25172 10.9520
10.0186 407.0 25234 10.9112
10.0186 408.0 25296 11.0280
10.0186 409.0 25358 10.8281
10.0186 410.0 25420 11.1875
10.0186 411.0 25482 11.0089
10.0146 412.0 25544 11.0386
10.0146 413.0 25606 10.8152
10.0146 414.0 25668 10.9460
10.0146 415.0 25730 10.9922
10.0146 416.0 25792 11.0850
10.0146 417.0 25854 11.0024
10.0146 418.0 25916 11.0934
10.0146 419.0 25978 11.0953
10.0251 420.0 26040 10.8996
10.0251 421.0 26102 10.9833
10.0251 422.0 26164 10.7546
10.0251 423.0 26226 10.9770
10.0251 424.0 26288 11.0632
10.0251 425.0 26350 10.9244
10.0251 426.0 26412 10.9376
10.0251 427.0 26474 11.0441
9.9776 428.0 26536 11.0679
9.9776 429.0 26598 11.0663
9.9776 430.0 26660 10.9885
9.9776 431.0 26722 10.9566
9.9776 432.0 26784 11.1560
9.9776 433.0 26846 11.0590
9.9776 434.0 26908 11.0154
9.9776 435.0 26970 10.9648
10.0079 436.0 27032 11.0840
10.0079 437.0 27094 10.8103
10.0079 438.0 27156 10.8994
10.0079 439.0 27218 11.0360
10.0079 440.0 27280 10.9094
10.0079 441.0 27342 10.9402
10.0079 442.0 27404 10.8771
10.0079 443.0 27466 11.0934
10.0049 444.0 27528 11.0897
10.0049 445.0 27590 11.0493
10.0049 446.0 27652 11.0395
10.0049 447.0 27714 10.8990
10.0049 448.0 27776 11.1673
10.0049 449.0 27838 11.1582
10.0049 450.0 27900 10.8591
10.0049 451.0 27962 11.0792
9.9924 452.0 28024 11.1450
9.9924 453.0 28086 10.9819
9.9924 454.0 28148 10.8871
9.9924 455.0 28210 10.9915
9.9924 456.0 28272 11.0373
9.9924 457.0 28334 10.9383
9.9924 458.0 28396 11.1292
9.9924 459.0 28458 11.1688
9.9918 460.0 28520 11.0430
9.9918 461.0 28582 11.0710
9.9918 462.0 28644 11.0110
9.9918 463.0 28706 11.0876
9.9918 464.0 28768 11.0982
9.9918 465.0 28830 10.9625
9.9918 466.0 28892 10.9642
9.9918 467.0 28954 10.7989
9.9799 468.0 29016 11.0038
9.9799 469.0 29078 11.1245
9.9799 470.0 29140 10.9135
9.9799 471.0 29202 10.9432
9.9799 472.0 29264 10.8295
9.9799 473.0 29326 10.9277
9.9799 474.0 29388 11.0949
9.9799 475.0 29450 11.0374
9.9961 476.0 29512 10.9588
9.9961 477.0 29574 11.0341
9.9961 478.0 29636 10.9541
9.9961 479.0 29698 10.9343
9.9961 480.0 29760 10.9599
9.9961 481.0 29822 10.9533
9.9961 482.0 29884 11.2046
9.9961 483.0 29946 10.9352
10.006 484.0 30008 11.1727
10.006 485.0 30070 10.9956
10.006 486.0 30132 11.1664
10.006 487.0 30194 11.0949
10.006 488.0 30256 10.9489
10.006 489.0 30318 11.0049
10.006 490.0 30380 11.1852
10.006 491.0 30442 11.1018
10.0083 492.0 30504 10.9130
10.0083 493.0 30566 10.9352
10.0083 494.0 30628 10.9716
10.0083 495.0 30690 11.1115
10.0083 496.0 30752 10.9810
10.0083 497.0 30814 10.9703
10.0083 498.0 30876 10.9395
10.0083 499.0 30938 11.0189
10.0106 500.0 31000 10.9759

Framework versions

  • Transformers 4.20.1
  • Pytorch 1.11.0
  • Datasets 2.1.0
  • Tokenizers 0.12.1