ArabicNewSplits7_FineTuningAraBERT_run1_AugV5_k6_task3_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.7449
• Qwk: 0.1416
• Mse: 0.7449
• Rmse: 0.8631

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.1111	2	3.6348	-0.0154	3.6348	1.9065
No log	0.2222	4	2.0756	-0.0292	2.0756	1.4407
No log	0.3333	6	1.1734	-0.0479	1.1734	1.0833
No log	0.4444	8	1.3332	-0.0385	1.3332	1.1546
No log	0.5556	10	1.0258	-0.0545	1.0258	1.0128
No log	0.6667	12	1.0136	-0.0545	1.0136	1.0068
No log	0.7778	14	0.8980	-0.0532	0.8980	0.9477
No log	0.8889	16	0.8864	0.0207	0.8864	0.9415
No log	1.0	18	0.7995	0.0628	0.7995	0.8942
No log	1.1111	20	0.7507	0.1444	0.7507	0.8664
No log	1.2222	22	0.7472	0.0436	0.7472	0.8644
No log	1.3333	24	0.9278	0.0839	0.9278	0.9632
No log	1.4444	26	0.8858	0.0233	0.8858	0.9412
No log	1.5556	28	0.7497	-0.1040	0.7497	0.8659
No log	1.6667	30	0.7760	0.0867	0.7760	0.8809
No log	1.7778	32	0.7349	-0.0939	0.7349	0.8573
No log	1.8889	34	0.7247	0.0068	0.7247	0.8513
No log	2.0	36	0.6733	0.0555	0.6733	0.8206
No log	2.1111	38	0.8329	0.0287	0.8329	0.9126
No log	2.2222	40	0.7826	0.0346	0.7826	0.8846
No log	2.3333	42	0.7653	0.0017	0.7653	0.8748
No log	2.4444	44	0.7566	-0.0881	0.7566	0.8699
No log	2.5556	46	0.9371	-0.0650	0.9371	0.9680
No log	2.6667	48	0.8302	0.0902	0.8302	0.9112
No log	2.7778	50	1.1856	0.0646	1.1856	1.0889
No log	2.8889	52	1.0697	0.0758	1.0697	1.0343
No log	3.0	54	0.9847	0.0403	0.9847	0.9923
No log	3.1111	56	1.1006	0.0219	1.1006	1.0491
No log	3.2222	58	0.9129	0.1819	0.9129	0.9554
No log	3.3333	60	0.8886	0.1268	0.8886	0.9426
No log	3.4444	62	0.8496	0.0661	0.8496	0.9217
No log	3.5556	64	0.8552	-0.0820	0.8552	0.9248
No log	3.6667	66	0.8509	-0.0820	0.8509	0.9224
No log	3.7778	68	0.7928	0.0277	0.7928	0.8904
No log	3.8889	70	0.8966	0.0618	0.8966	0.9469
No log	4.0	72	0.8626	0.0435	0.8626	0.9288
No log	4.1111	74	0.8052	0.1700	0.8052	0.8974
No log	4.2222	76	0.8743	0.0714	0.8743	0.9350
No log	4.3333	78	0.8363	0.0902	0.8363	0.9145
No log	4.4444	80	0.9610	0.1027	0.9610	0.9803
No log	4.5556	82	0.8825	-0.0008	0.8825	0.9394
No log	4.6667	84	0.7948	0.0095	0.7948	0.8915
No log	4.7778	86	0.7494	-0.0145	0.7494	0.8657
No log	4.8889	88	0.7471	0.0375	0.7471	0.8644
No log	5.0	90	0.8263	0.0917	0.8263	0.9090
No log	5.1111	92	0.8149	-0.0230	0.8149	0.9027
No log	5.2222	94	1.0083	0.0820	1.0083	1.0042
No log	5.3333	96	1.0897	0.0549	1.0897	1.0439
No log	5.4444	98	0.8179	0.1393	0.8179	0.9044
No log	5.5556	100	0.8201	0.0227	0.8201	0.9056
No log	5.6667	102	0.8526	0.1412	0.8526	0.9233
No log	5.7778	104	0.9089	0.1078	0.9089	0.9534
No log	5.8889	106	0.8295	0.2087	0.8295	0.9108
No log	6.0	108	0.8219	0.2066	0.8219	0.9066
No log	6.1111	110	0.7795	0.2109	0.7795	0.8829
No log	6.2222	112	0.7947	-0.0212	0.7947	0.8915
No log	6.3333	114	0.7449	0.1700	0.7449	0.8631
No log	6.4444	116	0.8378	0.1442	0.8378	0.9153
No log	6.5556	118	0.7708	0.1400	0.7708	0.8779
No log	6.6667	120	0.8188	-0.0269	0.8188	0.9049
No log	6.7778	122	0.7886	0.0200	0.7886	0.8881
No log	6.8889	124	0.8260	0.2832	0.8260	0.9088
No log	7.0	126	0.8282	0.2535	0.8282	0.9101
No log	7.1111	128	0.7646	0.2368	0.7646	0.8744
No log	7.2222	130	0.7504	-0.0171	0.7504	0.8662
No log	7.3333	132	0.7109	0.1630	0.7109	0.8432
No log	7.4444	134	0.6877	0.0465	0.6877	0.8293
No log	7.5556	136	0.6749	0.0571	0.6749	0.8215
No log	7.6667	138	0.7350	0.0710	0.7350	0.8573
No log	7.7778	140	0.7096	0.1128	0.7096	0.8424
No log	7.8889	142	0.8028	0.1120	0.8028	0.8960
No log	8.0	144	0.7993	0.1078	0.7993	0.8940
No log	8.1111	146	0.7467	0.1470	0.7467	0.8641
No log	8.2222	148	0.7637	0.0724	0.7637	0.8739
No log	8.3333	150	0.7558	0.0724	0.7558	0.8694
No log	8.4444	152	0.7492	0.1128	0.7492	0.8656
No log	8.5556	154	0.7104	0.1333	0.7104	0.8428
No log	8.6667	156	0.7298	0.1128	0.7298	0.8543
No log	8.7778	158	0.7285	0.1333	0.7285	0.8535
No log	8.8889	160	0.7985	0.1126	0.7985	0.8936
No log	9.0	162	0.8755	0.0776	0.8755	0.9357
No log	9.1111	164	0.8271	0.1036	0.8271	0.9094
No log	9.2222	166	0.7765	0.1539	0.7765	0.8812
No log	9.3333	168	0.7338	0.1327	0.7338	0.8566
No log	9.4444	170	0.7697	0.0724	0.7697	0.8773
No log	9.5556	172	0.7748	0.0291	0.7748	0.8802
No log	9.6667	174	0.7454	0.1127	0.7454	0.8634
No log	9.7778	176	0.7681	0.0216	0.7681	0.8764
No log	9.8889	178	0.7862	0.1569	0.7862	0.8867
No log	10.0	180	0.8695	0.0656	0.8695	0.9325
No log	10.1111	182	1.1003	0.0799	1.1003	1.0489
No log	10.2222	184	0.9880	0.1463	0.9880	0.9940
No log	10.3333	186	0.8060	0.1176	0.8060	0.8978
No log	10.4444	188	0.8285	0.0091	0.8285	0.9102
No log	10.5556	190	0.7488	0.0709	0.7488	0.8653
No log	10.6667	192	0.8210	0.0726	0.8210	0.9061
No log	10.7778	194	0.8112	0.1036	0.8112	0.9007
No log	10.8889	196	0.8066	0.1170	0.8066	0.8981
No log	11.0	198	0.8273	0.0995	0.8273	0.9096
No log	11.1111	200	0.9558	0.1113	0.9558	0.9776
No log	11.2222	202	1.0505	-0.0116	1.0505	1.0249
No log	11.3333	204	1.0892	-0.0079	1.0892	1.0437
No log	11.4444	206	0.9214	0.1113	0.9214	0.9599
No log	11.5556	208	0.7796	0.0791	0.7796	0.8829
No log	11.6667	210	0.7977	0.1192	0.7977	0.8931
No log	11.7778	212	0.8654	0.1361	0.8654	0.9303
No log	11.8889	214	0.9679	0.0778	0.9679	0.9838
No log	12.0	216	0.9566	0.0805	0.9566	0.9780
No log	12.1111	218	0.8093	0.0947	0.8093	0.8996
No log	12.2222	220	0.8199	0.0216	0.8199	0.9055
No log	12.3333	222	0.7808	0.1143	0.7808	0.8836
No log	12.4444	224	0.7763	0.0187	0.7763	0.8811
No log	12.5556	226	0.9558	0.0820	0.9558	0.9777
No log	12.6667	228	0.8665	0.0770	0.8665	0.9308
No log	12.7778	230	0.7170	0.1304	0.7170	0.8468
No log	12.8889	232	0.7804	0.0999	0.7804	0.8834
No log	13.0	234	0.7044	0.1675	0.7044	0.8393
No log	13.1111	236	0.7399	0.0196	0.7399	0.8602
No log	13.2222	238	0.7855	0.0310	0.7855	0.8863
No log	13.3333	240	0.6997	-0.0329	0.6997	0.8365
No log	13.4444	242	0.6883	0.1453	0.6883	0.8296
No log	13.5556	244	0.6823	0.2395	0.6823	0.8260
No log	13.6667	246	0.7126	0.0116	0.7126	0.8441
No log	13.7778	248	0.7278	0.0116	0.7278	0.8531
No log	13.8889	250	0.7050	0.0981	0.7050	0.8396
No log	14.0	252	0.6910	0.1463	0.6910	0.8313
No log	14.1111	254	0.7038	0.0557	0.7038	0.8389
No log	14.2222	256	0.7033	0.0981	0.7033	0.8387
No log	14.3333	258	0.6904	0.0978	0.6904	0.8309
No log	14.4444	260	0.7071	0.1249	0.7071	0.8409
No log	14.5556	262	0.7009	0.1835	0.7009	0.8372
No log	14.6667	264	0.7741	0.1078	0.7741	0.8798
No log	14.7778	266	0.8882	0.0050	0.8882	0.9424
No log	14.8889	268	0.7828	0.0726	0.7828	0.8847
No log	15.0	270	0.6958	0.1885	0.6958	0.8341
No log	15.1111	272	0.7048	0.1490	0.7048	0.8395
No log	15.2222	274	0.8563	0.0377	0.8563	0.9254
No log	15.3333	276	0.9414	0.0502	0.9414	0.9703
No log	15.4444	278	0.8175	0.0726	0.8175	0.9042
No log	15.5556	280	0.6938	0.1027	0.6938	0.8329
No log	15.6667	282	0.6989	0.0914	0.6989	0.8360
No log	15.7778	284	0.7345	0.1553	0.7345	0.8571
No log	15.8889	286	0.7292	0.1815	0.7292	0.8539
No log	16.0	288	0.7558	0.1537	0.7558	0.8694
No log	16.1111	290	0.7644	0.1379	0.7644	0.8743
No log	16.2222	292	0.7681	0.1282	0.7681	0.8764
No log	16.3333	294	0.7870	0.1541	0.7870	0.8871
No log	16.4444	296	0.7809	0.1859	0.7809	0.8837
No log	16.5556	298	0.7433	0.2122	0.7433	0.8621
No log	16.6667	300	0.7251	0.1292	0.7251	0.8515
No log	16.7778	302	0.7590	0.0664	0.7590	0.8712
No log	16.8889	304	0.7805	0.0718	0.7805	0.8834
No log	17.0	306	0.8183	0.0406	0.8183	0.9046
No log	17.1111	308	0.7350	0.0644	0.7350	0.8573
No log	17.2222	310	0.6854	0.2304	0.6854	0.8279
No log	17.3333	312	0.6809	0.1444	0.6809	0.8252
No log	17.4444	314	0.6950	-0.0473	0.6950	0.8337
No log	17.5556	316	0.7410	-0.0284	0.7410	0.8608
No log	17.6667	318	0.7532	-0.0648	0.7532	0.8679
No log	17.7778	320	0.7411	-0.0738	0.7411	0.8609
No log	17.8889	322	0.7946	0.0726	0.7946	0.8914
No log	18.0	324	0.8081	0.1078	0.8081	0.8989
No log	18.1111	326	0.8029	0.1263	0.8029	0.8960
No log	18.2222	328	0.8279	0.1623	0.8279	0.9099
No log	18.3333	330	0.8955	0.1037	0.8955	0.9463
No log	18.4444	332	0.8132	0.1255	0.8132	0.9018
No log	18.5556	334	0.7692	0.0246	0.7692	0.8771
No log	18.6667	336	0.7374	0.1277	0.7374	0.8587
No log	18.7778	338	0.8346	0.0726	0.8346	0.9136
No log	18.8889	340	0.8293	0.1078	0.8293	0.9107
No log	19.0	342	0.8627	0.1770	0.8627	0.9288
No log	19.1111	344	0.7848	0.1660	0.7848	0.8859
No log	19.2222	346	0.7475	0.1228	0.7475	0.8646
No log	19.3333	348	0.7489	0.1199	0.7489	0.8654
No log	19.4444	350	0.7400	0.1311	0.7400	0.8602
No log	19.5556	352	0.7394	0.0902	0.7394	0.8599
No log	19.6667	354	0.7337	0.0157	0.7337	0.8565
No log	19.7778	356	0.7186	0.1769	0.7186	0.8477
No log	19.8889	358	0.7234	0.1311	0.7234	0.8505
No log	20.0	360	0.7222	0.1828	0.7222	0.8498
No log	20.1111	362	0.7111	0.1828	0.7111	0.8433
No log	20.2222	364	0.7059	0.1828	0.7059	0.8402
No log	20.3333	366	0.7098	0.1413	0.7098	0.8425
No log	20.4444	368	0.7310	0.0157	0.7310	0.8550
No log	20.5556	370	0.7253	0.0934	0.7253	0.8516
No log	20.6667	372	0.7292	0.1659	0.7292	0.8539
No log	20.7778	374	0.7579	0.1965	0.7579	0.8706
No log	20.8889	376	0.7522	0.2096	0.7522	0.8673
No log	21.0	378	0.7743	0.0157	0.7743	0.8799
No log	21.1111	380	0.8732	0.0690	0.8732	0.9345
No log	21.2222	382	0.8152	0.0220	0.8152	0.9029
No log	21.3333	384	0.7910	0.1518	0.7910	0.8894
No log	21.4444	386	0.8036	0.1387	0.8036	0.8964
No log	21.5556	388	0.7920	0.1485	0.7920	0.8900
No log	21.6667	390	0.7954	0.0408	0.7954	0.8919
No log	21.7778	392	1.0076	0.0089	1.0076	1.0038
No log	21.8889	394	1.2286	0.0582	1.2286	1.1084
No log	22.0	396	1.1046	0.0558	1.1046	1.0510
No log	22.1111	398	0.8768	0.1601	0.8768	0.9364
No log	22.2222	400	0.8613	0.1011	0.8613	0.9281
No log	22.3333	402	0.8744	0.0541	0.8744	0.9351
No log	22.4444	404	0.8470	0.0807	0.8470	0.9203
No log	22.5556	406	0.9117	0.0337	0.9117	0.9548
No log	22.6667	408	0.8856	0.1039	0.8856	0.9411
No log	22.7778	410	0.7987	0.1170	0.7987	0.8937
No log	22.8889	412	0.8082	0.1049	0.8082	0.8990
No log	23.0	414	0.8080	0.1324	0.8080	0.8989
No log	23.1111	416	0.7737	0.0670	0.7737	0.8796
No log	23.2222	418	0.7946	0.1697	0.7946	0.8914
No log	23.3333	420	0.8585	0.1039	0.8585	0.9265
No log	23.4444	422	0.7964	0.1373	0.7964	0.8924
No log	23.5556	424	0.7355	0.1617	0.7355	0.8576
No log	23.6667	426	0.7258	0.1097	0.7258	0.8520
No log	23.7778	428	0.7091	0.2122	0.7091	0.8421
No log	23.8889	430	0.7655	0.1816	0.7655	0.8749
No log	24.0	432	0.8410	0.0770	0.8410	0.9170
No log	24.1111	434	0.7757	0.0726	0.7757	0.8807
No log	24.2222	436	0.7029	0.0922	0.7029	0.8384
No log	24.3333	438	0.7001	0.2180	0.7001	0.8367
No log	24.4444	440	0.7065	0.2180	0.7065	0.8405
No log	24.5556	442	0.7139	0.0922	0.7139	0.8449
No log	24.6667	444	0.8309	0.1037	0.8309	0.9115
No log	24.7778	446	0.9122	0.0392	0.9122	0.9551
No log	24.8889	448	0.8167	0.1037	0.8167	0.9037
No log	25.0	450	0.7177	0.0449	0.7177	0.8472
No log	25.1111	452	0.7887	0.0867	0.7887	0.8881
No log	25.2222	454	0.7742	0.0909	0.7742	0.8799
No log	25.3333	456	0.7087	0.0914	0.7087	0.8419
No log	25.4444	458	0.6938	0.0914	0.6938	0.8330
No log	25.5556	460	0.6883	0.1444	0.6883	0.8297
No log	25.6667	462	0.6844	0.0914	0.6844	0.8273
No log	25.7778	464	0.7223	0.2180	0.7223	0.8499
No log	25.8889	466	0.7649	0.0909	0.7649	0.8746
No log	26.0	468	0.7404	0.1675	0.7404	0.8605
No log	26.1111	470	0.7398	0.1705	0.7398	0.8601
No log	26.2222	472	0.7596	0.1675	0.7596	0.8716
No log	26.3333	474	0.7587	0.2078	0.7587	0.8710
No log	26.4444	476	0.7597	0.2078	0.7597	0.8716
No log	26.5556	478	0.7477	0.2584	0.7477	0.8647
No log	26.6667	480	0.7523	0.1775	0.7523	0.8673
No log	26.7778	482	0.7677	0.1775	0.7677	0.8762
No log	26.8889	484	0.7349	0.1899	0.7349	0.8573
No log	27.0	486	0.6966	0.2122	0.6966	0.8346
No log	27.1111	488	0.6906	0.2122	0.6906	0.8310
No log	27.2222	490	0.6877	0.0874	0.6877	0.8293
No log	27.3333	492	0.6820	0.0922	0.6820	0.8259
No log	27.4444	494	0.6784	0.0922	0.6784	0.8236
No log	27.5556	496	0.6860	0.0922	0.6860	0.8283
No log	27.6667	498	0.7001	0.1249	0.7001	0.8367
0.2525	27.7778	500	0.7135	0.1599	0.7135	0.8447
0.2525	27.8889	502	0.7134	0.1244	0.7134	0.8446
0.2525	28.0	504	0.7277	0.1729	0.7277	0.8530
0.2525	28.1111	506	0.7368	0.2412	0.7368	0.8584
0.2525	28.2222	508	0.7418	0.2412	0.7418	0.8613
0.2525	28.3333	510	0.7773	0.1686	0.7773	0.8817
0.2525	28.4444	512	0.8127	0.0993	0.8127	0.9015
0.2525	28.5556	514	0.7818	0.1345	0.7818	0.8842
0.2525	28.6667	516	0.7298	0.0798	0.7298	0.8543
0.2525	28.7778	518	0.7139	0.1196	0.7139	0.8449
0.2525	28.8889	520	0.7116	0.1675	0.7116	0.8435
0.2525	29.0	522	0.6968	0.1249	0.6968	0.8348
0.2525	29.1111	524	0.7044	0.0028	0.7044	0.8393
0.2525	29.2222	526	0.7374	0.1416	0.7374	0.8587
0.2525	29.3333	528	0.7330	0.1416	0.7330	0.8561
0.2525	29.4444	530	0.7449	0.1416	0.7449	0.8631

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1