ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k8_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2327
• Qwk: 0.1512
• Mse: 1.2327
• Rmse: 1.1103

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0690	2	4.7847	0.0010	4.7847	2.1874
No log	0.1379	4	2.7317	-0.0011	2.7317	1.6528
No log	0.2069	6	2.2480	-0.0553	2.2480	1.4993
No log	0.2759	8	3.0505	-0.1046	3.0505	1.7466
No log	0.3448	10	2.7817	-0.0980	2.7817	1.6678
No log	0.4138	12	2.0859	0.0041	2.0859	1.4443
No log	0.4828	14	1.4672	0.1516	1.4672	1.2113
No log	0.5517	16	1.4671	0.0101	1.4671	1.2112
No log	0.6207	18	1.5824	0.0227	1.5824	1.2579
No log	0.6897	20	1.7152	0.0227	1.7152	1.3096
No log	0.7586	22	2.0575	0.0118	2.0575	1.4344
No log	0.8276	24	2.0797	0.0118	2.0797	1.4421
No log	0.8966	26	1.7282	0.0355	1.7282	1.3146
No log	0.9655	28	1.2809	0.1912	1.2809	1.1318
No log	1.0345	30	1.1119	0.2416	1.1119	1.0544
No log	1.1034	32	1.0934	0.2416	1.0934	1.0457
No log	1.1724	34	1.2493	0.1388	1.2493	1.1177
No log	1.2414	36	1.7490	0.1272	1.7490	1.3225
No log	1.3103	38	1.9777	0.1074	1.9777	1.4063
No log	1.3793	40	1.9515	0.1074	1.9515	1.3970
No log	1.4483	42	1.8711	0.0975	1.8711	1.3679
No log	1.5172	44	1.8546	0.1024	1.8546	1.3618
No log	1.5862	46	2.0861	0.1905	2.0861	1.4444
No log	1.6552	48	1.6238	0.0764	1.6238	1.2743
No log	1.7241	50	1.3348	0.1868	1.3348	1.1553
No log	1.7931	52	1.1670	0.1803	1.1670	1.0803
No log	1.8621	54	1.3172	0.1868	1.3172	1.1477
No log	1.9310	56	1.8017	0.1986	1.8017	1.3423
No log	2.0	58	1.9583	0.2265	1.9583	1.3994
No log	2.0690	60	1.9757	0.2161	1.9757	1.4056
No log	2.1379	62	1.6104	0.2580	1.6104	1.2690
No log	2.2069	64	1.4154	0.1790	1.4154	1.1897
No log	2.2759	66	1.2560	0.1685	1.2560	1.1207
No log	2.3448	68	1.1278	0.2377	1.1278	1.0620
No log	2.4138	70	1.0104	0.3762	1.0104	1.0052
No log	2.4828	72	1.0227	0.3747	1.0227	1.0113
No log	2.5517	74	1.2036	0.2286	1.2036	1.0971
No log	2.6207	76	1.1553	0.2020	1.1553	1.0748
No log	2.6897	78	1.3636	0.3099	1.3636	1.1678
No log	2.7586	80	1.9737	0.1868	1.9737	1.4049
No log	2.8276	82	2.1471	0.1684	2.1471	1.4653
No log	2.8966	84	1.6708	0.2408	1.6708	1.2926
No log	2.9655	86	1.2519	0.2069	1.2519	1.1189
No log	3.0345	88	1.1644	0.2388	1.1644	1.0791
No log	3.1034	90	1.1929	0.2382	1.1929	1.0922
No log	3.1724	92	1.4450	0.2622	1.4450	1.2021
No log	3.2414	94	1.8301	0.1614	1.8301	1.3528
No log	3.3103	96	1.8619	0.1728	1.8619	1.3645
No log	3.3793	98	1.6129	0.1538	1.6129	1.2700
No log	3.4483	100	1.2347	0.2019	1.2347	1.1112
No log	3.5172	102	1.0417	0.3646	1.0417	1.0206
No log	3.5862	104	0.9846	0.3237	0.9846	0.9923
No log	3.6552	106	1.0483	0.3902	1.0483	1.0239
No log	3.7241	108	1.2019	0.2851	1.2019	1.0963
No log	3.7931	110	1.5266	0.2200	1.5266	1.2355
No log	3.8621	112	1.5033	0.2349	1.5033	1.2261
No log	3.9310	114	1.2021	0.2832	1.2021	1.0964
No log	4.0	116	1.0721	0.3443	1.0721	1.0354
No log	4.0690	118	1.0703	0.3443	1.0703	1.0346
No log	4.1379	120	1.2746	0.2919	1.2746	1.1290
No log	4.2069	122	1.5433	0.2190	1.5433	1.2423
No log	4.2759	124	1.4530	0.2114	1.4530	1.2054
No log	4.3448	126	1.4045	0.1533	1.4045	1.1851
No log	4.4138	128	1.2999	0.2657	1.2999	1.1401
No log	4.4828	130	1.5164	0.1677	1.5164	1.2314
No log	4.5517	132	2.0394	0.0801	2.0394	1.4281
No log	4.6207	134	1.9511	0.0710	1.9511	1.3968
No log	4.6897	136	1.3908	0.2411	1.3908	1.1793
No log	4.7586	138	1.1334	0.2480	1.1334	1.0646
No log	4.8276	140	1.1061	0.2804	1.1061	1.0517
No log	4.8966	142	1.2289	0.2806	1.2289	1.1086
No log	4.9655	144	1.3334	0.2939	1.3334	1.1547
No log	5.0345	146	1.2118	0.2397	1.2118	1.1008
No log	5.1034	148	1.1085	0.2850	1.1085	1.0528
No log	5.1724	150	1.1491	0.2902	1.1491	1.0720
No log	5.2414	152	1.4161	0.2746	1.4161	1.1900
No log	5.3103	154	1.4269	0.2674	1.4269	1.1945
No log	5.3793	156	1.3160	0.2385	1.3160	1.1472
No log	5.4483	158	1.2254	0.2246	1.2254	1.1070
No log	5.5172	160	1.2006	0.2572	1.2006	1.0957
No log	5.5862	162	1.3000	0.1814	1.3000	1.1402
No log	5.6552	164	1.4639	0.1416	1.4639	1.2099
No log	5.7241	166	1.3100	0.1943	1.3100	1.1446
No log	5.7931	168	1.1884	0.2360	1.1884	1.0902
No log	5.8621	170	1.1936	0.2360	1.1936	1.0925
No log	5.9310	172	1.2760	0.1935	1.2760	1.1296
No log	6.0	174	1.5078	0.1358	1.5078	1.2279
No log	6.0690	176	1.4106	0.1785	1.4106	1.1877
No log	6.1379	178	1.1683	0.2745	1.1683	1.0809
No log	6.2069	180	1.1533	0.2857	1.1533	1.0739
No log	6.2759	182	1.1413	0.1406	1.1413	1.0683
No log	6.3448	184	1.1211	0.2296	1.1211	1.0588
No log	6.4138	186	1.2475	0.2673	1.2475	1.1169
No log	6.4828	188	1.5733	0.2234	1.5733	1.2543
No log	6.5517	190	1.8091	0.1141	1.8091	1.3450
No log	6.6207	192	1.6873	0.1225	1.6873	1.2990
No log	6.6897	194	1.3104	0.2444	1.3104	1.1447
No log	6.7586	196	1.0933	0.3090	1.0933	1.0456
No log	6.8276	198	1.0951	0.2403	1.0951	1.0465
No log	6.8966	200	1.1011	0.3132	1.1011	1.0493
No log	6.9655	202	1.1929	0.2901	1.1929	1.0922
No log	7.0345	204	1.6423	0.2221	1.6423	1.2815
No log	7.1034	206	1.9024	0.1469	1.9024	1.3793
No log	7.1724	208	1.6737	0.2151	1.6737	1.2937
No log	7.2414	210	1.3357	0.2772	1.3357	1.1557
No log	7.3103	212	1.1910	0.2519	1.1910	1.0913
No log	7.3793	214	1.2011	0.2625	1.2011	1.0959
No log	7.4483	216	1.2235	0.2327	1.2235	1.1061
No log	7.5172	218	1.1311	0.3476	1.1311	1.0635
No log	7.5862	220	1.0933	0.4181	1.0933	1.0456
No log	7.6552	222	1.0577	0.4181	1.0577	1.0285
No log	7.7241	224	1.0605	0.3618	1.0605	1.0298
No log	7.7931	226	1.1145	0.2920	1.1145	1.0557
No log	7.8621	228	1.1350	0.2611	1.1350	1.0654
No log	7.9310	230	1.1970	0.3067	1.1970	1.0941
No log	8.0	232	1.0945	0.3262	1.0945	1.0462
No log	8.0690	234	1.0101	0.3979	1.0101	1.0050
No log	8.1379	236	0.9944	0.3164	0.9944	0.9972
No log	8.2069	238	0.9966	0.3164	0.9966	0.9983
No log	8.2759	240	1.0064	0.3596	1.0064	1.0032
No log	8.3448	242	1.1399	0.3494	1.1399	1.0677
No log	8.4138	244	1.2797	0.3006	1.2797	1.1313
No log	8.4828	246	1.3225	0.2846	1.3225	1.1500
No log	8.5517	248	1.1834	0.3330	1.1834	1.0879
No log	8.6207	250	1.0838	0.2740	1.0838	1.0411
No log	8.6897	252	1.0603	0.3764	1.0603	1.0297
No log	8.7586	254	1.0729	0.3764	1.0729	1.0358
No log	8.8276	256	1.0834	0.3764	1.0834	1.0409
No log	8.8966	258	1.0879	0.3811	1.0879	1.0430
No log	8.9655	260	1.0930	0.3811	1.0930	1.0455
No log	9.0345	262	1.1302	0.3194	1.1302	1.0631
No log	9.1034	264	1.2421	0.2470	1.2421	1.1145
No log	9.1724	266	1.3373	0.2444	1.3373	1.1564
No log	9.2414	268	1.2846	0.2459	1.2846	1.1334
No log	9.3103	270	1.1343	0.2529	1.1343	1.0650
No log	9.3793	272	1.0858	0.3566	1.0858	1.0420
No log	9.4483	274	1.0816	0.3566	1.0816	1.0400
No log	9.5172	276	1.1049	0.2804	1.1049	1.0511
No log	9.5862	278	1.2246	0.2688	1.2246	1.1066
No log	9.6552	280	1.4340	0.3022	1.4340	1.1975
No log	9.7241	282	1.3817	0.2145	1.3817	1.1755
No log	9.7931	284	1.1453	0.2685	1.1453	1.0702
No log	9.8621	286	1.0811	0.3566	1.0811	1.0398
No log	9.9310	288	1.0866	0.3566	1.0866	1.0424
No log	10.0	290	1.1162	0.3312	1.1162	1.0565
No log	10.0690	292	1.1018	0.3701	1.1018	1.0497
No log	10.1379	294	1.1564	0.2964	1.1564	1.0754
No log	10.2069	296	1.1721	0.2964	1.1721	1.0826
No log	10.2759	298	1.0874	0.3836	1.0874	1.0428
No log	10.3448	300	1.0506	0.3701	1.0506	1.0250
No log	10.4138	302	1.0384	0.4026	1.0384	1.0190
No log	10.4828	304	1.0388	0.4026	1.0388	1.0192
No log	10.5517	306	1.1131	0.3516	1.1131	1.0550
No log	10.6207	308	1.1685	0.3691	1.1685	1.0810
No log	10.6897	310	1.1286	0.3361	1.1286	1.0624
No log	10.7586	312	1.0458	0.3969	1.0458	1.0227
No log	10.8276	314	0.9947	0.4039	0.9947	0.9973
No log	10.8966	316	1.0032	0.4845	1.0032	1.0016
No log	10.9655	318	1.0301	0.3838	1.0301	1.0149
No log	11.0345	320	1.1562	0.3119	1.1562	1.0753
No log	11.1034	322	1.2997	0.2701	1.2997	1.1400
No log	11.1724	324	1.3233	0.2568	1.3233	1.1503
No log	11.2414	326	1.1747	0.2925	1.1747	1.0838
No log	11.3103	328	1.0530	0.4705	1.0530	1.0261
No log	11.3793	330	1.0386	0.4181	1.0386	1.0191
No log	11.4483	332	1.0373	0.4217	1.0373	1.0185
No log	11.5172	334	1.0715	0.3567	1.0715	1.0351
No log	11.5862	336	1.3114	0.2863	1.3114	1.1452
No log	11.6552	338	1.4878	0.2033	1.4878	1.2197
No log	11.7241	340	1.4960	0.2033	1.4960	1.2231
No log	11.7931	342	1.2939	0.2815	1.2939	1.1375
No log	11.8621	344	1.1281	0.2787	1.1281	1.0621
No log	11.9310	346	1.0673	0.3516	1.0673	1.0331
No log	12.0	348	1.0935	0.3427	1.0935	1.0457
No log	12.0690	350	1.1531	0.2963	1.1531	1.0738
No log	12.1379	352	1.3226	0.2275	1.3226	1.1500
No log	12.2069	354	1.5506	0.2266	1.5506	1.2452
No log	12.2759	356	1.5050	0.1954	1.5050	1.2268
No log	12.3448	358	1.2642	0.1751	1.2642	1.1244
No log	12.4138	360	1.1147	0.3033	1.1147	1.0558
No log	12.4828	362	1.1125	0.3355	1.1125	1.0547
No log	12.5517	364	1.2001	0.2316	1.2001	1.0955
No log	12.6207	366	1.2985	0.1677	1.2985	1.1395
No log	12.6897	368	1.3301	0.1888	1.3301	1.1533
No log	12.7586	370	1.3313	0.1888	1.3313	1.1538
No log	12.8276	372	1.1992	0.2431	1.1992	1.0951
No log	12.8966	374	1.0996	0.4181	1.0996	1.0486
No log	12.9655	376	1.1066	0.3412	1.1066	1.0520
No log	13.0345	378	1.1114	0.3948	1.1114	1.0542
No log	13.1034	380	1.1517	0.3077	1.1517	1.0732
No log	13.1724	382	1.2546	0.1956	1.2546	1.1201
No log	13.2414	384	1.4261	0.1681	1.4261	1.1942
No log	13.3103	386	1.5171	0.1872	1.5171	1.2317
No log	13.3793	388	1.4611	0.1582	1.4611	1.2087
No log	13.4483	390	1.3073	0.1845	1.3073	1.1434
No log	13.5172	392	1.1628	0.3081	1.1628	1.0783
No log	13.5862	394	1.1258	0.3747	1.1258	1.0611
No log	13.6552	396	1.1518	0.3336	1.1518	1.0732
No log	13.7241	398	1.2389	0.2486	1.2389	1.1130
No log	13.7931	400	1.3804	0.1677	1.3804	1.1749
No log	13.8621	402	1.3761	0.2059	1.3761	1.1731
No log	13.9310	404	1.2937	0.2301	1.2937	1.1374
No log	14.0	406	1.2384	0.2900	1.2384	1.1128
No log	14.0690	408	1.1499	0.3081	1.1499	1.0723
No log	14.1379	410	1.1022	0.3224	1.1022	1.0498
No log	14.2069	412	1.0778	0.3399	1.0778	1.0382
No log	14.2759	414	1.0832	0.3920	1.0832	1.0408
No log	14.3448	416	1.1447	0.2605	1.1447	1.0699
No log	14.4138	418	1.2004	0.2280	1.2004	1.0956
No log	14.4828	420	1.2769	0.1738	1.2769	1.1300
No log	14.5517	422	1.2307	0.2280	1.2307	1.1094
No log	14.6207	424	1.1480	0.2445	1.1480	1.0714
No log	14.6897	426	1.0694	0.4023	1.0694	1.0341
No log	14.7586	428	1.0541	0.3548	1.0541	1.0267
No log	14.8276	430	1.0556	0.3771	1.0556	1.0274
No log	14.8966	432	1.0607	0.4120	1.0607	1.0299
No log	14.9655	434	1.1694	0.1906	1.1694	1.0814
No log	15.0345	436	1.3313	0.1886	1.3313	1.1538
No log	15.1034	438	1.3503	0.1886	1.3503	1.1620
No log	15.1724	440	1.3329	0.1886	1.3329	1.1545
No log	15.2414	442	1.2523	0.1785	1.2523	1.1191
No log	15.3103	444	1.1901	0.2806	1.1901	1.0909
No log	15.3793	446	1.1254	0.2786	1.1254	1.0608
No log	15.4483	448	1.1044	0.2897	1.1044	1.0509
No log	15.5172	450	1.1149	0.3397	1.1149	1.0559
No log	15.5862	452	1.2043	0.1826	1.2043	1.0974
No log	15.6552	454	1.3840	0.1468	1.3840	1.1764
No log	15.7241	456	1.4396	0.2191	1.4396	1.1998
No log	15.7931	458	1.3136	0.1928	1.3136	1.1461
No log	15.8621	460	1.1573	0.2058	1.1573	1.0758
No log	15.9310	462	1.0420	0.3627	1.0420	1.0208
No log	16.0	464	1.0238	0.3685	1.0238	1.0118
No log	16.0690	466	1.0304	0.3596	1.0304	1.0151
No log	16.1379	468	1.0444	0.3472	1.0444	1.0220
No log	16.2069	470	1.0944	0.2944	1.0944	1.0461
No log	16.2759	472	1.1325	0.3273	1.1325	1.0642
No log	16.3448	474	1.2451	0.2718	1.2451	1.1158
No log	16.4138	476	1.4479	0.2070	1.4479	1.2033
No log	16.4828	478	1.4413	0.2070	1.4413	1.2006
No log	16.5517	480	1.3487	0.2239	1.3487	1.1613
No log	16.6207	482	1.2331	0.1921	1.2331	1.1104
No log	16.6897	484	1.1395	0.2397	1.1395	1.0675
No log	16.7586	486	1.1256	0.3406	1.1256	1.0609
No log	16.8276	488	1.1371	0.3268	1.1371	1.0664
No log	16.8966	490	1.1807	0.2081	1.1807	1.0866
No log	16.9655	492	1.1993	0.2431	1.1993	1.0951
No log	17.0345	494	1.2035	0.3297	1.2035	1.0971
No log	17.1034	496	1.1933	0.3255	1.1933	1.0924
No log	17.1724	498	1.1821	0.3255	1.1821	1.0873
0.3384	17.2414	500	1.1756	0.3166	1.1756	1.0842
0.3384	17.3103	502	1.2113	0.2727	1.2113	1.1006
0.3384	17.3793	504	1.2127	0.3202	1.2127	1.1012
0.3384	17.4483	506	1.2133	0.2438	1.2133	1.1015
0.3384	17.5172	508	1.1681	0.2896	1.1681	1.0808
0.3384	17.5862	510	1.0919	0.3321	1.0919	1.0449
0.3384	17.6552	512	1.0607	0.3451	1.0607	1.0299
0.3384	17.7241	514	1.0371	0.3467	1.0371	1.0184
0.3384	17.7931	516	1.0321	0.3467	1.0321	1.0159
0.3384	17.8621	518	1.0366	0.3723	1.0366	1.0181
0.3384	17.9310	520	1.0513	0.3418	1.0513	1.0253
0.3384	18.0	522	1.0335	0.4061	1.0335	1.0166
0.3384	18.0690	524	1.0249	0.4256	1.0249	1.0124
0.3384	18.1379	526	1.0379	0.3780	1.0379	1.0188
0.3384	18.2069	528	1.0758	0.3559	1.0758	1.0372
0.3384	18.2759	530	1.1077	0.3128	1.1077	1.0525
0.3384	18.3448	532	1.1164	0.2687	1.1164	1.0566
0.3384	18.4138	534	1.0776	0.3476	1.0776	1.0381
0.3384	18.4828	536	1.0188	0.3650	1.0188	1.0094
0.3384	18.5517	538	1.0008	0.3983	1.0008	1.0004
0.3384	18.6207	540	1.0090	0.4042	1.0090	1.0045
0.3384	18.6897	542	1.0150	0.4181	1.0150	1.0075
0.3384	18.7586	544	1.0254	0.3938	1.0254	1.0126
0.3384	18.8276	546	1.0429	0.3596	1.0429	1.0212
0.3384	18.8966	548	1.0634	0.3497	1.0634	1.0312
0.3384	18.9655	550	1.1308	0.2921	1.1308	1.0634
0.3384	19.0345	552	1.2013	0.1632	1.2013	1.0960
0.3384	19.1034	554	1.1888	0.1950	1.1888	1.0903
0.3384	19.1724	556	1.2232	0.1785	1.2232	1.1060
0.3384	19.2414	558	1.2327	0.1512	1.2327	1.1103

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1