ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k17_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.1043
• Qwk: 0.3200
• Mse: 1.1043
• Rmse: 1.0509

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0328	2	4.6296	0.0010	4.6296	2.1516
No log	0.0656	4	2.8694	0.0205	2.8694	1.6939
No log	0.0984	6	1.9692	-0.0017	1.9692	1.4033
No log	0.1311	8	2.0821	-0.0634	2.0821	1.4429
No log	0.1639	10	1.8211	0.0227	1.8211	1.3495
No log	0.1967	12	1.4127	-0.0096	1.4127	1.1886
No log	0.2295	14	1.2977	0.1260	1.2977	1.1392
No log	0.2623	16	1.2637	0.1107	1.2637	1.1242
No log	0.2951	18	1.3199	0.1288	1.3199	1.1489
No log	0.3279	20	1.4145	-0.0114	1.4145	1.1893
No log	0.3607	22	1.5902	0.0403	1.5902	1.2610
No log	0.3934	24	1.4493	0.0275	1.4493	1.2039
No log	0.4262	26	1.3329	0.0894	1.3329	1.1545
No log	0.4590	28	1.2677	0.1904	1.2677	1.1259
No log	0.4918	30	1.2638	0.2108	1.2638	1.1242
No log	0.5246	32	1.6114	0.0019	1.6114	1.2694
No log	0.5574	34	1.8959	0.0846	1.8959	1.3769
No log	0.5902	36	1.7425	0.0810	1.7425	1.3200
No log	0.6230	38	1.5763	0.0870	1.5763	1.2555
No log	0.6557	40	1.4307	0.0851	1.4307	1.1961
No log	0.6885	42	1.3777	0.1196	1.3777	1.1738
No log	0.7213	44	1.3692	0.2252	1.3692	1.1701
No log	0.7541	46	1.3708	0.2062	1.3708	1.1708
No log	0.7869	48	1.5012	0.1768	1.5012	1.2252
No log	0.8197	50	1.4187	0.2069	1.4187	1.1911
No log	0.8525	52	1.4428	0.2236	1.4428	1.2012
No log	0.8852	54	1.3572	0.1886	1.3572	1.1650
No log	0.9180	56	1.2117	0.2473	1.2117	1.1008
No log	0.9508	58	1.1199	0.3106	1.1199	1.0583
No log	0.9836	60	1.0953	0.3385	1.0953	1.0466
No log	1.0164	62	1.1061	0.2836	1.1061	1.0517
No log	1.0492	64	1.0667	0.2986	1.0667	1.0328
No log	1.0820	66	1.0567	0.2963	1.0567	1.0279
No log	1.1148	68	1.1595	0.2180	1.1595	1.0768
No log	1.1475	70	1.2388	0.2126	1.2388	1.1130
No log	1.1803	72	1.4148	0.1785	1.4148	1.1895
No log	1.2131	74	1.3665	0.1174	1.3665	1.1690
No log	1.2459	76	1.3367	0.2108	1.3367	1.1562
No log	1.2787	78	1.2575	0.2619	1.2575	1.1214
No log	1.3115	80	1.0372	0.2963	1.0372	1.0184
No log	1.3443	82	0.9544	0.2991	0.9544	0.9769
No log	1.3770	84	0.9770	0.2887	0.9770	0.9884
No log	1.4098	86	1.2323	0.1734	1.2323	1.1101
No log	1.4426	88	1.7707	0.1860	1.7707	1.3307
No log	1.4754	90	1.9613	0.1141	1.9613	1.4005
No log	1.5082	92	1.7104	0.2338	1.7104	1.3078
No log	1.5410	94	1.7601	0.2453	1.7601	1.3267
No log	1.5738	96	1.5147	0.1993	1.5147	1.2307
No log	1.6066	98	1.0971	0.2913	1.0971	1.0474
No log	1.6393	100	0.9711	0.3804	0.9711	0.9855
No log	1.6721	102	0.9570	0.4377	0.9570	0.9783
No log	1.7049	104	0.9884	0.3738	0.9884	0.9942
No log	1.7377	106	1.2220	0.2762	1.2220	1.1055
No log	1.7705	108	1.5241	0.2474	1.5241	1.2345
No log	1.8033	110	1.5157	0.2252	1.5157	1.2311
No log	1.8361	112	1.3055	0.3127	1.3055	1.1426
No log	1.8689	114	1.0314	0.3108	1.0314	1.0156
No log	1.9016	116	0.9572	0.3891	0.9572	0.9783
No log	1.9344	118	0.9776	0.3796	0.9776	0.9887
No log	1.9672	120	1.0216	0.3827	1.0216	1.0107
No log	2.0	122	1.0402	0.3636	1.0402	1.0199
No log	2.0328	124	1.0719	0.3453	1.0719	1.0353
No log	2.0656	126	1.1257	0.3393	1.1257	1.0610
No log	2.0984	128	1.2568	0.3987	1.2568	1.1211
No log	2.1311	130	1.3705	0.2926	1.3705	1.1707
No log	2.1639	132	1.4829	0.1890	1.4829	1.2178
No log	2.1967	134	1.3886	0.2632	1.3886	1.1784
No log	2.2295	136	1.2395	0.2611	1.2395	1.1133
No log	2.2623	138	1.1917	0.3237	1.1917	1.0917
No log	2.2951	140	1.1346	0.3261	1.1346	1.0652
No log	2.3279	142	1.1865	0.2663	1.1865	1.0893
No log	2.3607	144	1.2452	0.3555	1.2452	1.1159
No log	2.3934	146	1.5123	0.2055	1.5123	1.2298
No log	2.4262	148	1.9584	0.1438	1.9584	1.3994
No log	2.4590	150	2.0286	0.0697	2.0286	1.4243
No log	2.4918	152	1.7059	0.1135	1.7059	1.3061
No log	2.5246	154	1.3321	0.1980	1.3321	1.1542
No log	2.5574	156	1.2585	0.2438	1.2585	1.1218
No log	2.5902	158	1.1631	0.2487	1.1631	1.0785
No log	2.6230	160	1.0348	0.3511	1.0348	1.0173
No log	2.6557	162	1.1017	0.2939	1.1017	1.0496
No log	2.6885	164	1.1333	0.3078	1.1333	1.0646
No log	2.7213	166	1.1337	0.3781	1.1337	1.0648
No log	2.7541	168	1.2224	0.2287	1.2224	1.1056
No log	2.7869	170	1.2675	0.2446	1.2675	1.1258
No log	2.8197	172	1.2764	0.2555	1.2764	1.1298
No log	2.8525	174	1.2092	0.2605	1.2092	1.0996
No log	2.8852	176	1.1439	0.2560	1.1439	1.0695
No log	2.9180	178	1.0875	0.2891	1.0875	1.0429
No log	2.9508	180	1.0557	0.3250	1.0557	1.0274
No log	2.9836	182	1.0398	0.3930	1.0398	1.0197
No log	3.0164	184	1.0357	0.4160	1.0357	1.0177
No log	3.0492	186	1.0474	0.4160	1.0474	1.0234
No log	3.0820	188	1.0398	0.3842	1.0398	1.0197
No log	3.1148	190	1.0041	0.3701	1.0041	1.0021
No log	3.1475	192	1.0012	0.3701	1.0012	1.0006
No log	3.1803	194	1.0144	0.3995	1.0144	1.0072
No log	3.2131	196	1.0353	0.3995	1.0353	1.0175
No log	3.2459	198	1.0805	0.3649	1.0805	1.0395
No log	3.2787	200	1.1774	0.2391	1.1774	1.0851
No log	3.3115	202	1.2521	0.2391	1.2521	1.1190
No log	3.3443	204	1.3627	0.2476	1.3627	1.1674
No log	3.3770	206	1.4074	0.2227	1.4074	1.1863
No log	3.4098	208	1.2432	0.2672	1.2432	1.1150
No log	3.4426	210	1.1518	0.3097	1.1518	1.0732
No log	3.4754	212	1.1339	0.2752	1.1339	1.0648
No log	3.5082	214	1.1317	0.2752	1.1317	1.0638
No log	3.5410	216	1.1743	0.3812	1.1743	1.0837
No log	3.5738	218	1.1875	0.3812	1.1875	1.0897
No log	3.6066	220	1.0703	0.3371	1.0703	1.0346
No log	3.6393	222	0.9987	0.3363	0.9987	0.9993
No log	3.6721	224	0.9847	0.3355	0.9847	0.9923
No log	3.7049	226	0.9613	0.2620	0.9613	0.9805
No log	3.7377	228	0.9484	0.4444	0.9484	0.9739
No log	3.7705	230	0.9934	0.4397	0.9934	0.9967
No log	3.8033	232	1.0562	0.3446	1.0562	1.0277
No log	3.8361	234	1.1286	0.2752	1.1286	1.0624
No log	3.8689	236	1.2000	0.3249	1.2000	1.0954
No log	3.9016	238	1.2565	0.2919	1.2565	1.1209
No log	3.9344	240	1.2527	0.2615	1.2527	1.1192
No log	3.9672	242	1.1340	0.2110	1.1340	1.0649
No log	4.0	244	1.1136	0.2950	1.1136	1.0553
No log	4.0328	246	1.1578	0.3359	1.1578	1.0760
No log	4.0656	248	1.1976	0.3037	1.1976	1.0943
No log	4.0984	250	1.2598	0.1323	1.2598	1.1224
No log	4.1311	252	1.4242	0.2052	1.4242	1.1934
No log	4.1639	254	1.5472	0.1203	1.5472	1.2439
No log	4.1967	256	1.3737	0.2145	1.3737	1.1721
No log	4.2295	258	1.1522	0.3287	1.1522	1.0734
No log	4.2623	260	1.0161	0.3180	1.0161	1.0080
No log	4.2951	262	0.9841	0.3720	0.9841	0.9920
No log	4.3279	264	0.9821	0.2440	0.9821	0.9910
No log	4.3607	266	0.9823	0.2401	0.9823	0.9911
No log	4.3934	268	0.9930	0.3720	0.9930	0.9965
No log	4.4262	270	1.0138	0.3897	1.0138	1.0069
No log	4.4590	272	1.0664	0.3013	1.0664	1.0327
No log	4.4918	274	1.0669	0.3013	1.0669	1.0329
No log	4.5246	276	1.0674	0.3473	1.0674	1.0331
No log	4.5574	278	1.0712	0.3573	1.0712	1.0350
No log	4.5902	280	1.0526	0.3125	1.0526	1.0259
No log	4.6230	282	1.0524	0.3190	1.0524	1.0258
No log	4.6557	284	1.0668	0.3421	1.0668	1.0329
No log	4.6885	286	1.0581	0.3949	1.0581	1.0287
No log	4.7213	288	1.0757	0.3359	1.0757	1.0372
No log	4.7541	290	1.0895	0.3017	1.0895	1.0438
No log	4.7869	292	1.1011	0.2952	1.1011	1.0493
No log	4.8197	294	1.1093	0.2390	1.1093	1.0532
No log	4.8525	296	1.1615	0.2804	1.1615	1.0777
No log	4.8852	298	1.1654	0.3151	1.1654	1.0795
No log	4.9180	300	1.1449	0.2703	1.1449	1.0700
No log	4.9508	302	1.1606	0.3129	1.1606	1.0773
No log	4.9836	304	1.1445	0.3109	1.1445	1.0698
No log	5.0164	306	1.1453	0.2385	1.1453	1.0702
No log	5.0492	308	1.1722	0.2777	1.1722	1.0827
No log	5.0820	310	1.2359	0.2779	1.2359	1.1117
No log	5.1148	312	1.3577	0.2688	1.3577	1.1652
No log	5.1475	314	1.3749	0.2688	1.3749	1.1726
No log	5.1803	316	1.2086	0.2373	1.2086	1.0994
No log	5.2131	318	1.0731	0.3766	1.0731	1.0359
No log	5.2459	320	1.0221	0.3601	1.0221	1.0110
No log	5.2787	322	1.0150	0.3818	1.0150	1.0075
No log	5.3115	324	1.0414	0.3741	1.0414	1.0205
No log	5.3443	326	1.0732	0.4042	1.0732	1.0359
No log	5.3770	328	1.0512	0.3947	1.0512	1.0253
No log	5.4098	330	1.1037	0.2964	1.1037	1.0506
No log	5.4426	332	1.1154	0.2657	1.1154	1.0561
No log	5.4754	334	1.0373	0.3947	1.0373	1.0185
No log	5.5082	336	0.9840	0.4676	0.9840	0.9920
No log	5.5410	338	0.9852	0.4738	0.9852	0.9926
No log	5.5738	340	1.0068	0.4294	1.0068	1.0034
No log	5.6066	342	1.0129	0.3829	1.0129	1.0065
No log	5.6393	344	1.0059	0.3771	1.0059	1.0030
No log	5.6721	346	1.0201	0.3880	1.0201	1.0100
No log	5.7049	348	1.0113	0.4009	1.0113	1.0057
No log	5.7377	350	1.0287	0.3701	1.0287	1.0143
No log	5.7705	352	1.0870	0.2565	1.0870	1.0426
No log	5.8033	354	1.1105	0.2611	1.1105	1.0538
No log	5.8361	356	1.0650	0.3218	1.0650	1.0320
No log	5.8689	358	1.0207	0.3286	1.0207	1.0103
No log	5.9016	360	1.0089	0.3482	1.0089	1.0044
No log	5.9344	362	1.0401	0.3624	1.0401	1.0198
No log	5.9672	364	1.0470	0.3624	1.0470	1.0232
No log	6.0	366	1.0328	0.3255	1.0328	1.0163
No log	6.0328	368	1.0556	0.4007	1.0556	1.0274
No log	6.0656	370	1.0957	0.3675	1.0957	1.0467
No log	6.0984	372	1.0945	0.3363	1.0945	1.0462
No log	6.1311	374	1.0339	0.3584	1.0339	1.0168
No log	6.1639	376	0.9981	0.3514	0.9981	0.9990
No log	6.1967	378	0.9828	0.3164	0.9828	0.9914
No log	6.2295	380	0.9805	0.4079	0.9805	0.9902
No log	6.2623	382	0.9852	0.4079	0.9852	0.9926
No log	6.2951	384	0.9827	0.3983	0.9827	0.9913
No log	6.3279	386	0.9954	0.3969	0.9954	0.9977
No log	6.3607	388	1.0184	0.3648	1.0184	1.0092
No log	6.3934	390	1.0468	0.3237	1.0468	1.0231
No log	6.4262	392	1.0237	0.4479	1.0237	1.0118
No log	6.4590	394	1.0214	0.3819	1.0214	1.0107
No log	6.4918	396	1.0327	0.3712	1.0327	1.0162
No log	6.5246	398	1.0183	0.4409	1.0183	1.0091
No log	6.5574	400	1.0440	0.3427	1.0440	1.0218
No log	6.5902	402	1.0580	0.3646	1.0580	1.0286
No log	6.6230	404	1.0198	0.3399	1.0198	1.0098
No log	6.6557	406	1.0137	0.3282	1.0137	1.0068
No log	6.6885	408	1.0218	0.4065	1.0218	1.0109
No log	6.7213	410	1.0060	0.3440	1.0060	1.0030
No log	6.7541	412	1.0158	0.3920	1.0158	1.0078
No log	6.7869	414	1.0886	0.2760	1.0886	1.0434
No log	6.8197	416	1.0991	0.2560	1.0991	1.0484
No log	6.8525	418	1.0562	0.3294	1.0562	1.0277
No log	6.8852	420	1.0520	0.3908	1.0520	1.0256
No log	6.9180	422	1.0638	0.3084	1.0638	1.0314
No log	6.9508	424	1.0803	0.3040	1.0803	1.0394
No log	6.9836	426	1.0837	0.3509	1.0837	1.0410
No log	7.0164	428	1.0835	0.2723	1.0835	1.0409
No log	7.0492	430	1.1013	0.3099	1.1013	1.0494
No log	7.0820	432	1.1598	0.2788	1.1598	1.0769
No log	7.1148	434	1.1509	0.2470	1.1509	1.0728
No log	7.1475	436	1.1444	0.3094	1.1444	1.0698
No log	7.1803	438	1.1356	0.3313	1.1356	1.0656
No log	7.2131	440	1.1698	0.3114	1.1698	1.0816
No log	7.2459	442	1.2203	0.2740	1.2203	1.1047
No log	7.2787	444	1.2629	0.2387	1.2629	1.1238
No log	7.3115	446	1.2150	0.2462	1.2150	1.1023
No log	7.3443	448	1.1574	0.3146	1.1574	1.0758
No log	7.3770	450	1.1302	0.3514	1.1302	1.0631
No log	7.4098	452	1.0972	0.3176	1.0972	1.0475
No log	7.4426	454	1.0873	0.2898	1.0873	1.0427
No log	7.4754	456	1.0994	0.3243	1.0994	1.0485
No log	7.5082	458	1.1247	0.3103	1.1247	1.0605
No log	7.5410	460	1.1271	0.3103	1.1271	1.0616
No log	7.5738	462	1.1542	0.2759	1.1542	1.0744
No log	7.6066	464	1.1931	0.2418	1.1931	1.0923
No log	7.6393	466	1.1554	0.2293	1.1554	1.0749
No log	7.6721	468	1.0837	0.2785	1.0837	1.0410
No log	7.7049	470	1.0585	0.3590	1.0585	1.0288
No log	7.7377	472	1.0736	0.3464	1.0736	1.0362
No log	7.7705	474	1.0751	0.4031	1.0751	1.0369
No log	7.8033	476	1.0577	0.3464	1.0577	1.0284
No log	7.8361	478	1.0297	0.3134	1.0297	1.0147
No log	7.8689	480	1.0511	0.2804	1.0511	1.0252
No log	7.9016	482	1.0683	0.2712	1.0683	1.0336
No log	7.9344	484	1.0762	0.2529	1.0762	1.0374
No log	7.9672	486	1.1219	0.2478	1.1219	1.0592
No log	8.0	488	1.1120	0.2431	1.1120	1.0545
No log	8.0328	490	1.0700	0.2785	1.0700	1.0344
No log	8.0656	492	1.0643	0.3205	1.0643	1.0316
No log	8.0984	494	1.0756	0.3677	1.0756	1.0371
No log	8.1311	496	1.0741	0.3677	1.0741	1.0364
No log	8.1639	498	1.0621	0.3677	1.0621	1.0306
0.3076	8.1967	500	1.0437	0.3496	1.0437	1.0216
0.3076	8.2295	502	1.0892	0.2727	1.0892	1.0436
0.3076	8.2623	504	1.1333	0.3260	1.1333	1.0646
0.3076	8.2951	506	1.1025	0.3519	1.1025	1.0500
0.3076	8.3279	508	1.0836	0.2786	1.0836	1.0409
0.3076	8.3607	510	1.0699	0.4002	1.0699	1.0343
0.3076	8.3934	512	1.0698	0.4065	1.0698	1.0343
0.3076	8.4262	514	1.0703	0.3478	1.0703	1.0346
0.3076	8.4590	516	1.0773	0.3535	1.0773	1.0379
0.3076	8.4918	518	1.0839	0.3811	1.0839	1.0411
0.3076	8.5246	520	1.1219	0.2839	1.1219	1.0592
0.3076	8.5574	522	1.2015	0.2755	1.2015	1.0961
0.3076	8.5902	524	1.1816	0.2424	1.1816	1.0870
0.3076	8.6230	526	1.1619	0.2198	1.1619	1.0779
0.3076	8.6557	528	1.1043	0.3200	1.1043	1.0509

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1