ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k5_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.4459
• Qwk: 0.4928
• Mse: 1.4459
• Rmse: 1.2025

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	6.6944	0.0308	6.6944	2.5874
No log	0.1818	4	4.3989	0.1074	4.3989	2.0974
No log	0.2727	6	3.5543	0.0	3.5543	1.8853
No log	0.3636	8	3.3023	0.0230	3.3023	1.8172
No log	0.4545	10	3.2030	0.0778	3.2030	1.7897
No log	0.5455	12	2.2102	0.1517	2.2102	1.4867
No log	0.6364	14	2.3579	-0.0270	2.3579	1.5355
No log	0.7273	16	2.4630	-0.0411	2.4630	1.5694
No log	0.8182	18	2.3063	0.0	2.3063	1.5186
No log	0.9091	20	1.8667	0.2689	1.8667	1.3663
No log	1.0	22	1.5093	0.2243	1.5093	1.2285
No log	1.0909	24	1.4432	0.2407	1.4432	1.2013
No log	1.1818	26	1.4405	0.1905	1.4405	1.2002
No log	1.2727	28	1.6112	0.3419	1.6112	1.2693
No log	1.3636	30	1.7087	0.3438	1.7087	1.3072
No log	1.4545	32	1.6356	0.3577	1.6356	1.2789
No log	1.5455	34	1.5637	0.3590	1.5637	1.2505
No log	1.6364	36	1.5447	0.3652	1.5447	1.2429
No log	1.7273	38	1.5694	0.3621	1.5694	1.2527
No log	1.8182	40	2.0177	0.2286	2.0177	1.4205
No log	1.9091	42	2.2462	0.1389	2.2462	1.4987
No log	2.0	44	1.9031	0.3556	1.9031	1.3795
No log	2.0909	46	1.5366	0.3509	1.5366	1.2396
No log	2.1818	48	1.4825	0.2056	1.4825	1.2176
No log	2.2727	50	1.5832	0.3571	1.5832	1.2582
No log	2.3636	52	1.6747	0.4034	1.6747	1.2941
No log	2.4545	54	1.6914	0.4320	1.6914	1.3005
No log	2.5455	56	1.5720	0.3509	1.5720	1.2538
No log	2.6364	58	1.6941	0.4333	1.6941	1.3016
No log	2.7273	60	1.7770	0.4286	1.7770	1.3331
No log	2.8182	62	2.0386	0.2429	2.0386	1.4278
No log	2.9091	64	2.0031	0.2429	2.0031	1.4153
No log	3.0	66	1.8406	0.3382	1.8406	1.3567
No log	3.0909	68	1.4361	0.3871	1.4361	1.1984
No log	3.1818	70	1.2778	0.3333	1.2778	1.1304
No log	3.2727	72	1.2611	0.3478	1.2611	1.1230
No log	3.3636	74	1.4759	0.3279	1.4759	1.2149
No log	3.4545	76	1.7472	0.3088	1.7472	1.3218
No log	3.5455	78	1.5248	0.3566	1.5248	1.2348
No log	3.6364	80	1.2217	0.3866	1.2217	1.1053
No log	3.7273	82	1.2348	0.3559	1.2348	1.1112
No log	3.8182	84	1.4165	0.3802	1.4165	1.1901
No log	3.9091	86	1.6164	0.3252	1.6164	1.2714
No log	4.0	88	1.2544	0.3729	1.2544	1.1200
No log	4.0909	90	1.0909	0.5574	1.0909	1.0445
No log	4.1818	92	1.1862	0.5669	1.1862	1.0891
No log	4.2727	94	1.2350	0.5469	1.2350	1.1113
No log	4.3636	96	1.1685	0.5714	1.1685	1.0810
No log	4.4545	98	1.0530	0.625	1.0530	1.0262
No log	4.5455	100	1.0473	0.5203	1.0473	1.0234
No log	4.6364	102	1.0884	0.5041	1.0884	1.0432
No log	4.7273	104	1.1013	0.5645	1.1013	1.0494
No log	4.8182	106	1.1541	0.544	1.1541	1.0743
No log	4.9091	108	1.1621	0.5556	1.1621	1.0780
No log	5.0	110	1.2741	0.4848	1.2741	1.1288
No log	5.0909	112	1.2131	0.4806	1.2131	1.1014
No log	5.1818	114	1.1349	0.4921	1.1349	1.0653
No log	5.2727	116	1.3868	0.4545	1.3868	1.1776
No log	5.3636	118	1.5029	0.3788	1.5029	1.2259
No log	5.4545	120	1.3863	0.5231	1.3863	1.1774
No log	5.5455	122	1.3110	0.4754	1.3110	1.1450
No log	5.6364	124	1.3255	0.2342	1.3255	1.1513
No log	5.7273	126	1.3586	0.2735	1.3586	1.1656
No log	5.8182	128	1.2766	0.2679	1.2766	1.1299
No log	5.9091	130	1.2161	0.4715	1.2161	1.1028
No log	6.0	132	1.1239	0.544	1.1239	1.0601
No log	6.0909	134	1.0819	0.544	1.0819	1.0401
No log	6.1818	136	1.0795	0.5246	1.0795	1.0390
No log	6.2727	138	1.2697	0.4496	1.2697	1.1268
No log	6.3636	140	1.2350	0.4651	1.2350	1.1113
No log	6.4545	142	1.0681	0.5920	1.0681	1.0335
No log	6.5455	144	1.0749	0.5538	1.0749	1.0368
No log	6.6364	146	1.2324	0.5	1.2324	1.1102
No log	6.7273	148	1.2049	0.5522	1.2049	1.0977
No log	6.8182	150	1.2314	0.5522	1.2314	1.1097
No log	6.9091	152	1.2851	0.5333	1.2851	1.1336
No log	7.0	154	1.3086	0.5113	1.3086	1.1439
No log	7.0909	156	1.2015	0.5564	1.2015	1.0961
No log	7.1818	158	1.0828	0.6047	1.0828	1.0406
No log	7.2727	160	1.0626	0.5938	1.0626	1.0308
No log	7.3636	162	1.1472	0.5271	1.1472	1.0711
No log	7.4545	164	1.1854	0.5191	1.1854	1.0888
No log	7.5455	166	1.0412	0.6094	1.0412	1.0204
No log	7.6364	168	0.8889	0.5512	0.8889	0.9428
No log	7.7273	170	0.8689	0.6418	0.8689	0.9322
No log	7.8182	172	0.8452	0.6154	0.8452	0.9193
No log	7.9091	174	0.9799	0.5802	0.9799	0.9899
No log	8.0	176	1.2362	0.5038	1.2362	1.1119
No log	8.0909	178	1.2014	0.5077	1.2014	1.0961
No log	8.1818	180	1.0222	0.5692	1.0222	1.0111
No log	8.2727	182	0.8645	0.5760	0.8645	0.9298
No log	8.3636	184	0.8679	0.6457	0.8679	0.9316
No log	8.4545	186	0.9333	0.5691	0.9333	0.9661
No log	8.5455	188	1.1434	0.5469	1.1434	1.0693
No log	8.6364	190	1.4762	0.4545	1.4762	1.2150
No log	8.7273	192	1.6066	0.3597	1.6066	1.2675
No log	8.8182	194	1.5170	0.4058	1.5170	1.2317
No log	8.9091	196	1.3415	0.5	1.3415	1.1582
No log	9.0	198	1.3555	0.4812	1.3555	1.1643
No log	9.0909	200	1.5289	0.3913	1.5289	1.2365
No log	9.1818	202	1.7620	0.2695	1.7620	1.3274
No log	9.2727	204	1.7785	0.3121	1.7785	1.3336
No log	9.3636	206	1.5902	0.3597	1.5902	1.2610
No log	9.4545	208	1.2586	0.528	1.2586	1.1219
No log	9.5455	210	1.0631	0.6032	1.0631	1.0311
No log	9.6364	212	1.0807	0.5854	1.0807	1.0396
No log	9.7273	214	1.2966	0.4103	1.2966	1.1387
No log	9.8182	216	1.2548	0.4839	1.2548	1.1202
No log	9.9091	218	1.0792	0.56	1.0792	1.0389
No log	10.0	220	1.0316	0.4874	1.0316	1.0157
No log	10.0909	222	1.0626	0.4915	1.0626	1.0308
No log	10.1818	224	1.0787	0.5	1.0787	1.0386
No log	10.2727	226	1.2502	0.5271	1.2502	1.1181
No log	10.3636	228	1.3556	0.4627	1.3556	1.1643
No log	10.4545	230	1.3126	0.4925	1.3126	1.1457
No log	10.5455	232	1.2704	0.5344	1.2704	1.1271
No log	10.6364	234	1.2393	0.5344	1.2393	1.1132
No log	10.7273	236	1.1494	0.5625	1.1494	1.0721
No log	10.8182	238	1.0997	0.5366	1.0997	1.0487
No log	10.9091	240	1.1052	0.5410	1.1052	1.0513
No log	11.0	242	1.1534	0.5625	1.1534	1.0740
No log	11.0909	244	1.1752	0.5354	1.1752	1.0841
No log	11.1818	246	1.1332	0.5625	1.1332	1.0645
No log	11.2727	248	1.1437	0.5802	1.1437	1.0694
No log	11.3636	250	1.1161	0.5758	1.1161	1.0564
No log	11.4545	252	1.1323	0.5714	1.1323	1.0641
No log	11.5455	254	1.2092	0.5522	1.2092	1.0997
No log	11.6364	256	1.2979	0.5224	1.2979	1.1392
No log	11.7273	258	1.2599	0.5606	1.2599	1.1224
No log	11.8182	260	1.1007	0.6047	1.1007	1.0492
No log	11.9091	262	1.0426	0.5920	1.0426	1.0211
No log	12.0	264	1.0492	0.5806	1.0492	1.0243
No log	12.0909	266	1.0814	0.5938	1.0814	1.0399
No log	12.1818	268	1.1873	0.5714	1.1873	1.0897
No log	12.2727	270	1.3101	0.5414	1.3101	1.1446
No log	12.3636	272	1.3390	0.5294	1.3390	1.1571
No log	12.4545	274	1.2588	0.5373	1.2588	1.1220
No log	12.5455	276	1.2455	0.5441	1.2455	1.1160
No log	12.6364	278	1.1491	0.5414	1.1491	1.0720
No log	12.7273	280	1.1375	0.5821	1.1375	1.0665
No log	12.8182	282	1.2592	0.5441	1.2592	1.1221
No log	12.9091	284	1.4823	0.3916	1.4823	1.2175
No log	13.0	286	1.4922	0.4348	1.4922	1.2216
No log	13.0909	288	1.4849	0.4348	1.4849	1.2185
No log	13.1818	290	1.3437	0.5152	1.3437	1.1592
No log	13.2727	292	1.2307	0.5802	1.2307	1.1094
No log	13.3636	294	1.1324	0.6047	1.1324	1.0642
No log	13.4545	296	1.1774	0.5625	1.1774	1.0851
No log	13.5455	298	1.3675	0.5037	1.3675	1.1694
No log	13.6364	300	1.5971	0.4058	1.5971	1.2637
No log	13.7273	302	1.5843	0.4296	1.5843	1.2587
No log	13.8182	304	1.4719	0.4559	1.4719	1.2132
No log	13.9091	306	1.4771	0.4559	1.4771	1.2154
No log	14.0	308	1.4060	0.4741	1.4060	1.1858
No log	14.0909	310	1.5400	0.4058	1.5400	1.2410
No log	14.1818	312	1.5288	0.4113	1.5288	1.2364
No log	14.2727	314	1.3360	0.5	1.3360	1.1558
No log	14.3636	316	1.2116	0.5333	1.2116	1.1007
No log	14.4545	318	1.1950	0.5564	1.1950	1.0932
No log	14.5455	320	1.2072	0.5414	1.2072	1.0987
No log	14.6364	322	1.3058	0.5	1.3058	1.1427
No log	14.7273	324	1.4757	0.4604	1.4757	1.2148
No log	14.8182	326	1.4916	0.4380	1.4916	1.2213
No log	14.9091	328	1.3495	0.4818	1.3495	1.1617
No log	15.0	330	1.1963	0.5385	1.1963	1.0937
No log	15.0909	332	1.1146	0.5781	1.1146	1.0557
No log	15.1818	334	1.1249	0.5760	1.1249	1.0606
No log	15.2727	336	1.1262	0.5760	1.1262	1.0612
No log	15.3636	338	1.0998	0.5760	1.0998	1.0487
No log	15.4545	340	1.0774	0.5920	1.0774	1.0380
No log	15.5455	342	1.1713	0.5984	1.1713	1.0823
No log	15.6364	344	1.3198	0.4962	1.3198	1.1488
No log	15.7273	346	1.3959	0.4741	1.3959	1.1815
No log	15.8182	348	1.3528	0.4853	1.3528	1.1631
No log	15.9091	350	1.3031	0.5109	1.3031	1.1415
No log	16.0	352	1.1807	0.5294	1.1807	1.0866
No log	16.0909	354	1.1638	0.5294	1.1638	1.0788
No log	16.1818	356	1.2586	0.5255	1.2586	1.1219
No log	16.2727	358	1.3298	0.5109	1.3298	1.1532
No log	16.3636	360	1.3405	0.5185	1.3405	1.1578
No log	16.4545	362	1.3148	0.5414	1.3148	1.1466
No log	16.5455	364	1.2225	0.5846	1.2225	1.1057
No log	16.6364	366	1.2551	0.5397	1.2551	1.1203
No log	16.7273	368	1.3064	0.5581	1.3064	1.1430
No log	16.8182	370	1.2694	0.5736	1.2694	1.1267
No log	16.9091	372	1.3017	0.5455	1.3017	1.1409
No log	17.0	374	1.3239	0.5152	1.3239	1.1506
No log	17.0909	376	1.2936	0.5075	1.2936	1.1374
No log	17.1818	378	1.2098	0.5758	1.2098	1.0999
No log	17.2727	380	1.1865	0.5649	1.1865	1.0892
No log	17.3636	382	1.1688	0.5649	1.1688	1.0811
No log	17.4545	384	1.2160	0.5649	1.2160	1.1027
No log	17.5455	386	1.3844	0.4818	1.3844	1.1766
No log	17.6364	388	1.4489	0.4380	1.4489	1.2037
No log	17.7273	390	1.3901	0.4818	1.3901	1.1790
No log	17.8182	392	1.3137	0.5147	1.3137	1.1462
No log	17.9091	394	1.3600	0.5	1.3600	1.1662
No log	18.0	396	1.4179	0.4380	1.4179	1.1908
No log	18.0909	398	1.4830	0.4118	1.4830	1.2178
No log	18.1818	400	1.4860	0.4662	1.4860	1.2190
No log	18.2727	402	1.4051	0.4885	1.4051	1.1854
No log	18.3636	404	1.3130	0.5312	1.3130	1.1459
No log	18.4545	406	1.2290	0.5692	1.2290	1.1086
No log	18.5455	408	1.2603	0.5496	1.2603	1.1226
No log	18.6364	410	1.3467	0.4925	1.3467	1.1605
No log	18.7273	412	1.3769	0.4925	1.3769	1.1734
No log	18.8182	414	1.2567	0.5496	1.2567	1.1210
No log	18.9091	416	1.1686	0.5606	1.1686	1.0810
No log	19.0	418	1.1253	0.5758	1.1253	1.0608
No log	19.0909	420	1.1205	0.5846	1.1205	1.0585
No log	19.1818	422	1.2026	0.5606	1.2026	1.0967
No log	19.2727	424	1.3184	0.5496	1.3184	1.1482
No log	19.3636	426	1.4122	0.5038	1.4122	1.1884
No log	19.4545	428	1.3766	0.5231	1.3766	1.1733
No log	19.5455	430	1.2589	0.5496	1.2589	1.1220
No log	19.6364	432	1.1246	0.5649	1.1246	1.0605
No log	19.7273	434	1.0664	0.5891	1.0664	1.0327
No log	19.8182	436	1.1128	0.5781	1.1128	1.0549
No log	19.9091	438	1.1955	0.5538	1.1955	1.0934
No log	20.0	440	1.3029	0.5564	1.3029	1.1414
No log	20.0909	442	1.3311	0.5522	1.3311	1.1537
No log	20.1818	444	1.2928	0.5630	1.2928	1.1370
No log	20.2727	446	1.2881	0.5588	1.2881	1.1349
No log	20.3636	448	1.3135	0.5588	1.3135	1.1461
No log	20.4545	450	1.4456	0.4638	1.4456	1.2023
No log	20.5455	452	1.5061	0.4088	1.5061	1.2272
No log	20.6364	454	1.4593	0.4296	1.4593	1.2080
No log	20.7273	456	1.3898	0.4662	1.3898	1.1789
No log	20.8182	458	1.3665	0.4962	1.3665	1.1690
No log	20.9091	460	1.2574	0.5758	1.2574	1.1213
No log	21.0	462	1.1946	0.5846	1.1946	1.0930
No log	21.0909	464	1.2137	0.5802	1.2137	1.1017
No log	21.1818	466	1.1918	0.5802	1.1918	1.0917
No log	21.2727	468	1.2288	0.5564	1.2288	1.1085
No log	21.3636	470	1.2474	0.5522	1.2474	1.1169
No log	21.4545	472	1.2851	0.5	1.2851	1.1336
No log	21.5455	474	1.3672	0.4848	1.3672	1.1693
No log	21.6364	476	1.5004	0.3704	1.5004	1.2249
No log	21.7273	478	1.4678	0.4211	1.4678	1.2115
No log	21.8182	480	1.3377	0.5	1.3377	1.1566
No log	21.9091	482	1.2228	0.5556	1.2228	1.1058
No log	22.0	484	1.1964	0.5781	1.1964	1.0938
No log	22.0909	486	1.2587	0.5538	1.2587	1.1219
No log	22.1818	488	1.3294	0.4776	1.3294	1.1530
No log	22.2727	490	1.2927	0.5373	1.2927	1.1370
No log	22.3636	492	1.1977	0.5581	1.1977	1.0944
No log	22.4545	494	1.1868	0.5581	1.1868	1.0894
No log	22.5455	496	1.2908	0.5333	1.2908	1.1361
No log	22.6364	498	1.2755	0.5333	1.2755	1.1294
0.4372	22.7273	500	1.2479	0.5224	1.2479	1.1171
0.4372	22.8182	502	1.1773	0.5414	1.1773	1.0850
0.4372	22.9091	504	1.1747	0.5303	1.1747	1.0838
0.4372	23.0	506	1.1688	0.5581	1.1688	1.0811
0.4372	23.0909	508	1.2374	0.5303	1.2374	1.1124
0.4372	23.1818	510	1.3485	0.5075	1.3485	1.1612
0.4372	23.2727	512	1.3611	0.4812	1.3611	1.1667
0.4372	23.3636	514	1.2690	0.5373	1.2690	1.1265
0.4372	23.4545	516	1.1745	0.5581	1.1745	1.0837
0.4372	23.5455	518	1.1886	0.5581	1.1886	1.0902
0.4372	23.6364	520	1.1865	0.5581	1.1865	1.0892
0.4372	23.7273	522	1.2270	0.5231	1.2270	1.1077
0.4372	23.8182	524	1.2588	0.5	1.2588	1.1219
0.4372	23.9091	526	1.2543	0.5303	1.2543	1.1199
0.4372	24.0	528	1.2040	0.5469	1.2040	1.0973
0.4372	24.0909	530	1.1897	0.5469	1.1897	1.0907
0.4372	24.1818	532	1.2742	0.5263	1.2742	1.1288
0.4372	24.2727	534	1.2917	0.5263	1.2917	1.1365
0.4372	24.3636	536	1.2673	0.5303	1.2673	1.1258
0.4372	24.4545	538	1.2512	0.5496	1.2512	1.1186
0.4372	24.5455	540	1.2425	0.5496	1.2425	1.1147
0.4372	24.6364	542	1.1992	0.5538	1.1992	1.0951
0.4372	24.7273	544	1.2353	0.5496	1.2353	1.1114
0.4372	24.8182	546	1.1803	0.5581	1.1803	1.0864
0.4372	24.9091	548	1.1834	0.5538	1.1834	1.0879
0.4372	25.0	550	1.1768	0.5303	1.1768	1.0848
0.4372	25.0909	552	1.2020	0.5303	1.2020	1.0963
0.4372	25.1818	554	1.1802	0.5496	1.1802	1.0864
0.4372	25.2727	556	1.1780	0.5469	1.1780	1.0853
0.4372	25.3636	558	1.1848	0.5469	1.1848	1.0885
0.4372	25.4545	560	1.1782	0.5581	1.1782	1.0854
0.4372	25.5455	562	1.2549	0.5455	1.2549	1.1202
0.4372	25.6364	564	1.2748	0.5455	1.2748	1.1291
0.4372	25.7273	566	1.2153	0.5455	1.2153	1.1024
0.4372	25.8182	568	1.1683	0.5496	1.1683	1.0809
0.4372	25.9091	570	1.2356	0.5455	1.2356	1.1116
0.4372	26.0	572	1.2925	0.5455	1.2925	1.1369
0.4372	26.0909	574	1.3570	0.5152	1.3570	1.1649
0.4372	26.1818	576	1.2853	0.5455	1.2853	1.1337
0.4372	26.2727	578	1.1722	0.5469	1.1722	1.0827
0.4372	26.3636	580	1.0704	0.5760	1.0704	1.0346
0.4372	26.4545	582	1.0398	0.5873	1.0398	1.0197
0.4372	26.5455	584	1.0965	0.5649	1.0965	1.0471
0.4372	26.6364	586	1.2910	0.5522	1.2910	1.1362
0.4372	26.7273	588	1.6336	0.3611	1.6336	1.2781
0.4372	26.8182	590	1.8004	0.3514	1.8004	1.3418
0.4372	26.9091	592	1.6533	0.3662	1.6533	1.2858
0.4372	27.0	594	1.5029	0.4604	1.5029	1.2259
0.4372	27.0909	596	1.4459	0.4928	1.4459	1.2025

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1