ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k5_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.5840
• Qwk: 0.3459
• Mse: 1.5840
• Rmse: 1.2586

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0909	2	6.8706	0.0242	6.8706	2.6212
No log	0.1818	4	4.5537	0.12	4.5537	2.1339
No log	0.2727	6	4.4912	-0.0648	4.4912	2.1192
No log	0.3636	8	5.3606	-0.0803	5.3606	2.3153
No log	0.4545	10	3.8817	-0.0804	3.8817	1.9702
No log	0.5455	12	2.3578	0.1194	2.3578	1.5355
No log	0.6364	14	1.8213	0.2342	1.8213	1.3495
No log	0.7273	16	1.8044	0.1714	1.8044	1.3433
No log	0.8182	18	2.0548	0.1579	2.0548	1.4334
No log	0.9091	20	2.2141	0.0	2.2141	1.4880
No log	1.0	22	2.3652	0.0292	2.3652	1.5379
No log	1.0909	24	2.2941	0.0146	2.2941	1.5146
No log	1.1818	26	2.2398	0.0435	2.2398	1.4966
No log	1.2727	28	1.8855	0.2759	1.8855	1.3731
No log	1.3636	30	1.6558	0.2056	1.6558	1.2868
No log	1.4545	32	1.5973	0.2056	1.5973	1.2639
No log	1.5455	34	1.5514	0.1869	1.5514	1.2455
No log	1.6364	36	1.5700	0.2342	1.5700	1.2530
No log	1.7273	38	1.7613	0.3607	1.7613	1.3272
No log	1.8182	40	1.9252	0.2923	1.9252	1.3875
No log	1.9091	42	1.8372	0.2923	1.8372	1.3554
No log	2.0	44	1.7235	0.3548	1.7235	1.3128
No log	2.0909	46	1.5153	0.2143	1.5153	1.2310
No log	2.1818	48	1.5024	0.0971	1.5024	1.2257
No log	2.2727	50	1.5660	0.1698	1.5660	1.2514
No log	2.3636	52	1.4505	0.3063	1.4505	1.2044
No log	2.4545	54	1.3445	0.3866	1.3445	1.1595
No log	2.5455	56	1.5586	0.4394	1.5586	1.2484
No log	2.6364	58	1.5318	0.4930	1.5318	1.2376
No log	2.7273	60	1.2694	0.496	1.2694	1.1267
No log	2.8182	62	1.3984	0.3103	1.3984	1.1826
No log	2.9091	64	1.8260	0.2261	1.8260	1.3513
No log	3.0	66	1.7139	0.2982	1.7139	1.3092
No log	3.0909	68	1.3967	0.3932	1.3967	1.1818
No log	3.1818	70	1.1238	0.4667	1.1238	1.0601
No log	3.2727	72	1.0528	0.4706	1.0528	1.0261
No log	3.3636	74	1.0872	0.4706	1.0872	1.0427
No log	3.4545	76	1.1764	0.4724	1.1764	1.0846
No log	3.5455	78	1.3521	0.4444	1.3521	1.1628
No log	3.6364	80	1.8338	0.1571	1.8338	1.3542
No log	3.7273	82	2.1613	0.1022	2.1613	1.4701
No log	3.8182	84	2.2225	0.0	2.2225	1.4908
No log	3.9091	86	2.1272	0.0763	2.1272	1.4585
No log	4.0	88	1.9312	0.2482	1.9312	1.3897
No log	4.0909	90	1.9328	0.2482	1.9328	1.3902
No log	4.1818	92	1.9758	0.2590	1.9758	1.4056
No log	4.2727	94	1.8551	0.3022	1.8551	1.3620
No log	4.3636	96	1.6201	0.2836	1.6201	1.2728
No log	4.4545	98	1.5038	0.3259	1.5038	1.2263
No log	4.5455	100	1.5352	0.4030	1.5352	1.2390
No log	4.6364	102	1.7073	0.3212	1.7073	1.3066
No log	4.7273	104	1.6467	0.3759	1.6467	1.2832
No log	4.8182	106	1.6483	0.3594	1.6483	1.2838
No log	4.9091	108	1.6225	0.3407	1.6225	1.2738
No log	5.0	110	1.6973	0.3212	1.6973	1.3028
No log	5.0909	112	1.6400	0.3212	1.6400	1.2806
No log	5.1818	114	1.5024	0.2985	1.5024	1.2257
No log	5.2727	116	1.4355	0.3939	1.4355	1.1981
No log	5.3636	118	1.4879	0.3158	1.4879	1.2198
No log	5.4545	120	1.4161	0.4211	1.4161	1.1900
No log	5.5455	122	1.3863	0.4211	1.3863	1.1774
No log	5.6364	124	1.4558	0.3704	1.4558	1.2066
No log	5.7273	126	1.4664	0.3942	1.4664	1.2109
No log	5.8182	128	1.3583	0.4818	1.3583	1.1655
No log	5.9091	130	1.4895	0.4234	1.4895	1.2204
No log	6.0	132	1.7681	0.3000	1.7681	1.3297
No log	6.0909	134	1.7664	0.2695	1.7664	1.3291
No log	6.1818	136	1.5607	0.4088	1.5607	1.2493
No log	6.2727	138	1.3862	0.4651	1.3862	1.1774
No log	6.3636	140	1.4199	0.4186	1.4199	1.1916
No log	6.4545	142	1.5884	0.3308	1.5884	1.2603
No log	6.5455	144	1.6536	0.3913	1.6536	1.2859
No log	6.6364	146	1.7013	0.3597	1.7013	1.3044
No log	6.7273	148	1.7384	0.3453	1.7384	1.3185
No log	6.8182	150	1.7644	0.3453	1.7644	1.3283
No log	6.9091	152	1.8095	0.2878	1.8095	1.3452
No log	7.0	154	1.8180	0.2878	1.8180	1.3483
No log	7.0909	156	1.5243	0.3704	1.5243	1.2346
No log	7.1818	158	1.4358	0.3969	1.4358	1.1983
No log	7.2727	160	1.4661	0.3407	1.4661	1.2108
No log	7.3636	162	1.7613	0.2571	1.7613	1.3271
No log	7.4545	164	2.0139	0.2270	2.0139	1.4191
No log	7.5455	166	2.1845	0.1418	2.1845	1.4780
No log	7.6364	168	1.9770	0.2174	1.9770	1.4061
No log	7.7273	170	1.6052	0.3731	1.6052	1.2670
No log	7.8182	172	1.4131	0.4275	1.4131	1.1888
No log	7.9091	174	1.4421	0.3881	1.4421	1.2009
No log	8.0	176	1.6931	0.3407	1.6931	1.3012
No log	8.0909	178	1.7649	0.2899	1.7649	1.3285
No log	8.1818	180	1.5767	0.3407	1.5767	1.2557
No log	8.2727	182	1.4026	0.4394	1.4026	1.1843
No log	8.3636	184	1.4598	0.4296	1.4598	1.2082
No log	8.4545	186	1.4396	0.4559	1.4396	1.1998
No log	8.5455	188	1.6514	0.3212	1.6514	1.2851
No log	8.6364	190	1.7398	0.3212	1.7398	1.3190
No log	8.7273	192	1.5474	0.3942	1.5474	1.2440
No log	8.8182	194	1.4336	0.4179	1.4336	1.1973
No log	8.9091	196	1.4346	0.4091	1.4346	1.1978
No log	9.0	198	1.5731	0.3582	1.5731	1.2542
No log	9.0909	200	1.4968	0.3582	1.4968	1.2234
No log	9.1818	202	1.3101	0.5077	1.3101	1.1446
No log	9.2727	204	1.2901	0.5116	1.2901	1.1358
No log	9.3636	206	1.2367	0.5000	1.2367	1.1121
No log	9.4545	208	1.1997	0.5041	1.1997	1.0953
No log	9.5455	210	1.2436	0.528	1.2436	1.1152
No log	9.6364	212	1.4268	0.4308	1.4268	1.1945
No log	9.7273	214	1.5813	0.3582	1.5813	1.2575
No log	9.8182	216	1.5420	0.3969	1.5420	1.2418
No log	9.9091	218	1.4934	0.4531	1.4934	1.2221
No log	10.0	220	1.4864	0.4341	1.4864	1.2192
No log	10.0909	222	1.5623	0.3881	1.5623	1.2499
No log	10.1818	224	1.5122	0.4394	1.5122	1.2297
No log	10.2727	226	1.4307	0.5039	1.4307	1.1961
No log	10.3636	228	1.4624	0.4806	1.4624	1.2093
No log	10.4545	230	1.5415	0.3939	1.5415	1.2416
No log	10.5455	232	1.6682	0.3556	1.6682	1.2916
No log	10.6364	234	1.6007	0.3939	1.6007	1.2652
No log	10.7273	236	1.4173	0.4375	1.4173	1.1905
No log	10.8182	238	1.2418	0.4628	1.2418	1.1144
No log	10.9091	240	1.1790	0.4833	1.1790	1.0858
No log	11.0	242	1.2143	0.5156	1.2143	1.1020
No log	11.0909	244	1.3290	0.4962	1.3290	1.1528
No log	11.1818	246	1.4388	0.4296	1.4388	1.1995
No log	11.2727	248	1.5572	0.3212	1.5572	1.2479
No log	11.3636	250	1.4754	0.3759	1.4754	1.2147
No log	11.4545	252	1.3411	0.5426	1.3411	1.1581
No log	11.5455	254	1.3390	0.5625	1.3390	1.1571
No log	11.6364	256	1.4012	0.4885	1.4012	1.1837
No log	11.7273	258	1.4428	0.4478	1.4428	1.2012
No log	11.8182	260	1.3370	0.5152	1.3370	1.1563
No log	11.9091	262	1.2423	0.5625	1.2423	1.1146
No log	12.0	264	1.2537	0.5649	1.2537	1.1197
No log	12.0909	266	1.3821	0.5075	1.3821	1.1756
No log	12.1818	268	1.6418	0.3022	1.6418	1.2813
No log	12.2727	270	1.7039	0.3022	1.7039	1.3053
No log	12.3636	272	1.5771	0.3676	1.5771	1.2558
No log	12.4545	274	1.5311	0.4060	1.5311	1.2374
No log	12.5455	276	1.4889	0.4580	1.4889	1.2202
No log	12.6364	278	1.5068	0.4275	1.5068	1.2275
No log	12.7273	280	1.5146	0.4328	1.5146	1.2307
No log	12.8182	282	1.5921	0.3623	1.5921	1.2618
No log	12.9091	284	1.5620	0.3885	1.5620	1.2498
No log	13.0	286	1.4116	0.4593	1.4116	1.1881
No log	13.0909	288	1.3806	0.4962	1.3806	1.1750
No log	13.1818	290	1.3804	0.4615	1.3804	1.1749
No log	13.2727	292	1.3286	0.528	1.3286	1.1527
No log	13.3636	294	1.3524	0.5	1.3524	1.1629
No log	13.4545	296	1.4617	0.4462	1.4617	1.2090
No log	13.5455	298	1.6156	0.3433	1.6156	1.2711
No log	13.6364	300	1.5963	0.3433	1.5963	1.2635
No log	13.7273	302	1.6456	0.3407	1.6456	1.2828
No log	13.8182	304	1.5998	0.3433	1.5998	1.2648
No log	13.9091	306	1.6562	0.3407	1.6562	1.2870
No log	14.0	308	1.6529	0.3433	1.6529	1.2857
No log	14.0909	310	1.5907	0.3759	1.5907	1.2612
No log	14.1818	312	1.5256	0.3910	1.5256	1.2352
No log	14.2727	314	1.5206	0.4030	1.5206	1.2331
No log	14.3636	316	1.5911	0.3796	1.5911	1.2614
No log	14.4545	318	1.6345	0.3121	1.6345	1.2785
No log	14.5455	320	1.7117	0.3121	1.7117	1.3083
No log	14.6364	322	1.6836	0.3121	1.6836	1.2975
No log	14.7273	324	1.5810	0.3121	1.5810	1.2574
No log	14.8182	326	1.4354	0.4148	1.4354	1.1981
No log	14.9091	328	1.3537	0.5079	1.3537	1.1635
No log	15.0	330	1.4004	0.4885	1.4004	1.1834
No log	15.0909	332	1.5020	0.4060	1.5020	1.2256
No log	15.1818	334	1.5804	0.3650	1.5804	1.2572
No log	15.2727	336	1.6491	0.3235	1.6491	1.2842
No log	15.3636	338	1.6443	0.3504	1.6443	1.2823
No log	15.4545	340	1.5557	0.3676	1.5557	1.2473
No log	15.5455	342	1.3950	0.4394	1.3950	1.1811
No log	15.6364	344	1.3218	0.5038	1.3218	1.1497
No log	15.7273	346	1.4066	0.4394	1.4066	1.1860
No log	15.8182	348	1.5501	0.3676	1.5501	1.2450
No log	15.9091	350	1.4747	0.3582	1.4747	1.2144
No log	16.0	352	1.5083	0.3582	1.5083	1.2281
No log	16.0909	354	1.6487	0.3165	1.6487	1.2840
No log	16.1818	356	1.6896	0.3143	1.6896	1.2999
No log	16.2727	358	1.7706	0.2676	1.7706	1.3306
No log	16.3636	360	1.6590	0.3453	1.6590	1.2880
No log	16.4545	362	1.5596	0.3478	1.5596	1.2488
No log	16.5455	364	1.5449	0.3796	1.5449	1.2429
No log	16.6364	366	1.6290	0.3676	1.6290	1.2763
No log	16.7273	368	1.7740	0.2837	1.7740	1.3319
No log	16.8182	370	1.9521	0.2411	1.9521	1.3972
No log	16.9091	372	1.9071	0.2571	1.9071	1.3810
No log	17.0	374	1.6937	0.3478	1.6937	1.3014
No log	17.0909	376	1.3730	0.4496	1.3730	1.1717
No log	17.1818	378	1.1612	0.5645	1.1612	1.0776
No log	17.2727	380	1.1002	0.5806	1.1002	1.0489
No log	17.3636	382	1.1357	0.5397	1.1357	1.0657
No log	17.4545	384	1.3203	0.4697	1.3203	1.1490
No log	17.5455	386	1.6017	0.3478	1.6017	1.2656
No log	17.6364	388	1.7109	0.3188	1.7109	1.3080
No log	17.7273	390	1.6573	0.3478	1.6573	1.2874
No log	17.8182	392	1.4678	0.3676	1.4678	1.2115
No log	17.9091	394	1.3405	0.4741	1.3405	1.1578
No log	18.0	396	1.3196	0.4741	1.3196	1.1487
No log	18.0909	398	1.4438	0.4088	1.4438	1.2016
No log	18.1818	400	1.5150	0.3676	1.5150	1.2309
No log	18.2727	402	1.6033	0.3504	1.6033	1.2662
No log	18.3636	404	1.6203	0.3504	1.6203	1.2729
No log	18.4545	406	1.6050	0.3676	1.6050	1.2669
No log	18.5455	408	1.6324	0.3504	1.6324	1.2777
No log	18.6364	410	1.5730	0.3676	1.5730	1.2542
No log	18.7273	412	1.4614	0.3759	1.4614	1.2089
No log	18.8182	414	1.3911	0.4688	1.3911	1.1794
No log	18.9091	416	1.4258	0.4122	1.4258	1.1941
No log	19.0	418	1.4709	0.4	1.4709	1.2128
No log	19.0909	420	1.6050	0.3382	1.6050	1.2669
No log	19.1818	422	1.6628	0.3235	1.6628	1.2895
No log	19.2727	424	1.6224	0.3459	1.6224	1.2737
No log	19.3636	426	1.5484	0.3846	1.5484	1.2443
No log	19.4545	428	1.4464	0.4839	1.4464	1.2027
No log	19.5455	430	1.3737	0.4959	1.3737	1.1721
No log	19.6364	432	1.3675	0.496	1.3675	1.1694
No log	19.7273	434	1.4818	0.3676	1.4818	1.2173
No log	19.8182	436	1.7647	0.3212	1.7647	1.3284
No log	19.9091	438	1.9277	0.2878	1.9277	1.3884
No log	20.0	440	1.8568	0.2941	1.8568	1.3626
No log	20.0909	442	1.7175	0.2941	1.7175	1.3105
No log	20.1818	444	1.6060	0.3759	1.6060	1.2673
No log	20.2727	446	1.5320	0.3969	1.5320	1.2378
No log	20.3636	448	1.4896	0.3969	1.4896	1.2205
No log	20.4545	450	1.4353	0.4154	1.4353	1.1980
No log	20.5455	452	1.3613	0.4286	1.3613	1.1667
No log	20.6364	454	1.3880	0.4252	1.3880	1.1781
No log	20.7273	456	1.4123	0.4496	1.4123	1.1884
No log	20.8182	458	1.4129	0.4275	1.4129	1.1886
No log	20.9091	460	1.3080	0.48	1.3080	1.1437
No log	21.0	462	1.2757	0.5	1.2757	1.1295
No log	21.0909	464	1.2879	0.5	1.2879	1.1349
No log	21.1818	466	1.3556	0.4762	1.3556	1.1643
No log	21.2727	468	1.5139	0.3731	1.5139	1.2304
No log	21.3636	470	1.6971	0.2941	1.6971	1.3027
No log	21.4545	472	1.7255	0.2941	1.7255	1.3136
No log	21.5455	474	1.6266	0.3459	1.6266	1.2754
No log	21.6364	476	1.5223	0.3759	1.5223	1.2338
No log	21.7273	478	1.3618	0.4496	1.3618	1.1670
No log	21.8182	480	1.2994	0.5312	1.2994	1.1399
No log	21.9091	482	1.2503	0.528	1.2503	1.1182
No log	22.0	484	1.2992	0.5312	1.2992	1.1398
No log	22.0909	486	1.4324	0.4296	1.4324	1.1968
No log	22.1818	488	1.7009	0.2899	1.7009	1.3042
No log	22.2727	490	1.8672	0.2571	1.8672	1.3664
No log	22.3636	492	1.8131	0.2899	1.8131	1.3465
No log	22.4545	494	1.6237	0.3478	1.6237	1.2742
No log	22.5455	496	1.4523	0.4296	1.4523	1.2051
No log	22.6364	498	1.4190	0.4697	1.4190	1.1912
0.3783	22.7273	500	1.5080	0.4	1.5080	1.2280
0.3783	22.8182	502	1.6746	0.3212	1.6746	1.2941
0.3783	22.9091	504	1.7347	0.3188	1.7347	1.3171
0.3783	23.0	506	1.6808	0.3212	1.6808	1.2965
0.3783	23.0909	508	1.5253	0.3731	1.5253	1.2350
0.3783	23.1818	510	1.3566	0.4697	1.3566	1.1647
0.3783	23.2727	512	1.3154	0.4882	1.3154	1.1469
0.3783	23.3636	514	1.3595	0.4320	1.3595	1.1660
0.3783	23.4545	516	1.4158	0.4091	1.4158	1.1899
0.3783	23.5455	518	1.4526	0.4030	1.4526	1.2052
0.3783	23.6364	520	1.5010	0.4030	1.5010	1.2252
0.3783	23.7273	522	1.5754	0.4030	1.5754	1.2552
0.3783	23.8182	524	1.6426	0.3676	1.6426	1.2816
0.3783	23.9091	526	1.6226	0.3731	1.6226	1.2738
0.3783	24.0	528	1.6062	0.3459	1.6062	1.2674
0.3783	24.0909	530	1.6226	0.3459	1.6226	1.2738
0.3783	24.1818	532	1.5840	0.3459	1.5840	1.2586

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1