ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k11_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.2021
• Qwk: 0.5113
• Mse: 1.2021
• Rmse: 1.0964

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0417	2	7.0863	0.0	7.0863	2.6620
No log	0.0833	4	4.9299	0.0558	4.9299	2.2203
No log	0.125	6	4.4405	-0.0588	4.4405	2.1073
No log	0.1667	8	3.1816	-0.0240	3.1816	1.7837
No log	0.2083	10	2.1195	0.1692	2.1195	1.4559
No log	0.25	12	2.4282	0.2038	2.4282	1.5583
No log	0.2917	14	2.0452	0.2047	2.0452	1.4301
No log	0.3333	16	1.5903	0.2435	1.5903	1.2611
No log	0.375	18	1.4557	0.2281	1.4557	1.2065
No log	0.4167	20	1.5274	0.2810	1.5274	1.2359
No log	0.4583	22	1.6098	0.3511	1.6098	1.2688
No log	0.5	24	1.4804	0.4088	1.4804	1.2167
No log	0.5417	26	1.2790	0.4651	1.2790	1.1309
No log	0.5833	28	1.1776	0.5246	1.1776	1.0852
No log	0.625	30	1.2467	0.4724	1.2467	1.1166
No log	0.6667	32	1.6155	0.4167	1.6155	1.2710
No log	0.7083	34	1.6276	0.4179	1.6276	1.2758
No log	0.75	36	1.3705	0.3220	1.3705	1.1707
No log	0.7917	38	1.6580	0.1887	1.6580	1.2876
No log	0.8333	40	1.7090	0.1905	1.7090	1.3073
No log	0.875	42	1.2795	0.3826	1.2795	1.1312
No log	0.9167	44	1.1663	0.5077	1.1663	1.0799
No log	0.9583	46	1.4257	0.5324	1.4257	1.1940
No log	1.0	48	1.3096	0.5333	1.3096	1.1444
No log	1.0417	50	1.0171	0.5625	1.0171	1.0085
No log	1.0833	52	1.0272	0.5891	1.0272	1.0135
No log	1.125	54	1.0107	0.6061	1.0107	1.0054
No log	1.1667	56	0.9377	0.5954	0.9377	0.9684
No log	1.2083	58	1.0141	0.6074	1.0141	1.0070
No log	1.25	60	1.2151	0.5147	1.2151	1.1023
No log	1.2917	62	1.1610	0.5147	1.1610	1.0775
No log	1.3333	64	1.1455	0.5401	1.1455	1.0703
No log	1.375	66	0.9824	0.6324	0.9824	0.9912
No log	1.4167	68	0.8951	0.6324	0.8951	0.9461
No log	1.4583	70	1.0076	0.6370	1.0076	1.0038
No log	1.5	72	1.4460	0.4029	1.4460	1.2025
No log	1.5417	74	1.3945	0.3768	1.3945	1.1809
No log	1.5833	76	1.0248	0.6471	1.0248	1.0123
No log	1.625	78	0.9348	0.6418	0.9348	0.9669
No log	1.6667	80	0.9542	0.6260	0.9542	0.9768
No log	1.7083	82	1.1890	0.6015	1.1890	1.0904
No log	1.75	84	1.8621	0.2571	1.8621	1.3646
No log	1.7917	86	2.1592	0.1014	2.1592	1.4694
No log	1.8333	88	2.0089	0.1986	2.0089	1.4173
No log	1.875	90	1.5560	0.3382	1.5560	1.2474
No log	1.9167	92	1.2654	0.5496	1.2654	1.1249
No log	1.9583	94	1.2391	0.5625	1.2391	1.1132
No log	2.0	96	1.3478	0.4776	1.3478	1.1610
No log	2.0417	98	1.7414	0.2878	1.7414	1.3196
No log	2.0833	100	1.9650	0.2143	1.9650	1.4018
No log	2.125	102	1.7842	0.2270	1.7842	1.3357
No log	2.1667	104	1.2996	0.4688	1.2996	1.1400
No log	2.2083	106	1.1417	0.5124	1.1417	1.0685
No log	2.25	108	1.0963	0.5323	1.0963	1.0470
No log	2.2917	110	1.0522	0.5512	1.0522	1.0258
No log	2.3333	112	1.1053	0.5538	1.1053	1.0513
No log	2.375	114	1.1243	0.5271	1.1243	1.0603
No log	2.4167	116	1.0984	0.5238	1.0984	1.0481
No log	2.4583	118	1.0609	0.6190	1.0609	1.0300
No log	2.5	120	1.0950	0.4959	1.0950	1.0464
No log	2.5417	122	1.0877	0.5246	1.0877	1.0429
No log	2.5833	124	1.0919	0.6418	1.0919	1.0450
No log	2.625	126	1.4243	0.4179	1.4243	1.1934
No log	2.6667	128	1.8103	0.2734	1.8103	1.3455
No log	2.7083	130	2.2475	0.0455	2.2475	1.4992
No log	2.75	132	2.2916	0.0305	2.2916	1.5138
No log	2.7917	134	1.9515	0.0902	1.9515	1.3970
No log	2.8333	136	1.4890	0.3704	1.4890	1.2203
No log	2.875	138	1.3755	0.4776	1.3755	1.1728
No log	2.9167	140	1.3469	0.4697	1.3469	1.1605
No log	2.9583	142	1.3505	0.4462	1.3505	1.1621
No log	3.0	144	1.3091	0.4769	1.3091	1.1441
No log	3.0417	146	1.2731	0.5191	1.2731	1.1283
No log	3.0833	148	1.3298	0.4545	1.3298	1.1532
No log	3.125	150	1.6178	0.3217	1.6178	1.2719
No log	3.1667	152	1.5714	0.3043	1.5714	1.2536
No log	3.2083	154	1.4280	0.3582	1.4280	1.1950
No log	3.25	156	1.1659	0.5985	1.1659	1.0797
No log	3.2917	158	1.1825	0.5736	1.1825	1.0874
No log	3.3333	160	1.2438	0.5312	1.2438	1.1152
No log	3.375	162	1.5000	0.4394	1.5000	1.2247
No log	3.4167	164	1.5156	0.3939	1.5156	1.2311
No log	3.4583	166	1.2800	0.5116	1.2800	1.1314
No log	3.5	168	1.2280	0.5385	1.2280	1.1081
No log	3.5417	170	1.4657	0.4275	1.4657	1.2107
No log	3.5833	172	1.4867	0.3910	1.4867	1.2193
No log	3.625	174	1.1911	0.5538	1.1911	1.0914
No log	3.6667	176	1.1248	0.5938	1.1248	1.0606
No log	3.7083	178	1.1948	0.5469	1.1948	1.0931
No log	3.75	180	1.4235	0.4122	1.4235	1.1931
No log	3.7917	182	1.5357	0.3284	1.5357	1.2392
No log	3.8333	184	1.3469	0.4844	1.3469	1.1606
No log	3.875	186	1.1703	0.5410	1.1703	1.0818
No log	3.9167	188	1.1508	0.5854	1.1508	1.0728
No log	3.9583	190	1.1900	0.5496	1.1900	1.0909
No log	4.0	192	1.4097	0.3333	1.4097	1.1873
No log	4.0417	194	1.5598	0.3308	1.5598	1.2489
No log	4.0833	196	1.3285	0.4242	1.3285	1.1526
No log	4.125	198	1.0818	0.5397	1.0818	1.0401
No log	4.1667	200	1.0717	0.5167	1.0717	1.0352
No log	4.2083	202	1.1027	0.5167	1.1027	1.0501
No log	4.25	204	1.1334	0.5366	1.1334	1.0646
No log	4.2917	206	1.3352	0.4769	1.3352	1.1555
No log	4.3333	208	1.5081	0.3741	1.5081	1.2281
No log	4.375	210	1.4495	0.3529	1.4495	1.2040
No log	4.4167	212	1.2311	0.5588	1.2311	1.1096
No log	4.4583	214	1.2026	0.5547	1.2026	1.0966
No log	4.5	216	1.2240	0.5547	1.2240	1.1064
No log	4.5417	218	1.4455	0.3529	1.4455	1.2023
No log	4.5833	220	1.6305	0.3165	1.6305	1.2769
No log	4.625	222	1.6635	0.3165	1.6635	1.2898
No log	4.6667	224	1.5339	0.3358	1.5339	1.2385
No log	4.7083	226	1.5473	0.3358	1.5473	1.2439
No log	4.75	228	1.4060	0.3971	1.4060	1.1858
No log	4.7917	230	1.1699	0.5672	1.1699	1.0816
No log	4.8333	232	1.1040	0.5672	1.1040	1.0507
No log	4.875	234	1.1319	0.5147	1.1319	1.0639
No log	4.9167	236	1.2880	0.4672	1.2880	1.1349
No log	4.9583	238	1.4212	0.3971	1.4212	1.1921
No log	5.0	240	1.2310	0.4853	1.2310	1.1095
No log	5.0417	242	0.9758	0.6176	0.9758	0.9878
No log	5.0833	244	0.9173	0.6667	0.9173	0.9577
No log	5.125	246	1.0574	0.5797	1.0574	1.0283
No log	5.1667	248	1.3139	0.4853	1.3139	1.1462
No log	5.2083	250	1.2483	0.4853	1.2483	1.1173
No log	5.25	252	1.0258	0.6176	1.0258	1.0128
No log	5.2917	254	0.9502	0.6222	0.9502	0.9748
No log	5.3333	256	0.9477	0.6364	0.9477	0.9735
No log	5.375	258	1.0156	0.6515	1.0156	1.0078
No log	5.4167	260	1.1935	0.5735	1.1935	1.0925
No log	5.4583	262	1.4422	0.4412	1.4422	1.2009
No log	5.5	264	1.4422	0.4148	1.4422	1.2009
No log	5.5417	266	1.2567	0.5113	1.2567	1.1210
No log	5.5833	268	1.0970	0.6462	1.0970	1.0474
No log	5.625	270	1.0773	0.5760	1.0773	1.0379
No log	5.6667	272	1.0644	0.5760	1.0644	1.0317
No log	5.7083	274	1.1180	0.6154	1.1180	1.0574
No log	5.75	276	1.3173	0.4925	1.3173	1.1477
No log	5.7917	278	1.3516	0.4412	1.3516	1.1626
No log	5.8333	280	1.1634	0.5507	1.1634	1.0786
No log	5.875	282	1.0851	0.6471	1.0851	1.0417
No log	5.9167	284	1.0775	0.6471	1.0775	1.0380
No log	5.9583	286	1.0557	0.6767	1.0557	1.0275
No log	6.0	288	1.0357	0.6767	1.0357	1.0177
No log	6.0417	290	1.1502	0.5481	1.1502	1.0725
No log	6.0833	292	1.3752	0.4203	1.3752	1.1727
No log	6.125	294	1.4152	0.4029	1.4152	1.1896
No log	6.1667	296	1.4352	0.4336	1.4352	1.1980
No log	6.2083	298	1.5129	0.4225	1.5129	1.2300
No log	6.25	300	1.3725	0.4583	1.3725	1.1716
No log	6.2917	302	1.1994	0.6143	1.1994	1.0952
No log	6.3333	304	1.1508	0.6131	1.1508	1.0728
No log	6.375	306	1.0540	0.6308	1.0540	1.0266
No log	6.4167	308	1.0408	0.5574	1.0408	1.0202
No log	6.4583	310	1.0187	0.6457	1.0187	1.0093
No log	6.5	312	0.9330	0.6718	0.9330	0.9659
No log	6.5417	314	0.8406	0.6667	0.8406	0.9168
No log	6.5833	316	0.7340	0.6912	0.7340	0.8567
No log	6.625	318	0.7070	0.7153	0.7070	0.8409
No log	6.6667	320	0.7339	0.7015	0.7339	0.8567
No log	6.7083	322	0.8973	0.6525	0.8973	0.9473
No log	6.75	324	1.0009	0.5899	1.0009	1.0005
No log	6.7917	326	1.0964	0.5797	1.0964	1.0471
No log	6.8333	328	1.0702	0.5588	1.0702	1.0345
No log	6.875	330	1.0823	0.5778	1.0823	1.0403
No log	6.9167	332	1.1361	0.5672	1.1361	1.0659
No log	6.9583	334	1.0700	0.6212	1.0700	1.0344
No log	7.0	336	0.9873	0.6165	0.9873	0.9936
No log	7.0417	338	0.9747	0.6165	0.9747	0.9873
No log	7.0833	340	1.0596	0.6370	1.0596	1.0294
No log	7.125	342	1.0862	0.6370	1.0862	1.0422
No log	7.1667	344	1.0713	0.6370	1.0713	1.0351
No log	7.2083	346	1.1065	0.6316	1.1065	1.0519
No log	7.25	348	1.1492	0.6119	1.1492	1.0720
No log	7.2917	350	1.0838	0.5954	1.0838	1.0411
No log	7.3333	352	1.0492	0.6	1.0492	1.0243
No log	7.375	354	1.0568	0.5736	1.0568	1.0280
No log	7.4167	356	1.0798	0.5802	1.0798	1.0391
No log	7.4583	358	1.0742	0.5865	1.0742	1.0364
No log	7.5	360	1.1866	0.5588	1.1866	1.0893
No log	7.5417	362	1.2701	0.5217	1.2701	1.1270
No log	7.5833	364	1.2263	0.5352	1.2263	1.1074
No log	7.625	366	1.1878	0.5674	1.1878	1.0899
No log	7.6667	368	1.1173	0.5674	1.1173	1.0570
No log	7.7083	370	1.1111	0.5441	1.1111	1.0541
No log	7.75	372	1.1154	0.5693	1.1154	1.0561
No log	7.7917	374	1.1725	0.5547	1.1725	1.0828
No log	7.8333	376	1.1718	0.5882	1.1718	1.0825
No log	7.875	378	1.0617	0.6165	1.0617	1.0304
No log	7.9167	380	1.0239	0.6107	1.0239	1.0119
No log	7.9583	382	1.0599	0.6	1.0599	1.0295
No log	8.0	384	1.0622	0.5891	1.0622	1.0306
No log	8.0417	386	1.1066	0.6061	1.1066	1.0519
No log	8.0833	388	1.0915	0.6165	1.0915	1.0447
No log	8.125	390	1.0875	0.5926	1.0875	1.0428
No log	8.1667	392	1.0026	0.6165	1.0026	1.0013
No log	8.2083	394	0.9273	0.5938	0.9273	0.9629
No log	8.25	396	0.9548	0.5827	0.9548	0.9771
No log	8.2917	398	0.9880	0.5484	0.9880	0.9940
No log	8.3333	400	1.0434	0.5246	1.0434	1.0214
No log	8.375	402	1.0741	0.5203	1.0741	1.0364
No log	8.4167	404	1.1190	0.5366	1.1190	1.0578
No log	8.4583	406	1.1970	0.5581	1.1970	1.0941
No log	8.5	408	1.2397	0.5649	1.2397	1.1134
No log	8.5417	410	1.1698	0.5512	1.1698	1.0816
No log	8.5833	412	1.1608	0.5161	1.1608	1.0774
No log	8.625	414	1.2042	0.5512	1.2042	1.0974
No log	8.6667	416	1.2801	0.4921	1.2801	1.1314
No log	8.7083	418	1.3084	0.4844	1.3084	1.1438
No log	8.75	420	1.2386	0.4960	1.2386	1.1129
No log	8.7917	422	1.1632	0.4960	1.1632	1.0785
No log	8.8333	424	1.0760	0.5512	1.0760	1.0373
No log	8.875	426	1.0421	0.5736	1.0421	1.0209
No log	8.9167	428	1.0763	0.5891	1.0763	1.0374
No log	8.9583	430	1.2152	0.5263	1.2152	1.1024
No log	9.0	432	1.2607	0.5	1.2607	1.1228
No log	9.0417	434	1.1954	0.5263	1.1954	1.0933
No log	9.0833	436	1.0052	0.6	1.0052	1.0026
No log	9.125	438	0.9643	0.5984	0.9643	0.9820
No log	9.1667	440	0.9763	0.5873	0.9763	0.9881
No log	9.2083	442	1.0344	0.5846	1.0344	1.0171
No log	9.25	444	1.2768	0.5	1.2768	1.1300
No log	9.2917	446	1.6414	0.3333	1.6414	1.2812
No log	9.3333	448	1.7206	0.3066	1.7206	1.3117
No log	9.375	450	1.5448	0.3358	1.5448	1.2429
No log	9.4167	452	1.4298	0.4148	1.4298	1.1958
No log	9.4583	454	1.1893	0.6	1.1893	1.0905
No log	9.5	456	1.0943	0.5484	1.0943	1.0461
No log	9.5417	458	1.0539	0.5440	1.0539	1.0266
No log	9.5833	460	1.0641	0.5827	1.0641	1.0316
No log	9.625	462	1.1681	0.5354	1.1681	1.0808
No log	9.6667	464	1.3422	0.4462	1.3422	1.1585
No log	9.7083	466	1.3609	0.4733	1.3609	1.1666
No log	9.75	468	1.2287	0.5385	1.2287	1.1085
No log	9.7917	470	1.1974	0.6	1.1974	1.0943
No log	9.8333	472	1.2135	0.5954	1.2135	1.1016
No log	9.875	474	1.2490	0.5846	1.2490	1.1176
No log	9.9167	476	1.1358	0.6	1.1358	1.0658
No log	9.9583	478	0.9855	0.5938	0.9855	0.9927
No log	10.0	480	0.9389	0.5528	0.9389	0.9690
No log	10.0417	482	0.9573	0.5455	0.9573	0.9784
No log	10.0833	484	0.9664	0.5333	0.9664	0.9831
No log	10.125	486	0.9522	0.608	0.9522	0.9758
No log	10.1667	488	0.9885	0.5802	0.9885	0.9942
No log	10.2083	490	1.0174	0.5758	1.0174	1.0087
No log	10.25	492	0.9173	0.6015	0.9173	0.9577
No log	10.2917	494	0.8528	0.6357	0.8528	0.9235
No log	10.3333	496	0.8789	0.6308	0.8789	0.9375
No log	10.375	498	0.9071	0.6412	0.9071	0.9524
0.3551	10.4167	500	0.9779	0.6212	0.9779	0.9889
0.3551	10.4583	502	1.0219	0.6015	1.0219	1.0109
0.3551	10.5	504	1.0671	0.5865	1.0671	1.0330
0.3551	10.5417	506	1.0475	0.5909	1.0475	1.0235
0.3551	10.5833	508	1.1527	0.5564	1.1527	1.0736
0.3551	10.625	510	1.2021	0.5113	1.2021	1.0964

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1