ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run2_AugV5_k2_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 1.0372
• Qwk: 0.5714
• Mse: 1.0372
• Rmse: 1.0184

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.2222	2	6.8578	0.0308	6.8578	2.6187
No log	0.4444	4	4.6217	0.0455	4.6217	2.1498
No log	0.6667	6	3.2807	0.0546	3.2807	1.8113
No log	0.8889	8	3.5359	-0.0108	3.5359	1.8804
No log	1.1111	10	2.7983	-0.0444	2.7983	1.6728
No log	1.3333	12	2.0670	0.1176	2.0670	1.4377
No log	1.5556	14	1.7257	0.2037	1.7257	1.3136
No log	1.7778	16	1.7476	0.25	1.7476	1.3220
No log	2.0	18	1.9238	0.2992	1.9238	1.3870
No log	2.2222	20	1.8263	0.3692	1.8263	1.3514
No log	2.4444	22	1.5323	0.4127	1.5323	1.2379
No log	2.6667	24	1.3259	0.2364	1.3259	1.1515
No log	2.8889	26	1.6415	0.2182	1.6415	1.2812
No log	3.1111	28	1.4552	0.2982	1.4552	1.2063
No log	3.3333	30	1.0870	0.5271	1.0870	1.0426
No log	3.5556	32	1.2188	0.5493	1.2188	1.1040
No log	3.7778	34	1.1263	0.5775	1.1263	1.0613
No log	4.0	36	1.0219	0.6074	1.0219	1.0109
No log	4.2222	38	0.9976	0.6519	0.9976	0.9988
No log	4.4444	40	1.1445	0.5548	1.1445	1.0698
No log	4.6667	42	1.1721	0.5963	1.1721	1.0827
No log	4.8889	44	0.9559	0.6479	0.9559	0.9777
No log	5.1111	46	1.1124	0.5985	1.1124	1.0547
No log	5.3333	48	1.0382	0.6119	1.0382	1.0189
No log	5.5556	50	0.8116	0.7	0.8116	0.9009
No log	5.7778	52	0.8416	0.7183	0.8416	0.9174
No log	6.0	54	0.8945	0.6815	0.8945	0.9458
No log	6.2222	56	0.9174	0.6423	0.9174	0.9578
No log	6.4444	58	1.0776	0.5263	1.0776	1.0381
No log	6.6667	60	1.1476	0.5224	1.1476	1.0712
No log	6.8889	62	0.9633	0.6377	0.9633	0.9815
No log	7.1111	64	0.9754	0.6761	0.9754	0.9876
No log	7.3333	66	1.0304	0.6241	1.0304	1.0151
No log	7.5556	68	0.9863	0.6519	0.9863	0.9931
No log	7.7778	70	1.0885	0.5736	1.0885	1.0433
No log	8.0	72	1.4353	0.4252	1.4353	1.1980
No log	8.2222	74	1.3511	0.4567	1.3511	1.1624
No log	8.4444	76	1.0689	0.5161	1.0689	1.0339
No log	8.6667	78	1.0222	0.576	1.0222	1.0110
No log	8.8889	80	0.9871	0.6047	0.9871	0.9936
No log	9.1111	82	1.0996	0.5954	1.0996	1.0486
No log	9.3333	84	1.2094	0.5802	1.2094	1.0997
No log	9.5556	86	1.3074	0.5	1.3074	1.1434
No log	9.7778	88	1.3668	0.4733	1.3668	1.1691
No log	10.0	90	1.0939	0.6154	1.0939	1.0459
No log	10.2222	92	0.9013	0.7299	0.9013	0.9494
No log	10.4444	94	0.8712	0.7391	0.8712	0.9334
No log	10.6667	96	1.0158	0.5735	1.0158	1.0079
No log	10.8889	98	1.1644	0.4928	1.1644	1.0791
No log	11.1111	100	1.2251	0.5106	1.2251	1.1069
No log	11.3333	102	1.0808	0.5594	1.0808	1.0396
No log	11.5556	104	0.8490	0.6806	0.8490	0.9214
No log	11.7778	106	0.8732	0.6806	0.8732	0.9345
No log	12.0	108	0.9510	0.6619	0.9510	0.9752
No log	12.2222	110	1.2357	0.4853	1.2357	1.1116
No log	12.4444	112	1.2942	0.4511	1.2942	1.1376
No log	12.6667	114	1.0644	0.6119	1.0644	1.0317
No log	12.8889	116	0.9928	0.6370	0.9928	0.9964
No log	13.1111	118	0.9832	0.6119	0.9832	0.9916
No log	13.3333	120	1.0916	0.5926	1.0916	1.0448
No log	13.5556	122	1.1692	0.5612	1.1692	1.0813
No log	13.7778	124	1.0298	0.6043	1.0298	1.0148
No log	14.0	126	0.9028	0.6569	0.9028	0.9501
No log	14.2222	128	0.9548	0.6061	0.9548	0.9771
No log	14.4444	130	1.1279	0.5426	1.1279	1.0620
No log	14.6667	132	1.1766	0.5191	1.1766	1.0847
No log	14.8889	134	1.3029	0.4848	1.3029	1.1414
No log	15.1111	136	1.2368	0.5113	1.2368	1.1121
No log	15.3333	138	1.0217	0.5312	1.0217	1.0108
No log	15.5556	140	0.9483	0.5909	0.9483	0.9738
No log	15.7778	142	0.9784	0.5426	0.9784	0.9891
No log	16.0	144	1.0258	0.5312	1.0258	1.0128
No log	16.2222	146	1.2456	0.4925	1.2456	1.1161
No log	16.4444	148	1.3073	0.4776	1.3073	1.1434
No log	16.6667	150	1.2174	0.5	1.2174	1.1034
No log	16.8889	152	1.0491	0.5354	1.0491	1.0242
No log	17.1111	154	0.9968	0.544	0.9968	0.9984
No log	17.3333	156	1.0457	0.5354	1.0457	1.0226
No log	17.5556	158	1.1955	0.5426	1.1955	1.0934
No log	17.7778	160	1.1900	0.5426	1.1900	1.0909
No log	18.0	162	1.1020	0.5426	1.1020	1.0498
No log	18.2222	164	0.9908	0.5469	0.9908	0.9954
No log	18.4444	166	0.8777	0.6222	0.8777	0.9368
No log	18.6667	168	0.7850	0.7	0.7850	0.8860
No log	18.8889	170	0.8044	0.7246	0.8044	0.8969
No log	19.1111	172	0.8168	0.6667	0.8168	0.9038
No log	19.3333	174	0.8802	0.5581	0.8802	0.9382
No log	19.5556	176	0.9137	0.5625	0.9137	0.9559
No log	19.7778	178	0.8881	0.6202	0.8881	0.9424
No log	20.0	180	0.8947	0.6615	0.8947	0.9459
No log	20.2222	182	0.9134	0.6567	0.9134	0.9557
No log	20.4444	184	0.8783	0.625	0.8783	0.9372
No log	20.6667	186	0.9476	0.5649	0.9476	0.9735
No log	20.8889	188	1.0936	0.5455	1.0936	1.0457
No log	21.1111	190	1.0584	0.5802	1.0584	1.0288
No log	21.3333	192	0.9328	0.5954	0.9328	0.9658
No log	21.5556	194	0.9221	0.6154	0.9221	0.9603
No log	21.7778	196	0.9273	0.5954	0.9273	0.9630
No log	22.0	198	1.0601	0.5778	1.0601	1.0296
No log	22.2222	200	1.1689	0.4925	1.1689	1.0811
No log	22.4444	202	1.1396	0.5185	1.1396	1.0675
No log	22.6667	204	0.9748	0.6176	0.9748	0.9873
No log	22.8889	206	0.9039	0.6316	0.9039	0.9507
No log	23.1111	208	0.9200	0.6316	0.9200	0.9592
No log	23.3333	210	1.0144	0.5606	1.0144	1.0072
No log	23.5556	212	1.0499	0.5538	1.0499	1.0247
No log	23.7778	214	0.9493	0.5954	0.9493	0.9743
No log	24.0	216	0.8873	0.5954	0.8873	0.9419
No log	24.2222	218	0.8757	0.6	0.8757	0.9358
No log	24.4444	220	0.9017	0.6316	0.9017	0.9496
No log	24.6667	222	0.9555	0.5954	0.9555	0.9775
No log	24.8889	224	1.0284	0.5909	1.0284	1.0141
No log	25.1111	226	0.9799	0.5954	0.9799	0.9899
No log	25.3333	228	0.8939	0.6047	0.8939	0.9455
No log	25.5556	230	0.8485	0.6119	0.8485	0.9211
No log	25.7778	232	0.8125	0.6667	0.8125	0.9014
No log	26.0	234	0.8890	0.6316	0.8890	0.9429
No log	26.2222	236	0.9098	0.6370	0.9098	0.9539
No log	26.4444	238	0.8438	0.6667	0.8438	0.9186
No log	26.6667	240	0.8046	0.6667	0.8046	0.8970
No log	26.8889	242	0.8473	0.6818	0.8473	0.9205
No log	27.1111	244	0.9046	0.6094	0.9046	0.9511
No log	27.3333	246	0.9694	0.6094	0.9694	0.9846
No log	27.5556	248	1.0056	0.5873	1.0056	1.0028
No log	27.7778	250	1.0334	0.5873	1.0334	1.0165
No log	28.0	252	1.0315	0.5873	1.0315	1.0156
No log	28.2222	254	0.9804	0.6202	0.9804	0.9902
No log	28.4444	256	0.9546	0.6202	0.9546	0.9770
No log	28.6667	258	1.0404	0.5865	1.0404	1.0200
No log	28.8889	260	1.1532	0.5373	1.1532	1.0739
No log	29.1111	262	1.1176	0.5564	1.1176	1.0572
No log	29.3333	264	1.0926	0.5821	1.0926	1.0453
No log	29.5556	266	1.1013	0.5606	1.1013	1.0494
No log	29.7778	268	1.1030	0.5496	1.1030	1.0502
No log	30.0	270	1.0210	0.6142	1.0210	1.0104
No log	30.2222	272	0.9717	0.6094	0.9717	0.9858
No log	30.4444	274	0.9738	0.6094	0.9738	0.9868
No log	30.6667	276	0.9616	0.6260	0.9616	0.9806
No log	30.8889	278	0.9633	0.6963	0.9633	0.9815
No log	31.1111	280	0.9606	0.6716	0.9606	0.9801
No log	31.3333	282	0.9379	0.6716	0.9379	0.9685
No log	31.5556	284	0.9334	0.6716	0.9334	0.9661
No log	31.7778	286	0.9352	0.6190	0.9352	0.9670
No log	32.0	288	0.9707	0.5827	0.9707	0.9853
No log	32.2222	290	1.0338	0.5669	1.0338	1.0168
No log	32.4444	292	1.0297	0.5938	1.0297	1.0147
No log	32.6667	294	0.9832	0.544	0.9832	0.9915
No log	32.8889	296	0.9643	0.5323	0.9643	0.9820
No log	33.1111	298	0.9312	0.5891	0.9312	0.9650
No log	33.3333	300	0.9164	0.6154	0.9164	0.9573
No log	33.5556	302	0.9306	0.592	0.9306	0.9647
No log	33.7778	304	0.9819	0.5873	0.9819	0.9909
No log	34.0	306	1.0094	0.5873	1.0094	1.0047
No log	34.2222	308	0.9971	0.5760	0.9971	0.9986
No log	34.4444	310	1.0044	0.5484	1.0044	1.0022
No log	34.6667	312	1.0053	0.5760	1.0053	1.0026
No log	34.8889	314	0.9868	0.5873	0.9868	0.9934
No log	35.1111	316	0.9805	0.5873	0.9805	0.9902
No log	35.3333	318	0.9673	0.5873	0.9673	0.9835
No log	35.5556	320	0.9584	0.5873	0.9584	0.9790
No log	35.7778	322	0.9660	0.5760	0.9660	0.9829
No log	36.0	324	0.9680	0.5873	0.9680	0.9839
No log	36.2222	326	0.9527	0.5873	0.9527	0.9760
No log	36.4444	328	0.9191	0.5827	0.9191	0.9587
No log	36.6667	330	0.9086	0.6094	0.9086	0.9532
No log	36.8889	332	0.8846	0.6094	0.8846	0.9405
No log	37.1111	334	0.8593	0.6567	0.8593	0.9270
No log	37.3333	336	0.8706	0.6212	0.8706	0.9330
No log	37.5556	338	0.9002	0.6107	0.9002	0.9488
No log	37.7778	340	0.9242	0.5873	0.9242	0.9614
No log	38.0	342	0.9843	0.6142	0.9843	0.9921
No log	38.2222	344	1.0059	0.6142	1.0059	1.0029
No log	38.4444	346	0.9725	0.6142	0.9725	0.9862
No log	38.6667	348	0.9276	0.5984	0.9276	0.9631
No log	38.8889	350	0.9264	0.5984	0.9264	0.9625
No log	39.1111	352	0.9287	0.5984	0.9287	0.9637
No log	39.3333	354	0.9142	0.6154	0.9142	0.9561
No log	39.5556	356	0.9123	0.6190	0.9123	0.9551
No log	39.7778	358	0.9326	0.6202	0.9326	0.9657
No log	40.0	360	0.9645	0.6154	0.9645	0.9821
No log	40.2222	362	0.9648	0.6154	0.9648	0.9822
No log	40.4444	364	0.9482	0.6202	0.9482	0.9738
No log	40.6667	366	0.9453	0.6202	0.9453	0.9723
No log	40.8889	368	0.9336	0.6202	0.9336	0.9662
No log	41.1111	370	0.9372	0.6406	0.9372	0.9681
No log	41.3333	372	0.9740	0.6202	0.9740	0.9869
No log	41.5556	374	1.0083	0.5827	1.0083	1.0041
No log	41.7778	376	1.0308	0.5827	1.0308	1.0153
No log	42.0	378	1.0337	0.5827	1.0337	1.0167
No log	42.2222	380	1.0117	0.5827	1.0117	1.0058
No log	42.4444	382	0.9971	0.5873	0.9971	0.9985
No log	42.6667	384	1.0066	0.544	1.0066	1.0033
No log	42.8889	386	1.0057	0.5802	1.0057	1.0028
No log	43.1111	388	0.9981	0.5758	0.9981	0.9990
No log	43.3333	390	0.9821	0.5891	0.9821	0.9910
No log	43.5556	392	0.9874	0.6260	0.9874	0.9937
No log	43.7778	394	1.0097	0.6142	1.0097	1.0048
No log	44.0	396	1.0231	0.5938	1.0231	1.0115
No log	44.2222	398	1.0417	0.5938	1.0417	1.0206
No log	44.4444	400	1.0072	0.6154	1.0072	1.0036
No log	44.6667	402	0.9862	0.6094	0.9862	0.9931
No log	44.8889	404	0.9685	0.6094	0.9685	0.9841
No log	45.1111	406	0.9565	0.6094	0.9566	0.9780
No log	45.3333	408	0.9448	0.6094	0.9448	0.9720
No log	45.5556	410	0.9401	0.6364	0.9401	0.9696
No log	45.7778	412	0.9430	0.6308	0.9430	0.9711
No log	46.0	414	0.9659	0.6154	0.9659	0.9828
No log	46.2222	416	1.0272	0.6165	1.0272	1.0135
No log	46.4444	418	1.0475	0.5865	1.0475	1.0235
No log	46.6667	420	0.9952	0.6212	0.9952	0.9976
No log	46.8889	422	0.9054	0.6154	0.9054	0.9515
No log	47.1111	424	0.8488	0.6316	0.8488	0.9213
No log	47.3333	426	0.8370	0.6466	0.8370	0.9149
No log	47.5556	428	0.8243	0.6815	0.8243	0.9079
No log	47.7778	430	0.8262	0.6815	0.8262	0.9090
No log	48.0	432	0.8450	0.6512	0.8450	0.9192
No log	48.2222	434	0.8670	0.6406	0.8670	0.9311
No log	48.4444	436	0.8801	0.6032	0.8801	0.9381
No log	48.6667	438	0.8908	0.5938	0.8908	0.9438
No log	48.8889	440	0.8981	0.5873	0.8981	0.9477
No log	49.1111	442	0.9232	0.6406	0.9232	0.9609
No log	49.3333	444	0.9472	0.6406	0.9472	0.9732
No log	49.5556	446	0.9463	0.6406	0.9463	0.9728
No log	49.7778	448	0.9080	0.6094	0.9080	0.9529
No log	50.0	450	0.8695	0.6466	0.8695	0.9325
No log	50.2222	452	0.8573	0.6567	0.8573	0.9259
No log	50.4444	454	0.8667	0.6466	0.8667	0.9310
No log	50.6667	456	0.8876	0.6269	0.8876	0.9421
No log	50.8889	458	0.9230	0.6107	0.9230	0.9607
No log	51.1111	460	0.9771	0.6212	0.9771	0.9885
No log	51.3333	462	0.9836	0.6107	0.9836	0.9918
No log	51.5556	464	0.9622	0.6154	0.9622	0.9809
No log	51.7778	466	0.9743	0.5891	0.9743	0.9871
No log	52.0	468	0.9789	0.5891	0.9789	0.9894
No log	52.2222	470	0.9755	0.6094	0.9755	0.9877
No log	52.4444	472	0.9827	0.6094	0.9827	0.9913
No log	52.6667	474	0.9926	0.6094	0.9926	0.9963
No log	52.8889	476	1.0043	0.6094	1.0043	1.0022
No log	53.1111	478	1.0301	0.6142	1.0301	1.0149
No log	53.3333	480	1.0343	0.5891	1.0343	1.0170
No log	53.5556	482	1.0293	0.6107	1.0293	1.0146
No log	53.7778	484	1.0151	0.6212	1.0151	1.0075
No log	54.0	486	0.9688	0.6212	0.9688	0.9843
No log	54.2222	488	0.9502	0.6357	0.9502	0.9748
No log	54.4444	490	0.9379	0.5984	0.9379	0.9684
No log	54.6667	492	0.9535	0.5984	0.9535	0.9765
No log	54.8889	494	0.9750	0.5984	0.9750	0.9874
No log	55.1111	496	0.9916	0.5984	0.9916	0.9958
No log	55.3333	498	0.9865	0.5873	0.9865	0.9932
0.2429	55.5556	500	0.9727	0.5873	0.9727	0.9863
0.2429	55.7778	502	0.9593	0.5984	0.9593	0.9794
0.2429	56.0	504	0.9707	0.576	0.9707	0.9852
0.2429	56.2222	506	0.9866	0.6047	0.9866	0.9933
0.2429	56.4444	508	0.9968	0.6047	0.9968	0.9984
0.2429	56.6667	510	1.0032	0.6047	1.0032	1.0016
0.2429	56.8889	512	0.9776	0.6462	0.9776	0.9887
0.2429	57.1111	514	0.9509	0.6357	0.9509	0.9752
0.2429	57.3333	516	0.9477	0.5984	0.9477	0.9735
0.2429	57.5556	518	0.9670	0.6357	0.9670	0.9833
0.2429	57.7778	520	0.9884	0.6357	0.9884	0.9942
0.2429	58.0	522	0.9984	0.6094	0.9984	0.9992
0.2429	58.2222	524	1.0130	0.5827	1.0130	1.0065
0.2429	58.4444	526	1.0086	0.5714	1.0086	1.0043
0.2429	58.6667	528	1.0058	0.5984	1.0058	1.0029
0.2429	58.8889	530	0.9785	0.5984	0.9785	0.9892
0.2429	59.1111	532	0.9550	0.5984	0.9550	0.9772
0.2429	59.3333	534	0.9669	0.5984	0.9669	0.9833
0.2429	59.5556	536	0.9943	0.6094	0.9943	0.9971
0.2429	59.7778	538	1.0226	0.6357	1.0226	1.0112
0.2429	60.0	540	1.0603	0.6154	1.0603	1.0297
0.2429	60.2222	542	1.0610	0.6154	1.0610	1.0300
0.2429	60.4444	544	1.0345	0.6154	1.0345	1.0171
0.2429	60.6667	546	0.9843	0.6462	0.9843	0.9921
0.2429	60.8889	548	0.9503	0.6202	0.9503	0.9749
0.2429	61.1111	550	0.9233	0.5984	0.9233	0.9609
0.2429	61.3333	552	0.9201	0.5984	0.9201	0.9592
0.2429	61.5556	554	0.9175	0.6094	0.9175	0.9579
0.2429	61.7778	556	0.9242	0.6412	0.9242	0.9614
0.2429	62.0	558	0.9362	0.6412	0.9362	0.9676
0.2429	62.2222	560	0.9371	0.6412	0.9371	0.9680
0.2429	62.4444	562	0.9530	0.6412	0.9530	0.9762
0.2429	62.6667	564	0.9636	0.6412	0.9636	0.9816
0.2429	62.8889	566	0.9769	0.6202	0.9769	0.9884
0.2429	63.1111	568	0.9882	0.5938	0.9882	0.9941
0.2429	63.3333	570	1.0103	0.5827	1.0103	1.0051
0.2429	63.5556	572	1.0249	0.5827	1.0249	1.0124
0.2429	63.7778	574	1.0286	0.5714	1.0286	1.0142
0.2429	64.0	576	1.0293	0.5714	1.0293	1.0146
0.2429	64.2222	578	1.0372	0.5714	1.0372	1.0184

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1