ArabicNewSplits7_usingWellWrittenEssays_FineTuningAraBERT_run1_AugV5_k6_task1_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 2.1023
• Qwk: 0.2302
• Mse: 2.1023
• Rmse: 1.4499

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.0769	2	6.9275	-0.0056	6.9275	2.6320
No log	0.1538	4	4.4704	0.0702	4.4704	2.1143
No log	0.2308	6	3.7767	-0.0208	3.7767	1.9434
No log	0.3077	8	4.9755	-0.0855	4.9755	2.2306
No log	0.3846	10	4.8314	-0.0889	4.8314	2.1980
No log	0.4615	12	3.2770	-0.0686	3.2770	1.8102
No log	0.5385	14	2.3898	0.0584	2.3898	1.5459
No log	0.6154	16	2.4053	0.0	2.4053	1.5509
No log	0.6923	18	2.3197	0.0305	2.3197	1.5231
No log	0.7692	20	2.0640	0.1148	2.0640	1.4367
No log	0.8462	22	1.8753	0.1379	1.8753	1.3694
No log	0.9231	24	1.8365	0.1368	1.8365	1.3552
No log	1.0	26	1.7928	0.1930	1.7928	1.3389
No log	1.0769	28	1.7491	0.0784	1.7491	1.3225
No log	1.1538	30	1.7718	0.0971	1.7718	1.3311
No log	1.2308	32	1.8360	0.0769	1.8360	1.3550
No log	1.3077	34	1.9071	0.0748	1.9071	1.3810
No log	1.3846	36	2.0981	0.1322	2.0981	1.4485
No log	1.4615	38	1.9696	0.1186	1.9696	1.4034
No log	1.5385	40	1.7876	0.1053	1.7876	1.3370
No log	1.6154	42	1.7216	0.1818	1.7216	1.3121
No log	1.6923	44	1.7784	0.0962	1.7784	1.3336
No log	1.7692	46	1.8010	0.2679	1.8010	1.3420
No log	1.8462	48	1.7625	0.2957	1.7625	1.3276
No log	1.9231	50	1.6574	0.2951	1.6574	1.2874
No log	2.0	52	1.5691	0.3651	1.5691	1.2526
No log	2.0769	54	1.5583	0.2602	1.5583	1.2483
No log	2.1538	56	1.5564	0.3636	1.5564	1.2475
No log	2.2308	58	1.8582	0.3101	1.8582	1.3632
No log	2.3077	60	1.9456	0.2985	1.9456	1.3948
No log	2.3846	62	1.7541	0.3382	1.7541	1.3244
No log	2.4615	64	1.6197	0.2689	1.6197	1.2727
No log	2.5385	66	1.6497	0.1724	1.6497	1.2844
No log	2.6154	68	1.6558	0.1739	1.6558	1.2868
No log	2.6923	70	1.6264	0.1897	1.6264	1.2753
No log	2.7692	72	1.5811	0.3577	1.5811	1.2574
No log	2.8462	74	1.5280	0.3548	1.5280	1.2361
No log	2.9231	76	1.5087	0.3548	1.5087	1.2283
No log	3.0	78	1.5833	0.3939	1.5833	1.2583
No log	3.0769	80	1.8412	0.2609	1.8412	1.3569
No log	3.1538	82	1.8000	0.2920	1.8000	1.3416
No log	3.2308	84	1.6949	0.3676	1.6949	1.3019
No log	3.3077	86	1.7790	0.3358	1.7790	1.3338
No log	3.3846	88	1.8963	0.3333	1.8963	1.3771
No log	3.4615	90	1.9345	0.2857	1.9345	1.3908
No log	3.5385	92	1.8385	0.3478	1.8385	1.3559
No log	3.6154	94	1.7298	0.3259	1.7298	1.3152
No log	3.6923	96	1.7603	0.3382	1.7603	1.3268
No log	3.7692	98	1.8919	0.3000	1.8919	1.3755
No log	3.8462	100	1.8871	0.3650	1.8871	1.3737
No log	3.9231	102	1.7185	0.3636	1.7185	1.3109
No log	4.0	104	1.5748	0.2203	1.5748	1.2549
No log	4.0769	106	1.5630	0.2903	1.5630	1.2502
No log	4.1538	108	1.6675	0.3636	1.6675	1.2913
No log	4.2308	110	1.8266	0.3066	1.8266	1.3515
No log	4.3077	112	1.8425	0.3088	1.8425	1.3574
No log	4.3846	114	1.6335	0.2992	1.6335	1.2781
No log	4.4615	116	1.4517	0.2414	1.4517	1.2049
No log	4.5385	118	1.4063	0.3423	1.4063	1.1859
No log	4.6154	120	1.4478	0.3529	1.4478	1.2032
No log	4.6923	122	1.4713	0.3415	1.4713	1.2130
No log	4.7692	124	1.4835	0.4094	1.4835	1.2180
No log	4.8462	126	1.5031	0.4186	1.5031	1.2260
No log	4.9231	128	1.5503	0.4	1.5503	1.2451
No log	5.0	130	1.5101	0.4062	1.5101	1.2289
No log	5.0769	132	1.5969	0.4	1.5969	1.2637
No log	5.1538	134	1.7464	0.3459	1.7464	1.3215
No log	5.2308	136	1.6598	0.3485	1.6598	1.2883
No log	5.3077	138	1.4752	0.3871	1.4752	1.2146
No log	5.3846	140	1.3852	0.3140	1.3852	1.1769
No log	5.4615	142	1.4471	0.3692	1.4471	1.2030
No log	5.5385	144	1.9736	0.2657	1.9736	1.4049
No log	5.6154	146	2.2646	0.2192	2.2646	1.5049
No log	5.6923	148	2.0866	0.2657	2.0866	1.4445
No log	5.7692	150	1.8099	0.3165	1.8099	1.3453
No log	5.8462	152	1.6534	0.3852	1.6534	1.2859
No log	5.9231	154	1.6880	0.3529	1.6880	1.2992
No log	6.0	156	1.9886	0.2676	1.9886	1.4102
No log	6.0769	158	2.2375	0.1549	2.2375	1.4958
No log	6.1538	160	2.1110	0.1857	2.1110	1.4529
No log	6.2308	162	1.8239	0.3235	1.8239	1.3505
No log	6.3077	164	1.7347	0.3485	1.7347	1.3171
No log	6.3846	166	1.7939	0.3235	1.7939	1.3394
No log	6.4615	168	2.0819	0.2113	2.0819	1.4429
No log	6.5385	170	2.2585	0.1806	2.2585	1.5028
No log	6.6154	172	2.1435	0.2361	2.1435	1.4641
No log	6.6923	174	1.8139	0.2734	1.8139	1.3468
No log	6.7692	176	1.6765	0.3407	1.6765	1.2948
No log	6.8462	178	1.6456	0.4	1.6456	1.2828
No log	6.9231	180	1.6312	0.3740	1.6312	1.2772
No log	7.0	182	1.7430	0.3359	1.7430	1.3202
No log	7.0769	184	1.8327	0.2794	1.8327	1.3538
No log	7.1538	186	1.8168	0.2774	1.8168	1.3479
No log	7.2308	188	1.6506	0.3308	1.6506	1.2848
No log	7.3077	190	1.3571	0.4252	1.3571	1.1650
No log	7.3846	192	1.3120	0.4	1.3120	1.1454
No log	7.4615	194	1.4381	0.4275	1.4381	1.1992
No log	7.5385	196	1.7564	0.3000	1.7564	1.3253
No log	7.6154	198	2.2107	0.2069	2.2107	1.4868
No log	7.6923	200	2.5409	-0.0292	2.5409	1.5940
No log	7.7692	202	2.5550	-0.0438	2.5550	1.5985
No log	7.8462	204	2.4114	0.0699	2.4114	1.5529
No log	7.9231	206	2.0969	0.1549	2.0969	1.4481
No log	8.0	208	1.7141	0.3235	1.7141	1.3092
No log	8.0769	210	1.4594	0.4094	1.4594	1.2080
No log	8.1538	212	1.4004	0.4	1.4004	1.1834
No log	8.2308	214	1.5184	0.4	1.5184	1.2322
No log	8.3077	216	1.7736	0.3165	1.7736	1.3318
No log	8.3846	218	1.9138	0.2083	1.9138	1.3834
No log	8.4615	220	1.8375	0.2837	1.8375	1.3555
No log	8.5385	222	1.6468	0.3111	1.6468	1.2833
No log	8.6154	224	1.5440	0.3846	1.5440	1.2426
No log	8.6923	226	1.5017	0.4390	1.5017	1.2254
No log	8.7692	228	1.4905	0.4516	1.4905	1.2209
No log	8.8462	230	1.5342	0.375	1.5342	1.2386
No log	8.9231	232	1.5819	0.3692	1.5819	1.2577
No log	9.0	234	1.6323	0.3759	1.6323	1.2776
No log	9.0769	236	1.7617	0.3043	1.7617	1.3273
No log	9.1538	238	1.7586	0.2774	1.7586	1.3261
No log	9.2308	240	1.6349	0.3817	1.6349	1.2786
No log	9.3077	242	1.5181	0.375	1.5181	1.2321
No log	9.3846	244	1.4331	0.3492	1.4331	1.1971
No log	9.4615	246	1.4270	0.3780	1.4270	1.1946
No log	9.5385	248	1.5527	0.3788	1.5527	1.2461
No log	9.6154	250	1.8277	0.2878	1.8277	1.3519
No log	9.6923	252	1.8965	0.2714	1.8965	1.3771
No log	9.7692	254	1.8916	0.2878	1.8916	1.3754
No log	9.8462	256	1.7666	0.3382	1.7666	1.3291
No log	9.9231	258	1.6458	0.3910	1.6458	1.2829
No log	10.0	260	1.6844	0.3910	1.6844	1.2978
No log	10.0769	262	1.8749	0.2609	1.8749	1.3693
No log	10.1538	264	1.9623	0.2336	1.9623	1.4008
No log	10.2308	266	2.0164	0.2174	2.0164	1.4200
No log	10.3077	268	1.9008	0.2446	1.9008	1.3787
No log	10.3846	270	1.8635	0.2899	1.8635	1.3651
No log	10.4615	272	1.8457	0.2899	1.8457	1.3586
No log	10.5385	274	1.8511	0.2899	1.8511	1.3605
No log	10.6154	276	1.7922	0.2899	1.7922	1.3387
No log	10.6923	278	1.8583	0.2899	1.8583	1.3632
No log	10.7692	280	1.7983	0.3556	1.7983	1.3410
No log	10.8462	282	1.8143	0.3382	1.8143	1.3470
No log	10.9231	284	1.8287	0.3212	1.8287	1.3523
No log	11.0	286	1.7774	0.3382	1.7774	1.3332
No log	11.0769	288	1.7852	0.3212	1.7852	1.3361
No log	11.1538	290	1.9110	0.2590	1.9110	1.3824
No log	11.2308	292	2.0481	0.2411	2.0481	1.4311
No log	11.3077	294	2.0703	0.2411	2.0703	1.4389
No log	11.3846	296	1.8326	0.2590	1.8326	1.3537
No log	11.4615	298	1.5138	0.3566	1.5138	1.2304
No log	11.5385	300	1.4477	0.3780	1.4477	1.2032
No log	11.6154	302	1.5371	0.3692	1.5371	1.2398
No log	11.6923	304	1.7766	0.2590	1.7766	1.3329
No log	11.7692	306	2.0222	0.2143	2.0222	1.4220
No log	11.8462	308	2.1366	0.1871	2.1366	1.4617
No log	11.9231	310	2.0079	0.1871	2.0079	1.4170
No log	12.0	312	1.7520	0.3511	1.7520	1.3236
No log	12.0769	314	1.5289	0.3802	1.5289	1.2365
No log	12.1538	316	1.4179	0.3898	1.4179	1.1908
No log	12.2308	318	1.3929	0.4516	1.3929	1.1802
No log	12.3077	320	1.6046	0.2963	1.6046	1.2667
No log	12.3846	322	2.0543	0.2535	2.0543	1.4333
No log	12.4615	324	2.4063	0.2270	2.4063	1.5512
No log	12.5385	326	2.4551	0.2113	2.4551	1.5669
No log	12.6154	328	2.3467	0.2113	2.3467	1.5319
No log	12.6923	330	2.1283	0.2113	2.1283	1.4589
No log	12.7692	332	1.9246	0.2446	1.9246	1.3873
No log	12.8462	334	1.7449	0.2985	1.7449	1.3210
No log	12.9231	336	1.6519	0.4132	1.6519	1.2853
No log	13.0	338	1.6722	0.4098	1.6722	1.2931
No log	13.0769	340	1.7216	0.2857	1.7216	1.3121
No log	13.1538	342	1.7916	0.2628	1.7916	1.3385
No log	13.2308	344	2.0251	0.2270	2.0251	1.4231
No log	13.3077	346	2.1530	0.2621	2.1530	1.4673
No log	13.3846	348	2.1996	0.2535	2.1996	1.4831
No log	13.4615	350	2.0259	0.2535	2.0259	1.4233
No log	13.5385	352	1.8258	0.3066	1.8258	1.3512
No log	13.6154	354	1.6659	0.3511	1.6659	1.2907
No log	13.6923	356	1.6352	0.4032	1.6352	1.2787
No log	13.7692	358	1.6428	0.4098	1.6428	1.2817
No log	13.8462	360	1.6896	0.3465	1.6896	1.2998
No log	13.9231	362	1.7458	0.3158	1.7458	1.3213
No log	14.0	364	1.8685	0.2774	1.8685	1.3669
No log	14.0769	366	1.9395	0.2429	1.9395	1.3927
No log	14.1538	368	1.8290	0.3333	1.8290	1.3524
No log	14.2308	370	1.7674	0.3235	1.7674	1.3294
No log	14.3077	372	1.6785	0.3235	1.6785	1.2956
No log	14.3846	374	1.5667	0.4091	1.5667	1.2517
No log	14.4615	376	1.5535	0.3969	1.5535	1.2464
No log	14.5385	378	1.6077	0.4091	1.6077	1.2680
No log	14.6154	380	1.6691	0.3910	1.6691	1.2919
No log	14.6923	382	1.7313	0.3235	1.7313	1.3158
No log	14.7692	384	1.7110	0.3235	1.7110	1.3080
No log	14.8462	386	1.6179	0.3969	1.6179	1.2720
No log	14.9231	388	1.6247	0.3459	1.6247	1.2747
No log	15.0	390	1.6917	0.3212	1.6917	1.3006
No log	15.0769	392	1.7400	0.3043	1.7400	1.3191
No log	15.1538	394	1.8131	0.2857	1.8131	1.3465
No log	15.2308	396	1.7250	0.3382	1.7250	1.3134
No log	15.3077	398	1.6234	0.3731	1.6234	1.2741
No log	15.3846	400	1.6672	0.3731	1.6672	1.2912
No log	15.4615	402	1.6508	0.3731	1.6508	1.2848
No log	15.5385	404	1.6605	0.3212	1.6605	1.2886
No log	15.6154	406	1.8215	0.2857	1.8215	1.3496
No log	15.6923	408	1.9213	0.2695	1.9213	1.3861
No log	15.7692	410	1.8671	0.2628	1.8671	1.3664
No log	15.8462	412	1.6789	0.3407	1.6789	1.2957
No log	15.9231	414	1.5121	0.4286	1.5121	1.2297
No log	16.0	416	1.4929	0.4640	1.4929	1.2218
No log	16.0769	418	1.5600	0.4062	1.5600	1.2490
No log	16.1538	420	1.7432	0.2815	1.7432	1.3203
No log	16.2308	422	1.9998	0.1871	1.9998	1.4141
No log	16.3077	424	2.1962	0.2000	2.1962	1.4820
No log	16.3846	426	2.2117	0.2000	2.2117	1.4872
No log	16.4615	428	2.1421	0.2000	2.1421	1.4636
No log	16.5385	430	2.0120	0.2143	2.0120	1.4185
No log	16.6154	432	1.8857	0.25	1.8857	1.3732
No log	16.6923	434	1.8615	0.2628	1.8615	1.3644
No log	16.7692	436	1.9075	0.2609	1.9075	1.3811
No log	16.8462	438	1.9806	0.2174	1.9806	1.4073
No log	16.9231	440	2.0912	0.1871	2.0912	1.4461
No log	17.0	442	2.1281	0.1871	2.1281	1.4588
No log	17.0769	444	2.0521	0.1871	2.0521	1.4325
No log	17.1538	446	1.8757	0.2464	1.8757	1.3695
No log	17.2308	448	1.6782	0.3284	1.6782	1.2954
No log	17.3077	450	1.6164	0.3759	1.6164	1.2714
No log	17.3846	452	1.6502	0.3609	1.6502	1.2846
No log	17.4615	454	1.7342	0.2920	1.7342	1.3169
No log	17.5385	456	1.7119	0.2920	1.7119	1.3084
No log	17.6154	458	1.7253	0.2920	1.7253	1.3135
No log	17.6923	460	1.7881	0.2920	1.7881	1.3372
No log	17.7692	462	1.8963	0.2143	1.8963	1.3771
No log	17.8462	464	1.8805	0.2411	1.8805	1.3713
No log	17.9231	466	1.7983	0.2571	1.7983	1.3410
No log	18.0	468	1.7421	0.2941	1.7421	1.3199
No log	18.0769	470	1.7326	0.2941	1.7326	1.3163
No log	18.1538	472	1.7824	0.2774	1.7824	1.3351
No log	18.2308	474	1.8736	0.2302	1.8736	1.3688
No log	18.3077	476	1.9124	0.2029	1.9124	1.3829
No log	18.3846	478	1.8789	0.2190	1.8789	1.3707
No log	18.4615	480	1.7623	0.2388	1.7623	1.3275
No log	18.5385	482	1.5831	0.3538	1.5831	1.2582
No log	18.6154	484	1.4844	0.4000	1.4844	1.2184
No log	18.6923	486	1.4965	0.3307	1.4965	1.2233
No log	18.7692	488	1.6275	0.3359	1.6275	1.2757
No log	18.8462	490	1.8117	0.2647	1.8117	1.3460
No log	18.9231	492	1.8712	0.2647	1.8712	1.3679
No log	19.0	494	1.7784	0.2963	1.7784	1.3336
No log	19.0769	496	1.6606	0.3636	1.6606	1.2886
No log	19.1538	498	1.6373	0.3511	1.6373	1.2796
0.3621	19.2308	500	1.6432	0.3511	1.6432	1.2819
0.3621	19.3077	502	1.6127	0.3538	1.6127	1.2699
0.3621	19.3846	504	1.6164	0.3538	1.6164	1.2714
0.3621	19.4615	506	1.7241	0.3182	1.7241	1.3131
0.3621	19.5385	508	1.8258	0.2963	1.8258	1.3512
0.3621	19.6154	510	1.9375	0.2302	1.9375	1.3919
0.3621	19.6923	512	2.0132	0.2302	2.0132	1.4189
0.3621	19.7692	514	2.1023	0.2302	2.1023	1.4499

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1