ArabicNewSplits7_usingALLEssays_FineTuningAraBERT_run3_AugV5_k2_task2_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.9876
• Qwk: 0.3199
• Mse: 0.9876
• Rmse: 0.9938

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.25	2	4.5308	-0.0132	4.5308	2.1286
No log	0.5	4	2.5370	-0.0124	2.5370	1.5928
No log	0.75	6	2.4975	-0.1115	2.4975	1.5804
No log	1.0	8	2.0698	-0.0233	2.0698	1.4387
No log	1.25	10	1.6735	0.0372	1.6735	1.2936
No log	1.5	12	1.5178	-0.0149	1.5178	1.2320
No log	1.75	14	1.3612	0.0426	1.3612	1.1667
No log	2.0	16	1.3926	0.1196	1.3926	1.1801
No log	2.25	18	1.3771	0.1288	1.3771	1.1735
No log	2.5	20	1.4008	0.1196	1.4008	1.1835
No log	2.75	22	1.4026	0.0688	1.4026	1.1843
No log	3.0	24	1.4468	0.0723	1.4468	1.2028
No log	3.25	26	1.5522	0.0317	1.5522	1.2459
No log	3.5	28	1.6170	0.0	1.6170	1.2716
No log	3.75	30	1.4985	0.0723	1.4985	1.2241
No log	4.0	32	1.4732	0.0038	1.4732	1.2137
No log	4.25	34	1.5301	0.0878	1.5301	1.2370
No log	4.5	36	1.4363	0.1404	1.4363	1.1985
No log	4.75	38	1.4120	0.1827	1.4120	1.1883
No log	5.0	40	1.2871	0.2014	1.2871	1.1345
No log	5.25	42	1.2469	0.1865	1.2469	1.1166
No log	5.5	44	1.1438	0.2589	1.1438	1.0695
No log	5.75	46	1.1072	0.2137	1.1072	1.0522
No log	6.0	48	1.1476	0.2491	1.1476	1.0713
No log	6.25	50	1.2379	0.1772	1.2379	1.1126
No log	6.5	52	1.4566	0.1334	1.4566	1.2069
No log	6.75	54	1.7109	0.1488	1.7109	1.3080
No log	7.0	56	1.9536	0.1619	1.9536	1.3977
No log	7.25	58	1.8873	0.0765	1.8873	1.3738
No log	7.5	60	1.4988	0.1659	1.4988	1.2242
No log	7.75	62	1.2174	0.2351	1.2174	1.1034
No log	8.0	64	1.0867	0.2687	1.0867	1.0425
No log	8.25	66	1.0650	0.3035	1.0650	1.0320
No log	8.5	68	1.0867	0.3035	1.0867	1.0425
No log	8.75	70	1.1072	0.3183	1.1072	1.0522
No log	9.0	72	1.1770	0.3183	1.1770	1.0849
No log	9.25	74	1.1724	0.2735	1.1724	1.0828
No log	9.5	76	1.2904	0.2507	1.2904	1.1360
No log	9.75	78	1.5222	0.2146	1.5222	1.2338
No log	10.0	80	1.5433	0.2413	1.5433	1.2423
No log	10.25	82	1.4766	0.2418	1.4766	1.2152
No log	10.5	84	1.1661	0.2890	1.1661	1.0799
No log	10.75	86	1.0403	0.4236	1.0403	1.0199
No log	11.0	88	1.0107	0.2614	1.0107	1.0053
No log	11.25	90	0.9915	0.3483	0.9915	0.9958
No log	11.5	92	0.9892	0.3541	0.9892	0.9946
No log	11.75	94	1.0884	0.3985	1.0884	1.0433
No log	12.0	96	1.1776	0.3005	1.1776	1.0852
No log	12.25	98	1.0761	0.4248	1.0761	1.0374
No log	12.5	100	0.9896	0.3486	0.9896	0.9948
No log	12.75	102	0.9521	0.4158	0.9521	0.9758
No log	13.0	104	0.9540	0.3596	0.9540	0.9767
No log	13.25	106	0.9844	0.4213	0.9844	0.9922
No log	13.5	108	1.0736	0.3739	1.0736	1.0362
No log	13.75	110	1.0895	0.3430	1.0895	1.0438
No log	14.0	112	1.0226	0.4033	1.0226	1.0112
No log	14.25	114	0.9797	0.4135	0.9797	0.9898
No log	14.5	116	0.9261	0.3814	0.9261	0.9624
No log	14.75	118	0.9450	0.4393	0.9450	0.9721
No log	15.0	120	0.9828	0.3433	0.9828	0.9913
No log	15.25	122	1.2611	0.2823	1.2611	1.1230
No log	15.5	124	1.4279	0.3248	1.4279	1.1949
No log	15.75	126	1.2609	0.2716	1.2609	1.1229
No log	16.0	128	1.1001	0.2461	1.1001	1.0489
No log	16.25	130	1.0860	0.2759	1.0860	1.0421
No log	16.5	132	1.1606	0.2824	1.1606	1.0773
No log	16.75	134	1.2140	0.2731	1.2140	1.1018
No log	17.0	136	1.1191	0.3149	1.1191	1.0579
No log	17.25	138	1.0471	0.3723	1.0471	1.0233
No log	17.5	140	1.0143	0.3601	1.0143	1.0071
No log	17.75	142	1.0077	0.4013	1.0077	1.0038
No log	18.0	144	0.9613	0.4450	0.9613	0.9804
No log	18.25	146	1.0456	0.3243	1.0456	1.0225
No log	18.5	148	1.0878	0.3763	1.0878	1.0430
No log	18.75	150	0.9877	0.3965	0.9877	0.9938
No log	19.0	152	0.9587	0.4646	0.9587	0.9791
No log	19.25	154	0.9744	0.4493	0.9744	0.9871
No log	19.5	156	0.9632	0.4898	0.9632	0.9814
No log	19.75	158	0.9764	0.4609	0.9764	0.9881
No log	20.0	160	0.9838	0.4609	0.9838	0.9919
No log	20.25	162	0.9898	0.4995	0.9898	0.9949
No log	20.5	164	1.0125	0.4013	1.0125	1.0062
No log	20.75	166	1.0015	0.4540	1.0015	1.0007
No log	21.0	168	1.0087	0.3596	1.0087	1.0043
No log	21.25	170	1.0598	0.2851	1.0598	1.0295
No log	21.5	172	1.0729	0.3280	1.0729	1.0358
No log	21.75	174	1.0245	0.3596	1.0245	1.0122
No log	22.0	176	1.0141	0.3692	1.0141	1.0070
No log	22.25	178	1.0226	0.3692	1.0226	1.0112
No log	22.5	180	1.0632	0.3059	1.0632	1.0311
No log	22.75	182	1.0696	0.3433	1.0696	1.0342
No log	23.0	184	1.0689	0.3433	1.0689	1.0339
No log	23.25	186	1.0599	0.3179	1.0599	1.0295
No log	23.5	188	1.0564	0.3199	1.0564	1.0278
No log	23.75	190	1.0740	0.3418	1.0740	1.0363
No log	24.0	192	1.1258	0.3701	1.1258	1.0610
No log	24.25	194	1.0621	0.3433	1.0621	1.0306
No log	24.5	196	1.0245	0.3107	1.0245	1.0122
No log	24.75	198	1.0289	0.3293	1.0289	1.0144
No log	25.0	200	1.0404	0.2158	1.0404	1.0200
No log	25.25	202	1.0833	0.3157	1.0833	1.0408
No log	25.5	204	1.1102	0.2864	1.1102	1.0537
No log	25.75	206	1.0750	0.3157	1.0750	1.0368
No log	26.0	208	1.0433	0.3210	1.0433	1.0214
No log	26.25	210	1.0488	0.2665	1.0488	1.0241
No log	26.5	212	1.0982	0.3402	1.0982	1.0480
No log	26.75	214	1.1545	0.2609	1.1545	1.0745
No log	27.0	216	1.2579	0.2833	1.2579	1.1215
No log	27.25	218	1.1934	0.3071	1.1934	1.0924
No log	27.5	220	1.0486	0.3338	1.0486	1.0240
No log	27.75	222	1.0009	0.3821	1.0009	1.0004
No log	28.0	224	1.0240	0.3154	1.0240	1.0119
No log	28.25	226	1.0907	0.3010	1.0907	1.0444
No log	28.5	228	1.1315	0.3173	1.1315	1.0637
No log	28.75	230	1.1164	0.2748	1.1164	1.0566
No log	29.0	232	1.0631	0.3059	1.0631	1.0311
No log	29.25	234	1.0544	0.3059	1.0544	1.0269
No log	29.5	236	1.0716	0.2824	1.0716	1.0352
No log	29.75	238	1.1387	0.3007	1.1387	1.0671
No log	30.0	240	1.1421	0.3007	1.1421	1.0687
No log	30.25	242	1.0908	0.2796	1.0908	1.0444
No log	30.5	244	1.1074	0.2870	1.1074	1.0524
No log	30.75	246	1.1352	0.2762	1.1352	1.0655
No log	31.0	248	1.1204	0.2916	1.1204	1.0585
No log	31.25	250	1.1053	0.2891	1.1053	1.0513
No log	31.5	252	1.1145	0.2815	1.1145	1.0557
No log	31.75	254	1.0993	0.2844	1.0993	1.0485
No log	32.0	256	1.0471	0.2988	1.0471	1.0233
No log	32.25	258	1.0427	0.3086	1.0427	1.0211
No log	32.5	260	1.0736	0.2618	1.0736	1.0361
No log	32.75	262	1.1176	0.2560	1.1176	1.0572
No log	33.0	264	1.1909	0.3052	1.1909	1.0913
No log	33.25	266	1.2371	0.2411	1.2371	1.1122
No log	33.5	268	1.1636	0.2609	1.1636	1.0787
No log	33.75	270	1.0911	0.2665	1.0911	1.0445
No log	34.0	272	1.0917	0.2665	1.0917	1.0448
No log	34.25	274	1.1309	0.3321	1.1309	1.0634
No log	34.5	276	1.1481	0.3750	1.1481	1.0715
No log	34.75	278	1.1650	0.3424	1.1650	1.0793
No log	35.0	280	1.2577	0.3127	1.2577	1.1215
No log	35.25	282	1.3681	0.3159	1.3681	1.1696
No log	35.5	284	1.3199	0.3159	1.3199	1.1489
No log	35.75	286	1.2157	0.3152	1.2157	1.1026
No log	36.0	288	1.0826	0.3199	1.0826	1.0405
No log	36.25	290	1.0281	0.3263	1.0281	1.0139
No log	36.5	292	1.0189	0.3263	1.0189	1.0094
No log	36.75	294	1.0297	0.3086	1.0297	1.0147
No log	37.0	296	1.0977	0.3665	1.0977	1.0477
No log	37.25	298	1.2050	0.2918	1.2050	1.0977
No log	37.5	300	1.1999	0.2918	1.1999	1.0954
No log	37.75	302	1.1359	0.3314	1.1359	1.0658
No log	38.0	304	1.0609	0.3406	1.0609	1.0300
No log	38.25	306	1.0437	0.3406	1.0437	1.0216
No log	38.5	308	1.0653	0.3406	1.0653	1.0321
No log	38.75	310	1.1643	0.3355	1.1643	1.0790
No log	39.0	312	1.2252	0.2983	1.2252	1.1069
No log	39.25	314	1.1639	0.3497	1.1639	1.0788
No log	39.5	316	1.0562	0.3448	1.0562	1.0277
No log	39.75	318	1.0014	0.3639	1.0014	1.0007
No log	40.0	320	1.0004	0.4141	1.0004	1.0002
No log	40.25	322	1.0040	0.3838	1.0040	1.0020
No log	40.5	324	1.0193	0.3500	1.0193	1.0096
No log	40.75	326	1.0390	0.3250	1.0390	1.0193
No log	41.0	328	1.0668	0.2777	1.0668	1.0329
No log	41.25	330	1.0707	0.2700	1.0707	1.0347
No log	41.5	332	1.0523	0.3036	1.0523	1.0258
No log	41.75	334	1.0364	0.3126	1.0364	1.0180
No log	42.0	336	1.0404	0.3126	1.0404	1.0200
No log	42.25	338	1.0640	0.3126	1.0640	1.0315
No log	42.5	340	1.0851	0.3231	1.0851	1.0417
No log	42.75	342	1.0918	0.3231	1.0918	1.0449
No log	43.0	344	1.0476	0.3126	1.0476	1.0235
No log	43.25	346	1.0235	0.3371	1.0235	1.0117
No log	43.5	348	1.0229	0.3371	1.0229	1.0114
No log	43.75	350	1.0571	0.3625	1.0571	1.0281
No log	44.0	352	1.1547	0.3052	1.1547	1.0746
No log	44.25	354	1.2030	0.3113	1.2030	1.0968
No log	44.5	356	1.1641	0.3380	1.1641	1.0789
No log	44.75	358	1.0872	0.3466	1.0872	1.0427
No log	45.0	360	1.0147	0.3199	1.0147	1.0073
No log	45.25	362	0.9933	0.3583	0.9933	0.9966
No log	45.5	364	0.9959	0.3879	0.9959	0.9980
No log	45.75	366	1.0185	0.3371	1.0185	1.0092
No log	46.0	368	1.1037	0.3255	1.1037	1.0506
No log	46.25	370	1.2389	0.3166	1.2389	1.1130
No log	46.5	372	1.2834	0.3166	1.2834	1.1329
No log	46.75	374	1.2483	0.2833	1.2483	1.1173
No log	47.0	376	1.1530	0.2718	1.1530	1.0738
No log	47.25	378	1.0826	0.3133	1.0826	1.0405
No log	47.5	380	1.0476	0.2665	1.0476	1.0235
No log	47.75	382	1.0329	0.2764	1.0329	1.0163
No log	48.0	384	1.0286	0.2864	1.0286	1.0142
No log	48.25	386	1.0332	0.3086	1.0332	1.0165
No log	48.5	388	1.0538	0.2942	1.0538	1.0266
No log	48.75	390	1.0895	0.2851	1.0895	1.0438
No log	49.0	392	1.1437	0.3497	1.1437	1.0695
No log	49.25	394	1.1454	0.3497	1.1454	1.0702
No log	49.5	396	1.1095	0.3142	1.1095	1.0533
No log	49.75	398	1.0654	0.2851	1.0654	1.0322
No log	50.0	400	1.0497	0.3262	1.0497	1.0245
No log	50.25	402	1.0359	0.3262	1.0359	1.0178
No log	50.5	404	1.0359	0.3355	1.0359	1.0178
No log	50.75	406	1.0469	0.3355	1.0469	1.0232
No log	51.0	408	1.0602	0.3262	1.0602	1.0297
No log	51.25	410	1.0820	0.2851	1.0820	1.0402
No log	51.5	412	1.1048	0.2851	1.1048	1.0511
No log	51.75	414	1.0922	0.2851	1.0922	1.0451
No log	52.0	416	1.0805	0.2851	1.0805	1.0395
No log	52.25	418	1.0907	0.2851	1.0907	1.0444
No log	52.5	420	1.1051	0.2534	1.1051	1.0512
No log	52.75	422	1.0919	0.2851	1.0919	1.0449
No log	53.0	424	1.0953	0.2851	1.0953	1.0466
No log	53.25	426	1.1042	0.2851	1.1042	1.0508
No log	53.5	428	1.1115	0.2986	1.1115	1.0543
No log	53.75	430	1.1016	0.2851	1.1016	1.0496
No log	54.0	432	1.0984	0.3231	1.0984	1.0480
No log	54.25	434	1.0851	0.3099	1.0851	1.0417
No log	54.5	436	1.0389	0.3504	1.0389	1.0193
No log	54.75	438	1.0245	0.3504	1.0245	1.0122
No log	55.0	440	1.0248	0.3504	1.0248	1.0123
No log	55.25	442	1.0270	0.2942	1.0270	1.0134
No log	55.5	444	1.0338	0.2942	1.0338	1.0167
No log	55.75	446	1.0396	0.2942	1.0396	1.0196
No log	56.0	448	1.0392	0.2942	1.0392	1.0194
No log	56.25	450	1.0332	0.2871	1.0332	1.0165
No log	56.5	452	1.0313	0.3199	1.0313	1.0156
No log	56.75	454	1.0258	0.3230	1.0258	1.0128
No log	57.0	456	1.0179	0.3230	1.0179	1.0089
No log	57.25	458	1.0171	0.3086	1.0171	1.0085
No log	57.5	460	1.0168	0.3086	1.0168	1.0084
No log	57.75	462	1.0192	0.3154	1.0192	1.0095
No log	58.0	464	1.0324	0.3154	1.0324	1.0161
No log	58.25	466	1.0566	0.3262	1.0566	1.0279
No log	58.5	468	1.0979	0.2964	1.0979	1.0478
No log	58.75	470	1.1168	0.3497	1.1168	1.0568
No log	59.0	472	1.1044	0.3157	1.1044	1.0509
No log	59.25	474	1.0891	0.3546	1.0891	1.0436
No log	59.5	476	1.0534	0.3078	1.0534	1.0263
No log	59.75	478	1.0053	0.3371	1.0053	1.0026
No log	60.0	480	0.9807	0.3596	0.9807	0.9903
No log	60.25	482	0.9825	0.3738	0.9825	0.9912
No log	60.5	484	0.9892	0.3541	0.9892	0.9946
No log	60.75	486	0.9994	0.3086	0.9994	0.9997
No log	61.0	488	1.0244	0.2871	1.0244	1.0121
No log	61.25	490	1.0615	0.2986	1.0615	1.0303
No log	61.5	492	1.0777	0.2670	1.0777	1.0381
No log	61.75	494	1.0740	0.2670	1.0740	1.0363
No log	62.0	496	1.0476	0.2986	1.0476	1.0235
No log	62.25	498	1.0143	0.3262	1.0143	1.0071
0.2399	62.5	500	0.9926	0.3250	0.9926	0.9963
0.2399	62.75	502	0.9824	0.3250	0.9824	0.9912
0.2399	63.0	504	0.9765	0.3346	0.9765	0.9882
0.2399	63.25	506	0.9792	0.3346	0.9792	0.9896
0.2399	63.5	508	0.9906	0.3312	0.9906	0.9953
0.2399	63.75	510	0.9940	0.3312	0.9940	0.9970
0.2399	64.0	512	0.9922	0.3312	0.9922	0.9961
0.2399	64.25	514	0.9881	0.3250	0.9881	0.9941
0.2399	64.5	516	0.9796	0.3250	0.9796	0.9897
0.2399	64.75	518	0.9756	0.3541	0.9756	0.9877
0.2399	65.0	520	0.9754	0.3830	0.9754	0.9876
0.2399	65.25	522	0.9785	0.3382	0.9785	0.9892
0.2399	65.5	524	0.9848	0.3184	0.9848	0.9924
0.2399	65.75	526	0.9952	0.2988	0.9952	0.9976
0.2399	66.0	528	0.9959	0.3199	0.9959	0.9980
0.2399	66.25	530	0.9920	0.3199	0.9920	0.9960
0.2399	66.5	532	0.9876	0.3199	0.9876	0.9938

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1