ArabicNewSplits7_FineTuningAraBERT_run2_AugV5_k1_task5_organization

This model is a fine-tuned version of aubmindlab/bert-base-arabertv02 on the None dataset. It achieves the following results on the evaluation set:

• Loss: 0.6515
• Qwk: 0.5578
• Mse: 0.6515
• Rmse: 0.8072

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 2e-05
• train_batch_size: 8
• eval_batch_size: 8
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 100

Training results

Training Loss	Epoch	Step	Validation Loss	Qwk	Mse	Rmse
No log	0.4	2	4.0923	0.0	4.0923	2.0229
No log	0.8	4	2.9759	-0.0242	2.9759	1.7251
No log	1.2	6	1.4468	0.0	1.4468	1.2028
No log	1.6	8	1.0334	0.2857	1.0334	1.0166
No log	2.0	10	0.9606	0.2544	0.9606	0.9801
No log	2.4	12	1.0353	0.1962	1.0353	1.0175
No log	2.8	14	1.1293	0.1361	1.1293	1.0627
No log	3.2	16	1.0317	0.1997	1.0317	1.0157
No log	3.6	18	0.8784	0.3162	0.8784	0.9373
No log	4.0	20	0.7874	0.3821	0.7874	0.8874
No log	4.4	22	0.7384	0.4660	0.7384	0.8593
No log	4.8	24	0.9148	0.3944	0.9148	0.9565
No log	5.2	26	0.9277	0.4560	0.9277	0.9632
No log	5.6	28	0.6802	0.5725	0.6802	0.8247
No log	6.0	30	0.6621	0.6197	0.6621	0.8137
No log	6.4	32	0.6916	0.6235	0.6916	0.8316
No log	6.8	34	0.7129	0.6120	0.7129	0.8444
No log	7.2	36	0.7368	0.6241	0.7368	0.8583
No log	7.6	38	0.8262	0.6089	0.8262	0.9089
No log	8.0	40	0.9690	0.4894	0.9690	0.9844
No log	8.4	42	0.8814	0.5727	0.8814	0.9388
No log	8.8	44	0.8681	0.5026	0.8681	0.9317
No log	9.2	46	0.7804	0.6019	0.7804	0.8834
No log	9.6	48	0.7676	0.6242	0.7676	0.8761
No log	10.0	50	0.6799	0.5898	0.6799	0.8245
No log	10.4	52	0.6863	0.6094	0.6863	0.8284
No log	10.8	54	0.7178	0.5815	0.7178	0.8472
No log	11.2	56	0.8726	0.5965	0.8726	0.9341
No log	11.6	58	0.8296	0.6225	0.8296	0.9108
No log	12.0	60	0.9171	0.5896	0.9171	0.9576
No log	12.4	62	0.7419	0.6239	0.7419	0.8614
No log	12.8	64	0.6620	0.6197	0.6620	0.8136
No log	13.2	66	0.6618	0.6160	0.6618	0.8135
No log	13.6	68	0.8944	0.5948	0.8944	0.9457
No log	14.0	70	0.8615	0.5896	0.8615	0.9282
No log	14.4	72	0.6340	0.6042	0.6340	0.7963
No log	14.8	74	0.6028	0.6695	0.6028	0.7764
No log	15.2	76	0.6113	0.6695	0.6113	0.7818
No log	15.6	78	0.6103	0.6022	0.6103	0.7812
No log	16.0	80	0.7449	0.5988	0.7449	0.8631
No log	16.4	82	0.7361	0.5988	0.7361	0.8580
No log	16.8	84	0.6563	0.5945	0.6563	0.8101
No log	17.2	86	0.6118	0.6160	0.6118	0.7822
No log	17.6	88	0.5946	0.6244	0.5946	0.7711
No log	18.0	90	0.6268	0.6598	0.6268	0.7917
No log	18.4	92	0.6063	0.6482	0.6063	0.7787
No log	18.8	94	0.5969	0.6383	0.5969	0.7726
No log	19.2	96	0.5764	0.6244	0.5764	0.7592
No log	19.6	98	0.6075	0.6005	0.6075	0.7794
No log	20.0	100	0.7462	0.6136	0.7462	0.8639
No log	20.4	102	0.7146	0.6126	0.7146	0.8453
No log	20.8	104	0.5959	0.6022	0.5959	0.7719
No log	21.2	106	0.6028	0.6872	0.6028	0.7764
No log	21.6	108	0.6379	0.7155	0.6379	0.7987
No log	22.0	110	0.6157	0.6215	0.6157	0.7847
No log	22.4	112	0.7478	0.6067	0.7478	0.8648
No log	22.8	114	0.9174	0.6157	0.9174	0.9578
No log	23.2	116	0.8441	0.6002	0.8441	0.9187
No log	23.6	118	0.6946	0.6051	0.6946	0.8334
No log	24.0	120	0.6810	0.6471	0.6810	0.8253
No log	24.4	122	0.6469	0.6570	0.6469	0.8043
No log	24.8	124	0.6075	0.6051	0.6075	0.7794
No log	25.2	126	0.6577	0.5536	0.6577	0.8110
No log	25.6	128	0.6862	0.6461	0.6862	0.8284
No log	26.0	130	0.6678	0.5578	0.6678	0.8172
No log	26.4	132	0.6490	0.6129	0.6490	0.8056
No log	26.8	134	0.6686	0.6298	0.6686	0.8177
No log	27.2	136	0.6978	0.5657	0.6978	0.8354
No log	27.6	138	0.8517	0.6038	0.8517	0.9229
No log	28.0	140	0.9437	0.5712	0.9437	0.9715
No log	28.4	142	0.8215	0.6022	0.8215	0.9064
No log	28.8	144	0.6701	0.5470	0.6701	0.8186
No log	29.2	146	0.6647	0.6479	0.6647	0.8153
No log	29.6	148	0.6618	0.6900	0.6618	0.8135
No log	30.0	150	0.6549	0.6112	0.6549	0.8092
No log	30.4	152	0.7517	0.6026	0.7517	0.8670
No log	30.8	154	0.7624	0.6193	0.7624	0.8732
No log	31.2	156	0.6756	0.5466	0.6756	0.8219
No log	31.6	158	0.6638	0.5859	0.6638	0.8147
No log	32.0	160	0.7097	0.6005	0.7097	0.8424
No log	32.4	162	0.7151	0.5462	0.7151	0.8457
No log	32.8	164	0.6983	0.5470	0.6983	0.8357
No log	33.2	166	0.6616	0.5955	0.6616	0.8134
No log	33.6	168	0.6569	0.5955	0.6569	0.8105
No log	34.0	170	0.6558	0.5567	0.6558	0.8098
No log	34.4	172	0.6679	0.5470	0.6679	0.8172
No log	34.8	174	0.6897	0.5275	0.6897	0.8305
No log	35.2	176	0.6970	0.5470	0.6970	0.8349
No log	35.6	178	0.7396	0.5593	0.7396	0.8600
No log	36.0	180	0.7888	0.5862	0.7888	0.8881
No log	36.4	182	0.7546	0.5698	0.7546	0.8687
No log	36.8	184	0.6774	0.5859	0.6774	0.8230
No log	37.2	186	0.6380	0.5955	0.6380	0.7987
No log	37.6	188	0.6222	0.5895	0.6222	0.7888
No log	38.0	190	0.6044	0.6051	0.6044	0.7775
No log	38.4	192	0.5981	0.6041	0.5981	0.7733
No log	38.8	194	0.6066	0.6138	0.6066	0.7789
No log	39.2	196	0.6333	0.5955	0.6333	0.7958
No log	39.6	198	0.6592	0.5859	0.6592	0.8119
No log	40.0	200	0.7012	0.5835	0.7012	0.8374
No log	40.4	202	0.6785	0.5686	0.6785	0.8237
No log	40.8	204	0.6494	0.5859	0.6494	0.8059
No log	41.2	206	0.6379	0.6341	0.6379	0.7987
No log	41.6	208	0.6314	0.6041	0.6314	0.7946
No log	42.0	210	0.6383	0.5859	0.6383	0.7989
No log	42.4	212	0.6757	0.5678	0.6757	0.8220
No log	42.8	214	0.7189	0.6575	0.7189	0.8479
No log	43.2	216	0.7168	0.6041	0.7168	0.8466
No log	43.6	218	0.6857	0.6303	0.6857	0.8281
No log	44.0	220	0.6666	0.5927	0.6666	0.8164
No log	44.4	222	0.6281	0.5955	0.6281	0.7925
No log	44.8	224	0.6088	0.5955	0.6088	0.7803
No log	45.2	226	0.6131	0.6215	0.6131	0.7830
No log	45.6	228	0.6487	0.6154	0.6487	0.8054
No log	46.0	230	0.6513	0.6154	0.6513	0.8070
No log	46.4	232	0.6342	0.5784	0.6342	0.7964
No log	46.8	234	0.6285	0.5955	0.6285	0.7928
No log	47.2	236	0.6358	0.6051	0.6358	0.7974
No log	47.6	238	0.6464	0.5567	0.6464	0.8040
No log	48.0	240	0.6563	0.5805	0.6563	0.8101
No log	48.4	242	0.6979	0.5676	0.6979	0.8354
No log	48.8	244	0.7240	0.5688	0.7240	0.8509
No log	49.2	246	0.7107	0.6014	0.7107	0.8430
No log	49.6	248	0.6508	0.5915	0.6508	0.8067
No log	50.0	250	0.6156	0.5945	0.6156	0.7846
No log	50.4	252	0.6187	0.6041	0.6187	0.7866
No log	50.8	254	0.6143	0.5945	0.6143	0.7838
No log	51.2	256	0.6230	0.6051	0.6230	0.7893
No log	51.6	258	0.6644	0.5773	0.6644	0.8151
No log	52.0	260	0.6959	0.6045	0.6959	0.8342
No log	52.4	262	0.6643	0.6244	0.6643	0.8151
No log	52.8	264	0.6314	0.5470	0.6314	0.7946
No log	53.2	266	0.6270	0.5567	0.6270	0.7919
No log	53.6	268	0.6287	0.5955	0.6287	0.7929
No log	54.0	270	0.6263	0.5955	0.6263	0.7914
No log	54.4	272	0.6212	0.5955	0.6212	0.7882
No log	54.8	274	0.6209	0.5955	0.6209	0.7880
No log	55.2	276	0.6174	0.5955	0.6174	0.7857
No log	55.6	278	0.6037	0.5955	0.6037	0.7769
No log	56.0	280	0.5960	0.5955	0.5960	0.7720
No log	56.4	282	0.6004	0.5849	0.6004	0.7748
No log	56.8	284	0.6211	0.5921	0.6211	0.7881
No log	57.2	286	0.6554	0.5795	0.6554	0.8095
No log	57.6	288	0.6765	0.5968	0.6765	0.8225
No log	58.0	290	0.6866	0.6014	0.6866	0.8286
No log	58.4	292	0.6783	0.6014	0.6783	0.8236
No log	58.8	294	0.6624	0.6014	0.6624	0.8139
No log	59.2	296	0.6574	0.5783	0.6574	0.8108
No log	59.6	298	0.6339	0.5794	0.6339	0.7962
No log	60.0	300	0.6330	0.5794	0.6330	0.7956
No log	60.4	302	0.6321	0.5466	0.6321	0.7950
No log	60.8	304	0.6313	0.5941	0.6313	0.7945
No log	61.2	306	0.6325	0.5941	0.6325	0.7953
No log	61.6	308	0.6376	0.5941	0.6376	0.7985
No log	62.0	310	0.6306	0.5955	0.6306	0.7941
No log	62.4	312	0.6280	0.5955	0.6280	0.7925
No log	62.8	314	0.6401	0.5667	0.6401	0.8001
No log	63.2	316	0.6637	0.5688	0.6637	0.8147
No log	63.6	318	0.6779	0.5876	0.6779	0.8233
No log	64.0	320	0.6784	0.5688	0.6784	0.8237
No log	64.4	322	0.6632	0.5169	0.6632	0.8144
No log	64.8	324	0.6536	0.5955	0.6536	0.8084
No log	65.2	326	0.6456	0.5955	0.6456	0.8035
No log	65.6	328	0.6355	0.5955	0.6355	0.7972
No log	66.0	330	0.6255	0.5955	0.6255	0.7909
No log	66.4	332	0.6165	0.5567	0.6165	0.7852
No log	66.8	334	0.6193	0.5817	0.6193	0.7869
No log	67.2	336	0.6214	0.5567	0.6214	0.7883
No log	67.6	338	0.6265	0.5567	0.6265	0.7915
No log	68.0	340	0.6395	0.5567	0.6395	0.7997
No log	68.4	342	0.6565	0.5167	0.6565	0.8102
No log	68.8	344	0.6698	0.5169	0.6698	0.8184
No log	69.2	346	0.6914	0.5576	0.6914	0.8315
No log	69.6	348	0.6911	0.5576	0.6911	0.8313
No log	70.0	350	0.6721	0.5369	0.6721	0.8198
No log	70.4	352	0.6583	0.5369	0.6583	0.8114
No log	70.8	354	0.6408	0.5859	0.6408	0.8005
No log	71.2	356	0.6286	0.5859	0.6286	0.7929
No log	71.6	358	0.6275	0.5470	0.6275	0.7921
No log	72.0	360	0.6272	0.5470	0.6272	0.7920
No log	72.4	362	0.6302	0.5470	0.6302	0.7938
No log	72.8	364	0.6334	0.5695	0.6334	0.7959
No log	73.2	366	0.6261	0.5470	0.6261	0.7912
No log	73.6	368	0.6234	0.5567	0.6234	0.7895
No log	74.0	370	0.6197	0.5567	0.6197	0.7872
No log	74.4	372	0.6183	0.5665	0.6183	0.7863
No log	74.8	374	0.6214	0.5567	0.6214	0.7883
No log	75.2	376	0.6263	0.5470	0.6263	0.7914
No log	75.6	378	0.6328	0.5470	0.6328	0.7955
No log	76.0	380	0.6417	0.5470	0.6417	0.8010
No log	76.4	382	0.6586	0.5589	0.6586	0.8115
No log	76.8	384	0.6868	0.5936	0.6868	0.8287
No log	77.2	386	0.7137	0.6126	0.7137	0.8448
No log	77.6	388	0.7146	0.5864	0.7146	0.8453
No log	78.0	390	0.6957	0.5773	0.6957	0.8341
No log	78.4	392	0.6797	0.6063	0.6797	0.8244
No log	78.8	394	0.6616	0.5572	0.6616	0.8134
No log	79.2	396	0.6436	0.5572	0.6436	0.8022
No log	79.6	398	0.6338	0.5572	0.6338	0.7961
No log	80.0	400	0.6360	0.5706	0.6360	0.7975
No log	80.4	402	0.6403	0.5940	0.6403	0.8002
No log	80.8	404	0.6388	0.5706	0.6388	0.7992
No log	81.2	406	0.6357	0.5706	0.6357	0.7973
No log	81.6	408	0.6284	0.5578	0.6284	0.7927
No log	82.0	410	0.6245	0.5470	0.6245	0.7902
No log	82.4	412	0.6222	0.5859	0.6222	0.7888
No log	82.8	414	0.6242	0.5955	0.6242	0.7901
No log	83.2	416	0.6263	0.5859	0.6263	0.7914
No log	83.6	418	0.6289	0.5859	0.6289	0.7930
No log	84.0	420	0.6331	0.5859	0.6331	0.7957
No log	84.4	422	0.6397	0.5578	0.6397	0.7998
No log	84.8	424	0.6455	0.5686	0.6455	0.8034
No log	85.2	426	0.6472	0.5686	0.6472	0.8045
No log	85.6	428	0.6514	0.5686	0.6514	0.8071
No log	86.0	430	0.6533	0.5686	0.6533	0.8083
No log	86.4	432	0.6555	0.5686	0.6555	0.8096
No log	86.8	434	0.6587	0.5686	0.6587	0.8116
No log	87.2	436	0.6624	0.5678	0.6624	0.8139
No log	87.6	438	0.6637	0.5572	0.6637	0.8147
No log	88.0	440	0.6626	0.5572	0.6626	0.8140
No log	88.4	442	0.6575	0.5578	0.6575	0.8109
No log	88.8	444	0.6545	0.5578	0.6545	0.8090
No log	89.2	446	0.6570	0.5578	0.6570	0.8106
No log	89.6	448	0.6618	0.5578	0.6618	0.8135
No log	90.0	450	0.6628	0.5572	0.6628	0.8141
No log	90.4	452	0.6682	0.5678	0.6682	0.8174
No log	90.8	454	0.6746	0.5382	0.6746	0.8213
No log	91.2	456	0.6769	0.5382	0.6769	0.8228
No log	91.6	458	0.6759	0.5382	0.6759	0.8221
No log	92.0	460	0.6714	0.5382	0.6714	0.8194
No log	92.4	462	0.6643	0.5678	0.6643	0.8151
No log	92.8	464	0.6616	0.5578	0.6616	0.8134
No log	93.2	466	0.6615	0.5686	0.6615	0.8133
No log	93.6	468	0.6605	0.5686	0.6605	0.8127
No log	94.0	470	0.6578	0.5578	0.6578	0.8110
No log	94.4	472	0.6567	0.5578	0.6567	0.8104
No log	94.8	474	0.6548	0.5578	0.6548	0.8092
No log	95.2	476	0.6524	0.5578	0.6524	0.8077
No log	95.6	478	0.6499	0.5578	0.6499	0.8061
No log	96.0	480	0.6469	0.5578	0.6469	0.8043
No log	96.4	482	0.6449	0.5578	0.6449	0.8030
No log	96.8	484	0.6441	0.5578	0.6441	0.8025
No log	97.2	486	0.6450	0.5578	0.6450	0.8031
No log	97.6	488	0.6464	0.5578	0.6464	0.8040
No log	98.0	490	0.6479	0.5578	0.6479	0.8049
No log	98.4	492	0.6488	0.5578	0.6488	0.8055
No log	98.8	494	0.6498	0.5578	0.6498	0.8061
No log	99.2	496	0.6506	0.5578	0.6506	0.8066
No log	99.6	498	0.6512	0.5578	0.6512	0.8070
0.1647	100.0	500	0.6515	0.5578	0.6515	0.8072

Framework versions

• Transformers 4.44.2
• Pytorch 2.4.0+cu118
• Datasets 2.21.0
• Tokenizers 0.19.1