segformer-b4-finetuned-segments-pv

This model is a fine-tuned version of nvidia/mit-b4 on the mouadenna/satellite_PV_dataset_train_test dataset. It achieves the following results on the evaluation set:

• Loss: 0.0068
• Mean Iou: 0.9132
• Mean Accuracy: 0.9437
• Overall Accuracy: 0.9978
• Accuracy Unlabeled: 0.9991
• Accuracy Pv: 0.8883
• Iou Unlabeled: 0.9978
• Iou Pv: 0.8286

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 6e-05
• train_batch_size: 1
• eval_batch_size: 1
• seed: 42
• optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
• lr_scheduler_type: linear
• num_epochs: 1

Training results

Training Loss	Epoch	Step	Validation Loss	Mean Iou	Mean Accuracy	Overall Accuracy	Accuracy Unlabeled	Accuracy Pv	Iou Unlabeled	Iou Pv
0.3649	0.0055	20	0.3057	0.6051	0.8096	0.9751	0.9791	0.6401	0.9749	0.2353
0.2061	0.0109	40	0.0965	0.7760	0.8850	0.9927	0.9953	0.7746	0.9926	0.5595
0.0522	0.0164	60	0.0797	0.7319	0.9555	0.9878	0.9886	0.9225	0.9877	0.4761
0.0557	0.0218	80	0.0310	0.8324	0.8875	0.9954	0.9981	0.7770	0.9954	0.6694
0.0624	0.0273	100	0.0337	0.8012	0.8240	0.9950	0.9992	0.6487	0.9949	0.6074
0.0351	0.0327	120	0.0258	0.8310	0.8980	0.9952	0.9976	0.7984	0.9952	0.6667
0.0779	0.0382	140	0.0235	0.8142	0.8502	0.9951	0.9987	0.7018	0.9951	0.6333
0.0378	0.0436	160	0.0210	0.8107	0.8409	0.9951	0.9989	0.6830	0.9951	0.6264
0.0272	0.0491	180	0.0198	0.8243	0.8494	0.9956	0.9991	0.6997	0.9955	0.6532
0.0085	0.0546	200	0.0203	0.8300	0.8701	0.9955	0.9986	0.7417	0.9955	0.6644
0.008	0.0600	220	0.0178	0.8482	0.9149	0.9957	0.9977	0.8322	0.9957	0.7007
0.008	0.0655	240	0.0205	0.8323	0.9299	0.9949	0.9965	0.8633	0.9948	0.6697
0.0099	0.0709	260	0.0173	0.8340	0.8587	0.9958	0.9992	0.7181	0.9958	0.6723
0.0243	0.0764	280	0.0160	0.8504	0.9401	0.9956	0.9969	0.8832	0.9955	0.7052
0.0222	0.0818	300	0.0292	0.6962	0.7012	0.9928	0.9999	0.4025	0.9927	0.3997
0.0062	0.0873	320	0.0155	0.8374	0.8632	0.9959	0.9991	0.7272	0.9958	0.6790
0.0049	0.0927	340	0.0143	0.8614	0.9190	0.9962	0.9981	0.8398	0.9962	0.7267
0.0059	0.0982	360	0.0135	0.8632	0.9312	0.9962	0.9978	0.8647	0.9961	0.7302
0.0267	0.1037	380	0.0129	0.8630	0.9181	0.9963	0.9982	0.8380	0.9962	0.7297
0.0042	0.1091	400	0.0128	0.8557	0.8964	0.9962	0.9987	0.7941	0.9962	0.7151
0.0037	0.1146	420	0.0110	0.8741	0.9227	0.9966	0.9985	0.8469	0.9966	0.7516
0.0066	0.1200	440	0.0151	0.8154	0.8268	0.9955	0.9996	0.6540	0.9955	0.6353
0.0041	0.1255	460	0.0141	0.8472	0.8798	0.9961	0.9989	0.7607	0.9960	0.6984
0.0498	0.1309	480	0.0140	0.8544	0.9296	0.9958	0.9975	0.8616	0.9958	0.7130
0.0459	0.1364	500	0.0145	0.8553	0.9430	0.9958	0.9970	0.8890	0.9957	0.7150
0.0072	0.1418	520	0.0133	0.8531	0.8805	0.9963	0.9991	0.7619	0.9962	0.7100
0.0075	0.1473	540	0.0113	0.8724	0.9209	0.9966	0.9985	0.8433	0.9966	0.7483
0.008	0.1528	560	0.0125	0.8555	0.8833	0.9963	0.9991	0.7675	0.9963	0.7147
0.0038	0.1582	580	0.0119	0.8692	0.9090	0.9966	0.9987	0.8193	0.9966	0.7419
0.0079	0.1637	600	0.0122	0.8730	0.9472	0.9964	0.9976	0.8967	0.9964	0.7496
0.0044	0.1691	620	0.0120	0.8669	0.9100	0.9965	0.9986	0.8214	0.9965	0.7374
0.0044	0.1746	640	0.0121	0.8637	0.8958	0.9965	0.9990	0.7925	0.9965	0.7310
0.0032	0.1800	660	0.0113	0.8660	0.9016	0.9965	0.9989	0.8044	0.9965	0.7355
0.003	0.1855	680	0.0112	0.8670	0.9234	0.9964	0.9982	0.8486	0.9963	0.7376
0.0051	0.1909	700	0.0116	0.8489	0.8733	0.9962	0.9992	0.7475	0.9962	0.7016
0.0096	0.1964	720	0.0159	0.7907	0.8008	0.9949	0.9997	0.6020	0.9949	0.5866
0.0104	0.2019	740	0.0114	0.8656	0.9360	0.9962	0.9977	0.8743	0.9962	0.7351
0.0072	0.2073	760	0.0112	0.8729	0.9488	0.9964	0.9976	0.9001	0.9964	0.7495
0.0037	0.2128	780	0.0106	0.8632	0.8876	0.9966	0.9992	0.7759	0.9965	0.7299
0.0024	0.2182	800	0.0104	0.8679	0.8914	0.9967	0.9993	0.7835	0.9967	0.7392
0.0028	0.2237	820	0.0109	0.8735	0.9525	0.9964	0.9975	0.9076	0.9964	0.7507
0.1398	0.2291	840	0.0100	0.8761	0.9080	0.9968	0.9990	0.8170	0.9968	0.7555
0.0018	0.2346	860	0.0105	0.8699	0.9063	0.9966	0.9989	0.8137	0.9966	0.7433
0.0112	0.2400	880	0.0116	0.8705	0.9604	0.9962	0.9971	0.9237	0.9962	0.7448
0.0103	0.2455	900	0.0099	0.8765	0.9084	0.9968	0.9990	0.8177	0.9968	0.7563
0.0034	0.2510	920	0.0106	0.8707	0.9019	0.9967	0.9990	0.8049	0.9967	0.7448
0.0052	0.2564	940	0.0103	0.8788	0.9133	0.9969	0.9989	0.8276	0.9969	0.7608
0.001	0.2619	960	0.0102	0.8842	0.9298	0.9969	0.9986	0.8609	0.9969	0.7715
0.0058	0.2673	980	0.0102	0.8772	0.9033	0.9969	0.9992	0.8074	0.9969	0.7576
0.0049	0.2728	1000	0.0110	0.8744	0.9070	0.9968	0.9990	0.8151	0.9967	0.7520
0.0108	0.2782	1020	0.0109	0.8736	0.9504	0.9964	0.9975	0.9033	0.9964	0.7508
0.009	0.2837	1040	0.0106	0.8686	0.9066	0.9966	0.9988	0.8145	0.9966	0.7406
0.003	0.2891	1060	0.0120	0.8493	0.8748	0.9962	0.9992	0.7505	0.9962	0.7024
0.0042	0.2946	1080	0.0109	0.8746	0.9340	0.9966	0.9981	0.8699	0.9965	0.7526
0.0008	0.3001	1100	0.0110	0.8717	0.9050	0.9967	0.9990	0.8110	0.9967	0.7467
0.0054	0.3055	1120	0.0114	0.8623	0.8855	0.9965	0.9993	0.7717	0.9965	0.7281
0.0054	0.3110	1140	0.0096	0.8812	0.9230	0.9969	0.9987	0.8472	0.9969	0.7655
0.004	0.3164	1160	0.0091	0.8859	0.9289	0.9970	0.9987	0.8591	0.9970	0.7749
0.0139	0.3219	1180	0.0095	0.8827	0.9392	0.9968	0.9982	0.8802	0.9968	0.7686
0.0229	0.3273	1200	0.0100	0.8755	0.9485	0.9965	0.9977	0.8994	0.9965	0.7546
0.0071	0.3328	1220	0.0099	0.8804	0.9457	0.9967	0.9979	0.8934	0.9967	0.7641
0.0009	0.3382	1240	0.0103	0.8639	0.8943	0.9965	0.9990	0.7896	0.9965	0.7313
0.0038	0.3437	1260	0.0105	0.8687	0.9439	0.9963	0.9976	0.8902	0.9962	0.7411
0.0012	0.3492	1280	0.0098	0.8718	0.8951	0.9968	0.9993	0.7908	0.9968	0.7468
0.002	0.3546	1300	0.0093	0.8828	0.9440	0.9968	0.9981	0.8900	0.9968	0.7689
0.0032	0.3601	1320	0.0087	0.8886	0.9332	0.9971	0.9986	0.8678	0.9970	0.7801
0.006	0.3655	1340	0.0093	0.8862	0.9606	0.9968	0.9977	0.9235	0.9968	0.7756
0.0056	0.3710	1360	0.0090	0.8878	0.9117	0.9972	0.9993	0.8240	0.9972	0.7785
0.0115	0.3764	1380	0.0092	0.8939	0.9252	0.9973	0.9991	0.8514	0.9973	0.7905
0.0055	0.3819	1400	0.0090	0.8928	0.9618	0.9970	0.9979	0.9258	0.9970	0.7887
0.0088	0.3873	1420	0.0089	0.8894	0.9365	0.9971	0.9986	0.8743	0.9970	0.7817
0.0043	0.3928	1440	0.0092	0.8902	0.9450	0.9970	0.9983	0.8917	0.9970	0.7834
0.0007	0.3983	1460	0.0102	0.8736	0.8933	0.9969	0.9994	0.7872	0.9968	0.7504
0.0007	0.4037	1480	0.0088	0.8960	0.9295	0.9973	0.9990	0.8599	0.9973	0.7947
0.0091	0.4092	1500	0.0084	0.8995	0.9440	0.9974	0.9987	0.8894	0.9973	0.8016
0.0009	0.4146	1520	0.0079	0.9000	0.9471	0.9974	0.9986	0.8957	0.9973	0.8026
0.0028	0.4201	1540	0.0092	0.8832	0.9025	0.9971	0.9994	0.8057	0.9971	0.7693
0.0076	0.4255	1560	0.0108	0.8692	0.9655	0.9961	0.9969	0.9342	0.9961	0.7423
0.0012	0.4310	1580	0.0087	0.8883	0.9177	0.9972	0.9991	0.8364	0.9971	0.7795
0.0032	0.4364	1600	0.0084	0.8976	0.9441	0.9973	0.9986	0.8896	0.9973	0.7979
0.0091	0.4419	1620	0.0086	0.8940	0.9398	0.9972	0.9986	0.8809	0.9972	0.7908
0.0051	0.4474	1640	0.0095	0.8787	0.8991	0.9970	0.9994	0.7987	0.9970	0.7605
0.0775	0.4528	1660	0.0088	0.8927	0.9279	0.9972	0.9989	0.8568	0.9972	0.7882
0.0021	0.4583	1680	0.0084	0.8976	0.9490	0.9973	0.9985	0.8995	0.9972	0.7979
0.0031	0.4637	1700	0.0086	0.8988	0.9459	0.9973	0.9986	0.8933	0.9973	0.8003
0.0033	0.4692	1720	0.0084	0.9005	0.9382	0.9974	0.9989	0.8776	0.9974	0.8035
0.0035	0.4746	1740	0.0085	0.8938	0.9573	0.9971	0.9981	0.9165	0.9971	0.7905
0.0029	0.4801	1760	0.0086	0.8895	0.9425	0.9970	0.9984	0.8867	0.9970	0.7821
0.0037	0.4855	1780	0.0080	0.9011	0.9480	0.9974	0.9986	0.8974	0.9974	0.8047
0.0048	0.4910	1800	0.0085	0.9038	0.9393	0.9975	0.9990	0.8797	0.9975	0.8100
0.0043	0.4965	1820	0.0086	0.9016	0.9427	0.9974	0.9988	0.8865	0.9974	0.8057
0.0024	0.5019	1840	0.0089	0.8969	0.9309	0.9974	0.9990	0.8627	0.9973	0.7964
0.0082	0.5074	1860	0.0099	0.8850	0.9134	0.9971	0.9991	0.8276	0.9971	0.7730
0.0042	0.5128	1880	0.0092	0.8916	0.9309	0.9972	0.9988	0.8630	0.9972	0.7860
0.0032	0.5183	1900	0.0087	0.8946	0.9341	0.9973	0.9988	0.8693	0.9972	0.7919
0.0056	0.5237	1920	0.0102	0.8805	0.9160	0.9969	0.9989	0.8330	0.9969	0.7641
0.0054	0.5292	1940	0.0118	0.8665	0.8985	0.9966	0.9990	0.7980	0.9965	0.7365
0.0052	0.5346	1960	0.0092	0.8936	0.9331	0.9972	0.9988	0.8673	0.9972	0.7900
0.0009	0.5401	1980	0.0092	0.8916	0.9389	0.9971	0.9986	0.8792	0.9971	0.7860
0.0035	0.5456	2000	0.0088	0.8946	0.9285	0.9973	0.9990	0.8581	0.9973	0.7919
0.0026	0.5510	2020	0.0078	0.9015	0.9381	0.9975	0.9989	0.8772	0.9974	0.8056
0.0048	0.5565	2040	0.0082	0.8901	0.9118	0.9973	0.9994	0.8243	0.9972	0.7829
0.0027	0.5619	2060	0.0080	0.9012	0.9390	0.9975	0.9989	0.8790	0.9974	0.8050
0.0291	0.5674	2080	0.0076	0.9062	0.9403	0.9976	0.9990	0.8815	0.9976	0.8149
0.0023	0.5728	2100	0.0075	0.9072	0.9530	0.9976	0.9987	0.9073	0.9975	0.8168
0.0023	0.5783	2120	0.0081	0.8997	0.9312	0.9974	0.9991	0.8632	0.9974	0.8021
0.0004	0.5837	2140	0.0081	0.9009	0.9554	0.9973	0.9984	0.9125	0.9973	0.8044
0.0037	0.5892	2160	0.0078	0.8985	0.9304	0.9974	0.9991	0.8616	0.9974	0.7997
0.075	0.5947	2180	0.0075	0.9043	0.9475	0.9975	0.9987	0.8962	0.9975	0.8111
0.002	0.6001	2200	0.0088	0.8889	0.9613	0.9969	0.9978	0.9248	0.9969	0.7809
0.0043	0.6056	2220	0.0075	0.9010	0.9402	0.9974	0.9988	0.8815	0.9974	0.8046
0.0009	0.6110	2240	0.0077	0.9010	0.9470	0.9974	0.9986	0.8953	0.9974	0.8046
0.0044	0.6165	2260	0.0077	0.8951	0.9175	0.9974	0.9993	0.8357	0.9974	0.7929
0.0009	0.6219	2280	0.0074	0.9010	0.9277	0.9975	0.9992	0.8561	0.9975	0.8045
0.0023	0.6274	2300	0.0075	0.9004	0.9259	0.9975	0.9993	0.8526	0.9975	0.8033
0.0036	0.6328	2320	0.0076	0.9037	0.9391	0.9975	0.9990	0.8793	0.9975	0.8100
0.0043	0.6383	2340	0.0073	0.9048	0.9449	0.9975	0.9988	0.8910	0.9975	0.8121
0.0065	0.6438	2360	0.0081	0.8935	0.9181	0.9973	0.9993	0.8369	0.9973	0.7898
0.0019	0.6492	2380	0.0079	0.8993	0.9333	0.9974	0.9990	0.8676	0.9974	0.8011
0.0004	0.6547	2400	0.0079	0.8991	0.9294	0.9974	0.9991	0.8597	0.9974	0.8008
0.0009	0.6601	2420	0.0078	0.9005	0.9355	0.9974	0.9990	0.8720	0.9974	0.8037
0.0075	0.6656	2440	0.0081	0.8931	0.9210	0.9973	0.9992	0.8428	0.9973	0.7889
0.0018	0.6710	2460	0.0079	0.8969	0.9336	0.9973	0.9989	0.8683	0.9973	0.7966
0.0082	0.6765	2480	0.0078	0.8990	0.9364	0.9974	0.9989	0.8740	0.9974	0.8006
0.0013	0.6819	2500	0.0075	0.9020	0.9405	0.9975	0.9989	0.8821	0.9974	0.8066
0.0007	0.6874	2520	0.0074	0.9053	0.9436	0.9976	0.9989	0.8884	0.9975	0.8131
0.0037	0.6929	2540	0.0075	0.9054	0.9503	0.9975	0.9987	0.9020	0.9975	0.8134
0.0007	0.6983	2560	0.0077	0.9028	0.9459	0.9975	0.9987	0.8930	0.9974	0.8081
0.0031	0.7038	2580	0.0079	0.9021	0.9521	0.9974	0.9985	0.9057	0.9974	0.8068
0.0037	0.7092	2600	0.0075	0.9048	0.9488	0.9975	0.9987	0.8988	0.9975	0.8121
0.0012	0.7147	2620	0.0074	0.9048	0.9418	0.9975	0.9989	0.8846	0.9975	0.8121
0.0027	0.7201	2640	0.0075	0.9061	0.9531	0.9975	0.9986	0.9075	0.9975	0.8147
0.0048	0.7256	2660	0.0082	0.8992	0.9591	0.9973	0.9982	0.9200	0.9972	0.8012
0.0012	0.7310	2680	0.0080	0.8923	0.9378	0.9972	0.9986	0.8770	0.9971	0.7874
0.002	0.7365	2700	0.0083	0.8908	0.9451	0.9971	0.9983	0.8918	0.9970	0.7846
0.0175	0.7420	2720	0.0081	0.8961	0.9572	0.9972	0.9982	0.9163	0.9971	0.7951
0.0095	0.7474	2740	0.0074	0.9014	0.9350	0.9975	0.9990	0.8709	0.9975	0.8054
0.0026	0.7529	2760	0.0073	0.9027	0.9376	0.9975	0.9990	0.8761	0.9975	0.8080
0.0003	0.7583	2780	0.0074	0.9034	0.9545	0.9974	0.9985	0.9105	0.9974	0.8093
0.0027	0.7638	2800	0.0074	0.9032	0.9471	0.9975	0.9987	0.8954	0.9974	0.8090
0.0071	0.7692	2820	0.0074	0.9040	0.9520	0.9975	0.9986	0.9053	0.9974	0.8107
0.004	0.7747	2840	0.0072	0.9061	0.9514	0.9975	0.9987	0.9041	0.9975	0.8147
0.0043	0.7801	2860	0.0073	0.9026	0.9297	0.9975	0.9992	0.8603	0.9975	0.8077
0.0048	0.7856	2880	0.0075	0.9028	0.9417	0.9975	0.9989	0.8846	0.9975	0.8080
0.0022	0.7911	2900	0.0079	0.8974	0.9263	0.9974	0.9991	0.8535	0.9974	0.7975
0.0035	0.7965	2920	0.0071	0.9073	0.9447	0.9976	0.9989	0.8904	0.9976	0.8170
0.0029	0.8020	2940	0.0072	0.9033	0.9299	0.9976	0.9992	0.8605	0.9975	0.8091
0.0042	0.8074	2960	0.0072	0.9079	0.9491	0.9976	0.9988	0.8995	0.9976	0.8183
0.0034	0.8129	2980	0.0074	0.9071	0.9456	0.9976	0.9989	0.8922	0.9976	0.8166
0.0006	0.8183	3000	0.0073	0.9085	0.9417	0.9977	0.9990	0.8843	0.9976	0.8194
0.0004	0.8238	3020	0.0073	0.9086	0.9390	0.9977	0.9991	0.8788	0.9977	0.8195
0.0042	0.8292	3040	0.0075	0.9081	0.9469	0.9976	0.9989	0.8949	0.9976	0.8187
0.0003	0.8347	3060	0.0073	0.9092	0.9454	0.9977	0.9990	0.8918	0.9976	0.8208
0.0008	0.8402	3080	0.0072	0.9111	0.9457	0.9977	0.9990	0.8923	0.9977	0.8245
0.0031	0.8456	3100	0.0074	0.9078	0.9359	0.9977	0.9992	0.8726	0.9976	0.8179
0.0099	0.8511	3120	0.0077	0.9056	0.9335	0.9976	0.9992	0.8678	0.9976	0.8136
0.0003	0.8565	3140	0.0075	0.9086	0.9439	0.9977	0.9990	0.8888	0.9976	0.8196
0.0047	0.8620	3160	0.0072	0.9094	0.9381	0.9977	0.9992	0.8770	0.9977	0.8211
0.0057	0.8674	3180	0.0071	0.9098	0.9377	0.9977	0.9992	0.8763	0.9977	0.8218
0.0033	0.8729	3200	0.0070	0.9101	0.9389	0.9977	0.9992	0.8787	0.9977	0.8224
0.0009	0.8783	3220	0.0068	0.9129	0.9482	0.9978	0.9990	0.8974	0.9977	0.8281
0.0047	0.8838	3240	0.0069	0.9128	0.9580	0.9977	0.9987	0.9174	0.9977	0.8278
0.0021	0.8893	3260	0.0069	0.9133	0.9555	0.9977	0.9988	0.9121	0.9977	0.8289
0.0006	0.8947	3280	0.0069	0.9118	0.9417	0.9978	0.9991	0.8844	0.9977	0.8258
0.0003	0.9002	3300	0.0069	0.9107	0.9390	0.9977	0.9992	0.8788	0.9977	0.8237
0.0025	0.9056	3320	0.0069	0.9122	0.9557	0.9977	0.9987	0.9127	0.9977	0.8267
0.0003	0.9111	3340	0.0069	0.9131	0.9535	0.9977	0.9988	0.9082	0.9977	0.8285
0.0034	0.9165	3360	0.0068	0.9148	0.9522	0.9978	0.9989	0.9054	0.9978	0.8319
0.0043	0.9220	3380	0.0069	0.9140	0.9571	0.9978	0.9988	0.9155	0.9977	0.8303
0.0031	0.9274	3400	0.0068	0.9138	0.9557	0.9978	0.9988	0.9127	0.9977	0.8300
0.0063	0.9329	3420	0.0068	0.9139	0.9543	0.9978	0.9988	0.9098	0.9977	0.8300
0.0049	0.9384	3440	0.0068	0.9139	0.9527	0.9978	0.9989	0.9066	0.9978	0.8300
0.0092	0.9438	3460	0.0068	0.9142	0.9519	0.9978	0.9989	0.9050	0.9978	0.8306
0.0033	0.9493	3480	0.0068	0.9133	0.9460	0.9978	0.9991	0.8929	0.9978	0.8289
0.0048	0.9547	3500	0.0068	0.9141	0.9493	0.9978	0.9990	0.8996	0.9978	0.8304
0.0037	0.9602	3520	0.0068	0.9136	0.9463	0.9978	0.9991	0.8936	0.9978	0.8294
0.0037	0.9656	3540	0.0068	0.9124	0.9422	0.9978	0.9991	0.8852	0.9978	0.8271
0.0022	0.9711	3560	0.0069	0.9102	0.9365	0.9977	0.9992	0.8738	0.9977	0.8227
0.0066	0.9765	3580	0.0068	0.9117	0.9397	0.9978	0.9992	0.8803	0.9977	0.8256
0.0044	0.9820	3600	0.0068	0.9132	0.9438	0.9978	0.9991	0.8885	0.9978	0.8285
0.0066	0.9875	3620	0.0068	0.9143	0.9483	0.9978	0.9990	0.8975	0.9978	0.8309
0.0007	0.9929	3640	0.0068	0.9143	0.9481	0.9978	0.9990	0.8971	0.9978	0.8308
0.0046	0.9984	3660	0.0068	0.9132	0.9437	0.9978	0.9991	0.8883	0.9978	0.8286

Framework versions

• Transformers 4.42.3
• Pytorch 2.1.2
• Datasets 2.20.0
• Tokenizers 0.19.1