tom-b974 commited on
Commit
cdbcb72
·
verified ·
1 Parent(s): 95a8fe1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +16 -9
README.md CHANGED
@@ -17,30 +17,37 @@ Labels: Binary classification — wildfire present or not.
17
  Images: Captured under real-world conditions, including diverse environments and challenging scenarios like smoke, clouds, and varying lighting.
18
  Size: ~33 000 image labeled images, well-suited for training and validation of computer vision models.
19
  - 28,103 images with smoke
20
- - 31,975 smoke instances
21
  This dataset is formatted to be compatible with the Ultralytics YOLO framework, enabling efficient training of object detection models.
22
  Usage: Ideal for fine-tuning state-of-the-art models for wildfire detection tasks.
23
 
24
  ## Model Development Plan
25
  Model Choice: YOLOv11s
26
- Why YOLOv11s?
27
  Efficiency: YOLO (You Only Look Once) models are known for their high-speed performance and accuracy, ideal for real-time applications.
28
  Versatility: YOLOv11s builds upon prior versions, improving object detection, handling small objects, and performing well under challenging visual conditions.
29
  Frugality: Optimized for computational efficiency, aligning with the sustainability goals of the Frugal AI Challenge.
30
 
31
  ## Data Preprocessing:
32
-
33
-
34
  Fine-Tuning YOLOv11:
35
- Load a pre-trained YOLOv11s model as a starting point (transfer learning).
36
- Replace the output layer to align with the binary classification task (wildfire vs. no wildfire).
37
  Train the model using the PyroNear/pyro-sdis dataset.
38
 
39
  ## Evaluation:
40
-
41
- Metrics:
42
- Precision and recall to assess detection accuracy.
43
  Inference time to evaluate real-time feasibility.
44
 
45
  Using CodeCarbon, the model's carbon footprint and energy consumption will be tracked, this information will help ensure the model's alignment with the sustainability objectives of the Frugal AI Challenge.
46
 
 
 
 
 
 
 
 
 
 
 
 
17
  Images: Captured under real-world conditions, including diverse environments and challenging scenarios like smoke, clouds, and varying lighting.
18
  Size: ~33 000 image labeled images, well-suited for training and validation of computer vision models.
19
  - 28,103 images with smoke
20
+ - 31,975 smoke instances
21
  This dataset is formatted to be compatible with the Ultralytics YOLO framework, enabling efficient training of object detection models.
22
  Usage: Ideal for fine-tuning state-of-the-art models for wildfire detection tasks.
23
 
24
  ## Model Development Plan
25
  Model Choice: YOLOv11s
26
+ Why YOLOv11s?
27
  Efficiency: YOLO (You Only Look Once) models are known for their high-speed performance and accuracy, ideal for real-time applications.
28
  Versatility: YOLOv11s builds upon prior versions, improving object detection, handling small objects, and performing well under challenging visual conditions.
29
  Frugality: Optimized for computational efficiency, aligning with the sustainability goals of the Frugal AI Challenge.
30
 
31
  ## Data Preprocessing:
 
 
32
  Fine-Tuning YOLOv11:
33
+ Load a pre-trained YOLOv11s model as a starting point (transfer learning).
34
+ Replace the output layer to align with the binary classification task (wildfire vs. no wildfire).
35
  Train the model using the PyroNear/pyro-sdis dataset.
36
 
37
  ## Evaluation:
38
+ Metrics:
39
+ Precision and recall to assess detection accuracy.
 
40
  Inference time to evaluate real-time feasibility.
41
 
42
  Using CodeCarbon, the model's carbon footprint and energy consumption will be tracked, this information will help ensure the model's alignment with the sustainability objectives of the Frugal AI Challenge.
43
 
44
+ ## Results:
45
+ Since evaluation of this challenge is on 20% of the train dataset, we need to be vigilant when talking about model performance.
46
+ Indeed, a high accuracy in the part of the train dataset could hide the over-fitting of the model.
47
+
48
+ That is what I've been dealing with when reaching 0.91 accuracy of the model and 0.81 mean_iou on the train dataset:
49
+ I can see over-fitting while over-performance on the train dataset (see picture below) - model is used for submission and is called yolo11_tr_20012025_frugalAIchal.pt
50
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/666354284044e2b1c3287c22/LptPoEeSGH22MG_XftxdP.png)
51
+
52
+ As a data scientist, another model has been trained and evaluated on the whole "val" dataset.
53
+