Spaces:
Sleeping
Sleeping
hichem-abdellali
commited on
update the readme
Browse files
README.md
CHANGED
@@ -105,6 +105,47 @@ The output is a dictionary containing the following metrics:
|
|
105 |
|
106 |
We levereage one of the internal variables of motmetrics ```MOTAccumulator``` class, ```events```, which keeps track of the detections hits and misses. These values are then processed via the ```track_ratios``` function which counts the ratio of assigned to total appearance count per unique object id. We then define the ```recognition``` function that counts how many objects have been seen more times then the desired threshold.
|
107 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
108 |
## Citations
|
109 |
|
110 |
```bibtex {"id":"01HPS3ASFJXVQR88985GKHAQRE"}
|
|
|
105 |
|
106 |
We levereage one of the internal variables of motmetrics ```MOTAccumulator``` class, ```events```, which keeps track of the detections hits and misses. These values are then processed via the ```track_ratios``` function which counts the ratio of assigned to total appearance count per unique object id. We then define the ```recognition``` function that counts how many objects have been seen more times then the desired threshold.
|
107 |
|
108 |
+
|
109 |
+
|
110 |
+
|
111 |
+
## W&B logging
|
112 |
+
When you use **module.wandb()**, it is possible to log the User Frindly metrics values in Weights and Bias (W&B). The W&B key is stored as a Secret in this repository.
|
113 |
+
|
114 |
+
### Params
|
115 |
+
- **wandb_project** - Name of the W&B project (Default: `'user_freindly_metrics'`)
|
116 |
+
- **log_plots** (bool, optional): Generates categorized bar charts for global metrics. Defaults to True
|
117 |
+
- **debug** (bool, optional): Logs everything to the console and w&b Logs page. Defaults to False
|
118 |
+
|
119 |
+
```python
|
120 |
+
import evaluate
|
121 |
+
import logging
|
122 |
+
from seametrics.payload.processor import PayloadProcessor
|
123 |
+
|
124 |
+
logging.basicConfig(level=logging.WARNING)
|
125 |
+
|
126 |
+
# Configure your dataset and model details
|
127 |
+
payload = PayloadProcessor(
|
128 |
+
dataset_name="SENTRY_VIDEOS_DATASET_QA",
|
129 |
+
gt_field="ground_truth_det_fused_id",
|
130 |
+
models=["ahoy_IR_b2_engine_3_7_0_757_g8765b007_oversea"],
|
131 |
+
sequence_list=["Sentry_2023_02_08_PROACT_CELADON_@6m_MOB_2023_02_08_14_41_51"],
|
132 |
+
tracking_mode=True
|
133 |
+
).payload
|
134 |
+
|
135 |
+
|
136 |
+
# Evaluate using SEA-AI/user-friendly-metrics
|
137 |
+
module = evaluate.load("SEA-AI/user-friendly-metrics")
|
138 |
+
res = module._compute(payload, max_iou=0.5, recognition_thresholds=[0.3, 0.5, 0.8])
|
139 |
+
|
140 |
+
module.wandb(res,log_plots=True, debug=True)
|
141 |
+
```
|
142 |
+
|
143 |
+
|
144 |
+
|
145 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65ca2aafdc38a2858aa43f1e/RYEsFwt6K-jP0mp7_RIZv.png)
|
146 |
+
|
147 |
+
![image/png](https://cdn-uploads.huggingface.co/production/uploads/65ca2aafdc38a2858aa43f1e/BK0LqOAahukp6filT3ODb.png)
|
148 |
+
|
149 |
## Citations
|
150 |
|
151 |
```bibtex {"id":"01HPS3ASFJXVQR88985GKHAQRE"}
|