Yongxin-Guo
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -16,6 +16,7 @@ tags:
|
|
16 |
|
17 |
## 📰 News
|
18 |
|
|
|
19 |
- **[2024.10.10]** 🔥 Our [code](https://github.com/gyxxyg/TRACE) and [paper](https://arxiv.org/abs/2410.05643) are released!
|
20 |
- **[2024.10.10]** 🔥 Our **checkpoints** are available now!
|
21 |
|
@@ -41,19 +42,25 @@ In this work
|
|
41 |
| Youcook2 (Zero-Shot) | CIDER | METEOR | SODA_c | F1 |
|
42 |
| --- | --- | --- | --- | --- |
|
43 |
| TRACE | 8.1 | 2.8 | 2.2 | 22.4 |
|
|
|
44 |
|
45 |
| Charades-STA (Zero-Shot) | 0.3 | 0.5 | 0.7 | mIOU |
|
46 |
| --- | --- | --- | --- | --- |
|
47 |
| TRACE | 58.6 | 40.3 | 19.4 | 38.7 |
|
|
|
48 |
|
49 |
| QVHighlights (Zero-Shot) | mAP | Hit@1 |
|
50 |
| --- | --- | --- |
|
51 |
-
| TRACE | 26.8 | 42.7
|
|
|
|
|
52 |
|
53 |
| ActivityNet-DVC | CIDER | METEOR | SODA_c | F1 |
|
54 |
| --- | --- | --- | --- | --- |
|
55 |
| TRACE | 25.9 | 6.0 | 6.4 | 39.3 |
|
|
|
56 |
|
57 |
| ActivityNet-MR | 0.3 | 0.5 | 0.7 | mIOU |
|
58 |
| --- | --- | --- | --- | --- |
|
59 |
-
| TRACE |
|
|
|
|
16 |
|
17 |
## 📰 News
|
18 |
|
19 |
+
- **[2024.10.19]** 🔥 We release [trace-retrieval](https://huggingface.co/Yongxin-Guo/trace-retrieval) by forcing the predicted timestamps to be align with the input frame timestamps. Results show trace-retrieval achieve better performance on dense video captioning tasks.
|
20 |
- **[2024.10.10]** 🔥 Our [code](https://github.com/gyxxyg/TRACE) and [paper](https://arxiv.org/abs/2410.05643) are released!
|
21 |
- **[2024.10.10]** 🔥 Our **checkpoints** are available now!
|
22 |
|
|
|
42 |
| Youcook2 (Zero-Shot) | CIDER | METEOR | SODA_c | F1 |
|
43 |
| --- | --- | --- | --- | --- |
|
44 |
| TRACE | 8.1 | 2.8 | 2.2 | 22.4 |
|
45 |
+
| TRACE-retrieval | 8.3 | 2.9 | 2.3 | 24.1 |
|
46 |
|
47 |
| Charades-STA (Zero-Shot) | 0.3 | 0.5 | 0.7 | mIOU |
|
48 |
| --- | --- | --- | --- | --- |
|
49 |
| TRACE | 58.6 | 40.3 | 19.4 | 38.7 |
|
50 |
+
| TRACE-retrieval | 57.9 | 37.4 | 17.3 | 37.4 |
|
51 |
|
52 |
| QVHighlights (Zero-Shot) | mAP | Hit@1 |
|
53 |
| --- | --- | --- |
|
54 |
+
| TRACE | 26.8 | 42.7 |
|
55 |
+
| TRACE-retrieval | 27.9 | 44.3 |
|
56 |
+
|
57 |
|
58 |
| ActivityNet-DVC | CIDER | METEOR | SODA_c | F1 |
|
59 |
| --- | --- | --- | --- | --- |
|
60 |
| TRACE | 25.9 | 6.0 | 6.4 | 39.3 |
|
61 |
+
| TRACE-retrieval | 25.7 | 5.9 | 6.5 | 40.1 |
|
62 |
|
63 |
| ActivityNet-MR | 0.3 | 0.5 | 0.7 | mIOU |
|
64 |
| --- | --- | --- | --- | --- |
|
65 |
+
| TRACE | 54.0 | 37.7 | 24.0 | 39.0 |
|
66 |
+
| TRACE-retrieval | 54.4 | 39.8 | 24.9 | 40.2 |
|