lixuejing commited on
Commit
1141b52
·
1 Parent(s): f0c809a
Files changed (1) hide show
  1. src/about.py +0 -11
src/about.py CHANGED
@@ -79,17 +79,6 @@ FlagEval-Embodied Verse is a scientific and comprehensive embodied evaluation to
79
  We hope to promote a more open ecosystem for embodied model developers to participate and contribute accordingly to the advancement of embodied models. To achieve the goal of fairness, all models are evaluated all models are evaluated under the FlagEvalMM framework using standardized GPUs and a unified environment to ensure fairness.
80
 
81
  ## Embodied Verse
82
- 数据集 论文 链接
83
- Where2Place https://arxiv.org/abs/2406.10721 https://huggingface.co/datasets/FlagEval/Where2Place
84
- Blink https://arxiv.org/abs/2404.12390 https://huggingface.co/datasets/BLINK-Benchmark/BLINK
85
- CVBench https://arxiv.org/abs/2406.16860 https://huggingface.co/datasets/nyu-visionx/CV-Bench
86
- RoboSpatial-Home https://arxiv.org/abs/2411.16537 https://huggingface.co/datasets/chanhee-luke/RoboSpatial-Home
87
- EmbspatialBench https://arxiv.org/abs/2406.05756 https://huggingface.co/datasets/Phineas476/EmbSpatial-Bench
88
- All-Angles Bench https://arxiv.org/abs/2504.15280 -
89
- VSI-Bench https://arxiv.org/abs/2412.14171 https://huggingface.co/datasets/nyu-visionx/VSI-Bench
90
- SAT https://arxiv.org/abs/2412.07755 https://huggingface.co/datasets/FlagEval/SAT
91
- EgoPlan-Bench2 https://arxiv.org/abs/2412.04447 -
92
- ERQA https://arxiv.org/abs/2503.20020 https://huggingface.co/datasets/FlagEval/ERQA/
93
 
94
  EmbodiedVerse-Open是一个由10个数据集构成的用于全面评测模型在具身智能场景下的meta dataset,包括:
95
 
 
79
  We hope to promote a more open ecosystem for embodied model developers to participate and contribute accordingly to the advancement of embodied models. To achieve the goal of fairness, all models are evaluated all models are evaluated under the FlagEvalMM framework using standardized GPUs and a unified environment to ensure fairness.
80
 
81
  ## Embodied Verse
 
 
 
 
 
 
 
 
 
 
 
82
 
83
  EmbodiedVerse-Open是一个由10个数据集构成的用于全面评测模型在具身智能场景下的meta dataset,包括:
84