Hugging Face's logo

Spaces:
TIGER-Lab
/
MMEB-Leaderboard
Running

App Files Community
61
MINGYISU commited on
Commit
c0b9140
·
1 Parent(s): c579c3b

update submission instruction

Browse files
Files changed (1) hide show
  1. utils.py +7 -8
utils.py CHANGED
@@ -35,7 +35,8 @@ This comprehensive suite enables robust evaluation of multimodal embedding model
35
  | [**📈Overview**](https://tiger-ai-lab.github.io/VLM2Vec/) | [**Github**](https://github.com/TIGER-AI-Lab/VLM2Vec)
36
  | [**📖MMEB-V2/VLM2Vec-V2 Paper (TBA)**](https://arxiv.org/abs/2410.05160)
37
  | [**📖MMEB-V1/VLM2Vec-V1 Paper**](https://arxiv.org/abs/2410.05160)
38
- | [**🤗Hugging Face**](https://huggingface.co/datasets/TIGER-Lab/MMEB-V2) |
 
39
  """
40
 
41
  TABLE_INTRODUCTION = """***Important Notes: ***
@@ -55,11 +56,9 @@ CITATION_BUTTON_TEXT = r"""@article{jiang2024vlm2vec,
55
 
56
  SUBMIT_INTRODUCTION = """# Submit on MMEB Leaderboard Introduction
57
 
58
- ## ⚠ Please note that you need to submit the JSON file with the following format:
59
 
60
- ### ***Important Notes: We have released MMEB-V2 and will deprecate MMEB-V1 soon.*** \n
61
- ### ***All further submissions should be made using the V2 format (see following).*** \n
62
- ### ***In V2, the detailed scores of each dataset will be included, and our code will automatically generate the results and calculate the overall scores. See the [**GitHub page**](https://github.com/TIGER-AI-Lab/VLM2Vec) for more information.***
63
  ```json
64
  {
65
  "metadata": {
@@ -103,9 +102,9 @@ SUBMIT_INTRODUCTION = """# Submit on MMEB Leaderboard Introduction
103
  }
104
  }
105
  ```
106
- Please refer to the [**GitHub page**](https://github.com/TIGER-AI-Lab/VLM2Vec) for detailed instructions about evaluating your model. \n
107
- To submit, create a pull request and upload the generated JSON file to the ***scores*** folder, then send us an email at [email protected], including your model's information. \n We will review your submission and update the leaderboard accordingly. \n
108
- Please also share any feedback or suggestions you have for improving the leaderboard experience. We appreciate your contributions to the MMEB community!
109
  """
110
 
111
  def create_hyperlinked_names(df):
 
35
  | [**📈Overview**](https://tiger-ai-lab.github.io/VLM2Vec/) | [**Github**](https://github.com/TIGER-AI-Lab/VLM2Vec)
36
  | [**📖MMEB-V2/VLM2Vec-V2 Paper (TBA)**](https://arxiv.org/abs/2410.05160)
37
  | [**📖MMEB-V1/VLM2Vec-V1 Paper**](https://arxiv.org/abs/2410.05160)
38
+ | [**🤗Hugging Face**](https://huggingface.co/datasets/TIGER-Lab/MMEB-V2)
39
+ | [**Discord**](https://discord.gg/njyKubdtry) |
40
  """
41
 
42
  TABLE_INTRODUCTION = """***Important Notes: ***
 
56
 
57
  SUBMIT_INTRODUCTION = """# Submit on MMEB Leaderboard Introduction
58
 
59
+ ## Please refer to the [**GitHub page**](https://github.com/TIGER-AI-Lab/VLM2Vec) for detailed instructions about evaluating your model. \n
60
 
61
+ ## ⚠️ Please note that you need to submit the JSON file with the following format:
 
 
62
  ```json
63
  {
64
  "metadata": {
 
102
  }
103
  }
104
  ```
105
+ To submit, create a pull request and upload the generated JSON file to the ***scores*** folder, then inform us on [our discord server](https://discord.gg/njyKubdtry), or send us an email at [email protected], including your model's information. \n
106
+ We will review your submission and update the leaderboard accordingly. \n
107
+ We highly recommend joining our [discord server](https://discord.gg/njyKubdtry), which provides a convenient way to stay informed with latest updates, or share any feedback you have for improving the leaderboard experience. We appreciate your contributions to the MMEB community!
108
  """
109
 
110
  def create_hyperlinked_names(df):