Update src/about.py
Browse filesA note about API speed
- src/about.py +1 -0
src/about.py
CHANGED
|
@@ -80,6 +80,7 @@ https://huggingface.co/datasets/silma-ai/arabic-broad-benchmark#scoring-rules
|
|
| 80 |
* Please note that we use the same GPU (A100) and a batch size of 1 for all Hugging Face models to ensure a fair comparison. Models above 15B are split across multiple GPUs.
|
| 81 |
* Each model should only be compared to other models in its size category.
|
| 82 |
* API or closed models can't be compared to open models, only to other API models, since they are not hosted on our infrastructure.
|
|
|
|
| 83 |
|
| 84 |
---
|
| 85 |
|
|
|
|
| 80 |
* Please note that we use the same GPU (A100) and a batch size of 1 for all Hugging Face models to ensure a fair comparison. Models above 15B are split across multiple GPUs.
|
| 81 |
* Each model should only be compared to other models in its size category.
|
| 82 |
* API or closed models can't be compared to open models, only to other API models, since they are not hosted on our infrastructure.
|
| 83 |
+
* API providers may impose rate limits on new models, which can impact their overall speed on the leaderboard. It is important to consider this posibility when comparing API speeds.
|
| 84 |
|
| 85 |
---
|
| 86 |
|