Jacqueline Garrahan
commited on
Commit
•
eaace0a
1
Parent(s):
50664b2
Add note about serverless api
Browse files- src/about.py +2 -0
src/about.py
CHANGED
|
@@ -52,6 +52,8 @@ A guide for running the above tasks using EleutherAi's lm-evaluation-harness is
|
|
| 52 |
"""
|
| 53 |
|
| 54 |
EVALUATION_QUEUE_TEXT = """
|
|
|
|
|
|
|
| 55 |
## Some good practices before submitting a model
|
| 56 |
|
| 57 |
### 1) Make sure you can load your model and tokenizer using AutoClasses:
|
|
|
|
| 52 |
"""
|
| 53 |
|
| 54 |
EVALUATION_QUEUE_TEXT = """
|
| 55 |
+
Note: The evaluation suite is only able to run on models available via the Hugging Face Serverless Inference API.
|
| 56 |
+
|
| 57 |
## Some good practices before submitting a model
|
| 58 |
|
| 59 |
### 1) Make sure you can load your model and tokenizer using AutoClasses:
|