Spaces:
Runtime error
Runtime error
Commit
·
ec2acd0
1
Parent(s):
3fd3041
Adding model as input to gradio app
Browse files- README.md +1 -1
- dmx_perplexity/dmx_perplexity.py +1 -0
README.md
CHANGED
@@ -51,7 +51,7 @@ At minimum, this metric requires the model and references as inputs.
|
|
51 |
|
52 |
Output Example(s):
|
53 |
```python
|
54 |
-
{'
|
55 |
```
|
56 |
This metric outputs a dictionary, containing the loss and perplexity score.
|
57 |
|
|
|
51 |
|
52 |
Output Example(s):
|
53 |
```python
|
54 |
+
{'loss': 4.993086338043213, 'perplexity': 147.390625}
|
55 |
```
|
56 |
This metric outputs a dictionary, containing the loss and perplexity score.
|
57 |
|
dmx_perplexity/dmx_perplexity.py
CHANGED
@@ -51,6 +51,7 @@ class DmxPerplexity(evaluate.Metric):
|
|
51 |
features=datasets.Features(
|
52 |
{
|
53 |
"references": datasets.Value("string"),
|
|
|
54 |
}
|
55 |
),
|
56 |
reference_urls=["https://huggingface.co/docs/transformers/perplexity"],
|
|
|
51 |
features=datasets.Features(
|
52 |
{
|
53 |
"references": datasets.Value("string"),
|
54 |
+
"model":datasets.Value("string")
|
55 |
}
|
56 |
),
|
57 |
reference_urls=["https://huggingface.co/docs/transformers/perplexity"],
|