d-matrix-user commited on
Commit
ec2acd0
·
1 Parent(s): 3fd3041

Adding model as input to gradio app

Browse files
Files changed (2) hide show
  1. README.md +1 -1
  2. dmx_perplexity/dmx_perplexity.py +1 -0
README.md CHANGED
@@ -51,7 +51,7 @@ At minimum, this metric requires the model and references as inputs.
51
 
52
  Output Example(s):
53
  ```python
54
- {'accuracy': 1.0}
55
  ```
56
  This metric outputs a dictionary, containing the loss and perplexity score.
57
 
 
51
 
52
  Output Example(s):
53
  ```python
54
+ {'loss': 4.993086338043213, 'perplexity': 147.390625}
55
  ```
56
  This metric outputs a dictionary, containing the loss and perplexity score.
57
 
dmx_perplexity/dmx_perplexity.py CHANGED
@@ -51,6 +51,7 @@ class DmxPerplexity(evaluate.Metric):
51
  features=datasets.Features(
52
  {
53
  "references": datasets.Value("string"),
 
54
  }
55
  ),
56
  reference_urls=["https://huggingface.co/docs/transformers/perplexity"],
 
51
  features=datasets.Features(
52
  {
53
  "references": datasets.Value("string"),
54
+ "model":datasets.Value("string")
55
  }
56
  ),
57
  reference_urls=["https://huggingface.co/docs/transformers/perplexity"],