Spaces:
Running
Running
Update apps_metric.py
Browse files- apps_metric.py +1 -1
apps_metric.py
CHANGED
@@ -44,7 +44,7 @@ Returns:
|
|
44 |
metrics: dict of three metrics: average accuracy, stric accuracy, and pass@k.
|
45 |
Examples:
|
46 |
>>> my_new_module = evaluate.load("loubnabnl/apps_metric")
|
47 |
-
>>> results = my_new_module.compute(
|
48 |
>>> print(results)
|
49 |
{'avg_accuracy': 0, 'strict_accuracy': 0, 'pass_at_k': None}
|
50 |
"""
|
|
|
44 |
metrics: dict of three metrics: average accuracy, stric accuracy, and pass@k.
|
45 |
Examples:
|
46 |
>>> my_new_module = evaluate.load("loubnabnl/apps_metric")
|
47 |
+
>>> results = my_new_module.compute(predictions=[["s=input()\nprint(s)"]])
|
48 |
>>> print(results)
|
49 |
{'avg_accuracy': 0, 'strict_accuracy': 0, 'pass_at_k': None}
|
50 |
"""
|