Spaces:
Sleeping
Sleeping
Add changed Args for compute function.
Browse files- execution_accuracy.py +4 -3
execution_accuracy.py
CHANGED
|
@@ -17,7 +17,6 @@ import evaluate
|
|
| 17 |
import datasets
|
| 18 |
|
| 19 |
|
| 20 |
-
|
| 21 |
# TODO: Add BibTeX citation
|
| 22 |
_CITATION = """\
|
| 23 |
@misc{li2023llm,
|
|
@@ -46,9 +45,11 @@ Args:
|
|
| 46 |
should be a string with tokens separated by spaces.
|
| 47 |
references: list of reference for each prediction. Each
|
| 48 |
reference should be a string with tokens separated by spaces.
|
|
|
|
|
|
|
|
|
|
| 49 |
Returns:
|
| 50 |
-
accuracy: description of the first score
|
| 51 |
-
another_score: description of the second score,
|
| 52 |
Examples:
|
| 53 |
Examples should be written in doctest format, and should illustrate how
|
| 54 |
to use the function.
|
|
|
|
| 17 |
import datasets
|
| 18 |
|
| 19 |
|
|
|
|
| 20 |
# TODO: Add BibTeX citation
|
| 21 |
_CITATION = """\
|
| 22 |
@misc{li2023llm,
|
|
|
|
| 45 |
should be a string with tokens separated by spaces.
|
| 46 |
references: list of reference for each prediction. Each
|
| 47 |
reference should be a string with tokens separated by spaces.
|
| 48 |
+
execute_func: function that executes sql query on database.
|
| 49 |
+
filter_func: function that returns true, if sql query can make changes to the database,
|
| 50 |
+
else false.
|
| 51 |
Returns:
|
| 52 |
+
accuracy: description of the first score
|
|
|
|
| 53 |
Examples:
|
| 54 |
Examples should be written in doctest format, and should illustrate how
|
| 55 |
to use the function.
|