Spaces:
Sleeping
Sleeping
Add changed Args for compute function.
Browse files- execution_accuracy.py +4 -3
execution_accuracy.py
CHANGED
@@ -17,7 +17,6 @@ import evaluate
|
|
17 |
import datasets
|
18 |
|
19 |
|
20 |
-
|
21 |
# TODO: Add BibTeX citation
|
22 |
_CITATION = """\
|
23 |
@misc{li2023llm,
|
@@ -46,9 +45,11 @@ Args:
|
|
46 |
should be a string with tokens separated by spaces.
|
47 |
references: list of reference for each prediction. Each
|
48 |
reference should be a string with tokens separated by spaces.
|
|
|
|
|
|
|
49 |
Returns:
|
50 |
-
accuracy: description of the first score
|
51 |
-
another_score: description of the second score,
|
52 |
Examples:
|
53 |
Examples should be written in doctest format, and should illustrate how
|
54 |
to use the function.
|
|
|
17 |
import datasets
|
18 |
|
19 |
|
|
|
20 |
# TODO: Add BibTeX citation
|
21 |
_CITATION = """\
|
22 |
@misc{li2023llm,
|
|
|
45 |
should be a string with tokens separated by spaces.
|
46 |
references: list of reference for each prediction. Each
|
47 |
reference should be a string with tokens separated by spaces.
|
48 |
+
execute_func: function that executes sql query on database.
|
49 |
+
filter_func: function that returns true, if sql query can make changes to the database,
|
50 |
+
else false.
|
51 |
Returns:
|
52 |
+
accuracy: description of the first score
|
|
|
53 |
Examples:
|
54 |
Examples should be written in doctest format, and should illustrate how
|
55 |
to use the function.
|