Update src/tasks_content.py
Browse files- src/tasks_content.py +7 -1
src/tasks_content.py
CHANGED
@@ -25,7 +25,13 @@ TASKS_DESCRIPTIONS = {
|
|
25 |
|
26 |
**Note.** The leaderboard is sorted by ROUGE-1 metric by default.
|
27 |
""",
|
28 |
-
"bug_localization": "
|
|
|
|
|
|
|
|
|
|
|
|
|
29 |
"module_to_text": """# Module-to-Text\n
|
30 |
|
31 |
Our Module-to-Text benchmark 🤗 [JetBrains-Research/lca-module-to-text](https://huggingface.co/datasets/JetBrains-Research/lca-module-to-text) includes 206 manually curated text files describing modules from different Python projects.
|
|
|
25 |
|
26 |
**Note.** The leaderboard is sorted by ROUGE-1 metric by default.
|
27 |
""",
|
28 |
+
"bug_localization": """# Bug Localization\n
|
29 |
+
|
30 |
+
Our Module-to-Text benchmark 🤗 [JetBrains-Research/lca-bug-localization](https://huggingface.co/datasets/JetBrains-Research/lca-bug-localization) includes 7,479 bug issue descriptions with information about pull request that fix them for Python, Java and Kotlin projects.
|
31 |
+
|
32 |
+
Moreover, 150 data points from the test split were manually verified and can be used for bug localization approaches evaluation.
|
33 |
+
We used information retrieval metrics such as R@k, P@k and F1-score for evaluation, taking k equals to 2.
|
34 |
+
""",
|
35 |
"module_to_text": """# Module-to-Text\n
|
36 |
|
37 |
Our Module-to-Text benchmark 🤗 [JetBrains-Research/lca-module-to-text](https://huggingface.co/datasets/JetBrains-Research/lca-module-to-text) includes 206 manually curated text files describing modules from different Python projects.
|