Small tweak for CMG description
Browse files- src/tasks_content.py +2 -2
src/tasks_content.py
CHANGED
@@ -54,7 +54,7 @@ TASKS_DESCRIPTIONS = {
|
|
54 |
|
55 |
"commit_message_generation": """# Commit Message Generation\n
|
56 |
|
57 |
-
Our Commit Message Generation benchmark ๐ค [JetBrains-Research/lca-commit-message-generation](https://huggingface.co/datasets/JetBrains-Research/lca-commit-message-generation) includes 163 manually curated commits from Python projects.
|
58 |
|
59 |
We use the following metrics for evaluation:
|
60 |
* [BLEU](https://huggingface.co/spaces/evaluate-metric/sacrebleu)
|
@@ -62,7 +62,7 @@ TASKS_DESCRIPTIONS = {
|
|
62 |
* [ChrF](https://huggingface.co/spaces/evaluate-metric/chrf)
|
63 |
* [BERTScore](https://huggingface.co/spaces/evaluate-metric/bertscore)
|
64 |
|
65 |
-
For further details on the dataset and the baselines from ๐๏ธ Long Code Arena Team, refer to `commit_message_generation` folder in [our baselines repository](https://github.com/JetBrains-Research/lca-baselines) or to our preprint
|
66 |
|
67 |
**Note.** The leaderboard is sorted by ROUGE-1 metric by default.
|
68 |
""",
|
|
|
54 |
|
55 |
"commit_message_generation": """# Commit Message Generation\n
|
56 |
|
57 |
+
Our Commit Message Generation benchmark ๐ค [JetBrains-Research/lca-commit-message-generation](https://huggingface.co/datasets/JetBrains-Research/lca-commit-message-generation) includes 163 manually curated commits from 34 Python projects.
|
58 |
|
59 |
We use the following metrics for evaluation:
|
60 |
* [BLEU](https://huggingface.co/spaces/evaluate-metric/sacrebleu)
|
|
|
62 |
* [ChrF](https://huggingface.co/spaces/evaluate-metric/chrf)
|
63 |
* [BERTScore](https://huggingface.co/spaces/evaluate-metric/bertscore)
|
64 |
|
65 |
+
For further details on the dataset and the baselines from ๐๏ธ Long Code Arena Team, refer to `commit_message_generation` folder in [our baselines repository](https://github.com/JetBrains-Research/lca-baselines) or to our preprint.
|
66 |
|
67 |
**Note.** The leaderboard is sorted by ROUGE-1 metric by default.
|
68 |
""",
|