Update app.py
Browse files
app.py
CHANGED
@@ -61,6 +61,40 @@ Here is an outline of some of the most exciting recent developments in AI:
|
|
61 |
6. [217 other models optimized for use with Bloom](https://huggingface.co/models?other=bloom)
|
62 |
|
63 |
- 📚 Datasets:
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
64 |
1. [Universal Dependencies](https://paperswithcode.com/dataset/universal-dependencies)
|
65 |
2. [WMT 2014](https://paperswithcode.com/dataset/wmt-2014)
|
66 |
3. [The Pile](https://paperswithcode.com/dataset/the-pile)
|
|
|
61 |
6. [217 other models optimized for use with Bloom](https://huggingface.co/models?other=bloom)
|
62 |
|
63 |
- 📚 Datasets:
|
64 |
+
|
65 |
+
- Universal Dependencies: A collection of annotated corpora for natural language processing in a range of languages, with a focus on dependency parsing.
|
66 |
+
- [Universal Dependencies official website.](https://universaldependencies.org/)
|
67 |
+
|
68 |
+
- WMT 2014: The fourth edition of the Workshop on Statistical Machine Translation, featuring shared tasks on translating between English and various other languages.
|
69 |
+
- [WMT14 website.](http://www.statmt.org/wmt14/)
|
70 |
+
|
71 |
+
- The Pile: An English language corpus of diverse text, sourced from various places on the internet.
|
72 |
+
- [The Pile official website.](https://pile.eleuther.ai/)
|
73 |
+
|
74 |
+
- HumanEval: A dataset of English sentences, annotated with human judgments on a range of linguistic qualities.
|
75 |
+
- [HumanEval: An Evaluation Benchmark for Language Understanding](https://github.com/google-research-datasets/humaneval) by Gabriel Ilharco, Daniel Loureiro, Pedro Rodriguez, and Afonso Mendes.
|
76 |
+
|
77 |
+
- FLORES-101: A dataset of parallel sentences in 101 languages, designed for multilingual machine translation.
|
78 |
+
- [FLORES-101: A Massively Multilingual Parallel Corpus for Language Understanding](https://flores101.opennmt.net/) by Aman Madaan, Shruti Rijhwani, Raghav Gupta, and Mitesh M. Khapra.
|
79 |
+
|
80 |
+
- CrowS-Pairs: A dataset of sentence pairs, designed for evaluating the plausibility of generated text.
|
81 |
+
- [CrowS-Pairs: A Challenge Dataset for Plausible Plausibility Judgments](https://github.com/stanford-cogsci/crows-pairs) by Andrea Madotto, Zhaojiang Lin, Chien-Sheng Wu, Pascale Fung, and Caiming Xiong.
|
82 |
+
|
83 |
+
- WikiLingua: A dataset of parallel sentences in 75 languages, sourced from Wikipedia.
|
84 |
+
- [WikiLingua: A New Benchmark Dataset for Cross-Lingual Wikification](https://arxiv.org/abs/2105.08031) by Jiarui Yao, Yanqiao Zhu, Ruihan Bao, Guosheng Lin, Lidong Bing, and Bei Shi.
|
85 |
+
|
86 |
+
- MTEB: A dataset of English sentences, annotated with their entailment relationships with respect to other sentences.
|
87 |
+
- [Multi-Task Evaluation Benchmark for Natural Language Inference](https://github.com/google-research-datasets/mteb) by Michał Lukasik, Marcin Junczys-Dowmunt, and Houda Bouamor.
|
88 |
+
|
89 |
+
- xP3: A dataset of English sentences, annotated with their paraphrase relationships with respect to other sentences.
|
90 |
+
- [xP3: A Large-Scale Evaluation Benchmark for Paraphrase Identification in Context](https://github.com/nyu-dl/xp3) by Aniket Didolkar, James Mayfield, Markus Saers, and Jason Baldridge.
|
91 |
+
|
92 |
+
- DiaBLa: A dataset of English dialogue, annotated with dialogue acts.
|
93 |
+
- [A Large-Scale Corpus for Conversation Disentanglement](https://github.com/HLTCHKUST/DiaBLA) by Samuel Broscheit, António Branco, and André F. T. Martins.
|
94 |
+
|
95 |
+
|
96 |
+
- 📚 Dataset Papers with Code
|
97 |
+
|
98 |
1. [Universal Dependencies](https://paperswithcode.com/dataset/universal-dependencies)
|
99 |
2. [WMT 2014](https://paperswithcode.com/dataset/wmt-2014)
|
100 |
3. [The Pile](https://paperswithcode.com/dataset/the-pile)
|