Update README.md

README.md

@@ -40,30 +40,32 @@ used in the original [RoBERTA](https://github.com/pytorch/fairseq/tree/master/ex
 
 ## Training corpora and preprocessing
 
-The training corpus is composed of several biomedical corpora in Spanish, collected from publicly available corpora and crawlers:
+The training corpus is composed of several biomedical corpora in Spanish, collected from publicly available corpora and crawlers.
+To obtain a high-quality training corpus, a cleaning pipeline with the following operations has been applied:
+
+- data parsing in different formats
+  - sentence splitting
+  - language detection
+  - filtering of ill-formed sentences 
+  - deduplication of repetitive contents
+  - keep the original document boundaries
+
+Finally, the corpora are concatenated and further global deduplication among the corpora have been applied.
+The result is a medium-size biomedical corpus for Spanish composed of about 860M tokens. The table below shows some basic statistics of the individual cleaned corpora:
+
     
 | Name                                                                                    | No. tokens  | Description                                                                                                                                                                                                                                          |
 |-----------------------------------------------------------------------------------------|-------------|------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
 | [Medical crawler](https://zenodo.org/record/4561971#.YTtwM32xXbQ)                       | 745,705,946 | Crawler of more than 3,000 URLs belonging to Spanish biomedical and health domains.                                                                                                                                                                                 |
 | [Scielo](https://github.com/PlanTL-SANIDAD/SciELO-Spain-Crawler)                        | 60,007,289  | Publications written in Spanish crawled from the Spanish SciELO server in 2017.                                                                                                                                       |
 | [BARR2_background](https://temu.bsc.es/BARR2/downloads/background_set.raw_text.tar.bz2) | 24,516,442  | Biomedical Abbreviation Recognition and Resolution (BARR2) containing Spanish clinical case study sections from a variety of clinical disciplines.                                                                                       |
-| Wikipedia_life_sciences                                                                 | 13,890,501  | Wikipedia articles belonging to the Life Sciences category crawled on 04/01/2021                                                                                                                                                                      |
+| Wikipedia_life_sciences                                                                 | 13,890,501  | Wikipedia articles crawled 04/01/2021 with the [Wikipedia API python library](https://pypi.org/project/Wikipedia-API/) starting from the "Ciencias\_de\_la\_vida" category up to a maximum of 5 subcategories. Multiple links to the same articles are then discarded to avoid repeating content.                                                                                                             |
 | Patents                                                                                 | 13,463,387  | Google Patent in Medical Domain for Spain (Spanish). The accepted codes (Medical Domain) for Json files of patents are: "A61B", "A61C","A61F", "A61H", "A61K", "A61L","A61M", "A61B", "A61P".                                                        |
 | [EMEA](http://opus.nlpl.eu/download.php?f=EMEA/v3/moses/en-es.txt.zip)                  | 5,377,448   | Spanish-side documents extracted from parallel corpora made out of PDF documents from the European Medicines Agency.                                                                                                                            |
 | [mespen_Medline](https://zenodo.org/record/3562536#.YTt1fH2xXbR)                        | 4,166,077   | Spanish-side articles extracted from a collection of Spanish-English parallel corpus consisting of biomedical scientific literature.  The collection of parallel resources are aggregated from the MedlinePlus source. |
 | PubMed                                                                                  | 1,858,966   | Open-access articles from the PubMed repository crawled in 2017.                                                                                                                                              |
 
-To obtain a high-quality training corpus, a cleaning pipeline with the following operations has been applied:
-
-- data parsing in different formats
-  - sentence splitting
-  - language detection
-  - filtering of ill-formed sentences 
-  - deduplication of repetitive contents
-  - keep the original document boundaries
 
-Finally, the corpora are concatenated and further global deduplication among the corpora have been applied.
-The result is a medium-size biomedical corpus for Spanish composed of about 860M tokens.
 
 ## Evaluation and results