HugoLaurencon
commited on
Commit
·
a93d027
1
Parent(s):
25ff6d2
Update README.md
Browse files
README.md
CHANGED
@@ -118,7 +118,7 @@ The model is trained on the following data mixture of openly accessible English
|
|
118 |
| [OBELISC](https://huggingface.co/datasets/HuggingFaceM4/OBELISC) | Unstructured Multimodal Web Documents | 114.9B | 353M | 1 | 73.85% |
|
119 |
| [Wikipedia](https://huggingface.co/datasets/wikipedia) | Unstructured Multimodal Web Documents | 3.192B | TODO | 3 | 6.15% |
|
120 |
| [LAION](https://huggingface.co/datasets/laion/laion2B-en) | Image-Text Pairs | 29.9B | TODO | 1 | 17.18%
|
121 |
-
| [PMD](https://huggingface.co/datasets/facebook/pmd) | Image-Text Pairs | 1.6B |
|
122 |
|
123 |
**OBELISC** is an open, massive and curated collection of interleaved image-text web documents, containing 141M documents, 115B text tokens and 353M images. An interactive visualization of the dataset content is available [here](TODO).
|
124 |
|
|
|
118 |
| [OBELISC](https://huggingface.co/datasets/HuggingFaceM4/OBELISC) | Unstructured Multimodal Web Documents | 114.9B | 353M | 1 | 73.85% |
|
119 |
| [Wikipedia](https://huggingface.co/datasets/wikipedia) | Unstructured Multimodal Web Documents | 3.192B | TODO | 3 | 6.15% |
|
120 |
| [LAION](https://huggingface.co/datasets/laion/laion2B-en) | Image-Text Pairs | 29.9B | TODO | 1 | 17.18%
|
121 |
+
| [PMD](https://huggingface.co/datasets/facebook/pmd) | Image-Text Pairs | 1.6B | 70M | 3 | 2.82% | |
|
122 |
|
123 |
**OBELISC** is an open, massive and curated collection of interleaved image-text web documents, containing 141M documents, 115B text tokens and 353M images. An interactive visualization of the dataset content is available [here](TODO).
|
124 |
|