Update README.md
Browse files
README.md
CHANGED
|
@@ -17,6 +17,8 @@ Training was done on [Karolina](https://www.it4i.cz/en) cluster.
|
|
| 17 |
|
| 18 |
# <span style="color:blue">Latest Updates</span>
|
| 19 |
- 18/04/2024 We released all our training checkpoints (in MosaicML format & packed using ZPAQ) at [czechllm.fit.vutbr.cz/csmpt7b/checkpoints/](https://czechllm.fit.vutbr.cz/csmpt7b/checkpoints/)
|
|
|
|
|
|
|
| 20 |
# Evaluation
|
| 21 |
Dev eval at CS-HellaSwag (automatically translated HellaSwag benchmark).
|
| 22 |
| Model | CS-HellaSwag Accuracy |
|
|
|
|
| 17 |
|
| 18 |
# <span style="color:blue">Latest Updates</span>
|
| 19 |
- 18/04/2024 We released all our training checkpoints (in MosaicML format & packed using ZPAQ) at [czechllm.fit.vutbr.cz/csmpt7b/checkpoints/](https://czechllm.fit.vutbr.cz/csmpt7b/checkpoints/)
|
| 20 |
+
- 06/05/2024 We released small manually annotated [dataset of adult content](https://huggingface.co/datasets/BUT-FIT/adult_content_classifier_dataset). We used classifier trained on this dataset for filtering our corpus.
|
| 21 |
+
-
|
| 22 |
# Evaluation
|
| 23 |
Dev eval at CS-HellaSwag (automatically translated HellaSwag benchmark).
|
| 24 |
| Model | CS-HellaSwag Accuracy |
|