Spaces:
Running
Running
Update README.md
Browse files
README.md
CHANGED
@@ -16,11 +16,15 @@ We value:
|
|
16 |
In this organization, you can find RoLLM models, based on different underlying models and in different flavours (i.e., foundational, instruct, or chat variants). There are currently four model collections:
|
17 |
- RoLlama2: Romanian models based on Llama2
|
18 |
- RoMistral: Romanian models based on Mistral
|
19 |
-
- RoGemma: Romanian models based on Gemma
|
20 |
- RoLlama3: Romanian models based on Llama3
|
|
|
|
|
|
|
|
|
21 |
|
22 |
-
Furthermore, here you can find data used to train and evaluate LLMs in Romanian. Currently, there are
|
23 |
- SFT datasets: data used for supervised (instruction) finetuning
|
|
|
24 |
- Evaluation datasets: data used for evaluating LLM in Romanian
|
25 |
|
26 |
See details in [https://arxiv.org/abs/2406.18266](https://arxiv.org/abs/2406.18266) and [https://arxiv.org/abs/2405.07703](https://arxiv.org/abs/2405.07703).
|
|
|
16 |
In this organization, you can find RoLLM models, based on different underlying models and in different flavours (i.e., foundational, instruct, or chat variants). There are currently four model collections:
|
17 |
- RoLlama2: Romanian models based on Llama2
|
18 |
- RoMistral: Romanian models based on Mistral
|
|
|
19 |
- RoLlama3: Romanian models based on Llama3
|
20 |
+
- RoLlama3.1: Romanian models based on Llama3.1
|
21 |
+
- RoGemma: Romanian models based on Gemma
|
22 |
+
- RoGemma2: Romanian models based on Gemma2
|
23 |
+
|
24 |
|
25 |
+
Furthermore, here you can find data used to train and evaluate LLMs in Romanian. Currently, there are three data collections:
|
26 |
- SFT datasets: data used for supervised (instruction) finetuning
|
27 |
+
- Alignment datasets: data used mainly for Direct Preference Optimization (DPO)
|
28 |
- Evaluation datasets: data used for evaluating LLM in Romanian
|
29 |
|
30 |
See details in [https://arxiv.org/abs/2406.18266](https://arxiv.org/abs/2406.18266) and [https://arxiv.org/abs/2405.07703](https://arxiv.org/abs/2405.07703).
|