Update README.md
Browse files
README.md
CHANGED
@@ -34,7 +34,7 @@ This model is a Dutch chat model, originally developed from Mistral 7B v0.3 Inst
|
|
34 |
## Intended uses & limitations
|
35 |
|
36 |
This model could still generate wrong, misleading, and potentially even offensive content. Use at your own risk.
|
37 |
-
Use with Mistral's chat template (can be found in the tokenizer)
|
38 |
|
39 |
## Training procedure
|
40 |
|
@@ -43,7 +43,7 @@ This model was trained with QLoRa in bfloat16 with flash attention 2 on oen A100
|
|
43 |
|
44 |
## Evaluation results
|
45 |
|
46 |
-
The model was evaluated using [scandeval](https://scandeval.com/dutch-nlg/). There are improvements in 4/7 benchmarks compared to the Mistral-7B-v0.3-Instruct model.
|
47 |
|
48 |
| Model| conll_nl | dutch_social | scala_nl | squad_nl | wiki_lingua_nl | mmlu_nl | hellaswag_nl |
|
49 |
|:-------------:|:-----:|:----:|:---------------:|:--------------:|:----------------:|:------------------:|:---------------:
|
@@ -77,4 +77,5 @@ The following hyperparameters were used during training:
|
|
77 |
|
78 |
## Model Developer
|
79 |
|
80 |
-
|
|
|
|
34 |
## Intended uses & limitations
|
35 |
|
36 |
This model could still generate wrong, misleading, and potentially even offensive content. Use at your own risk.
|
37 |
+
Use with Mistral's chat template (can be found in the tokenizer).
|
38 |
|
39 |
## Training procedure
|
40 |
|
|
|
43 |
|
44 |
## Evaluation results
|
45 |
|
46 |
+
The model was evaluated using [scandeval](https://scandeval.com/dutch-nlg/). There are improvements in 4/7 benchmarks compared to the Mistral-7B-v0.3-Instruct model it was based on.
|
47 |
|
48 |
| Model| conll_nl | dutch_social | scala_nl | squad_nl | wiki_lingua_nl | mmlu_nl | hellaswag_nl |
|
49 |
|:-------------:|:-----:|:----:|:---------------:|:--------------:|:----------------:|:------------------:|:---------------:
|
|
|
77 |
|
78 |
## Model Developer
|
79 |
|
80 |
+
The Mistral-7B-v0.3-Instruct model this model is based on is created by [Mistral AI](https://huggingface.co/mistralai).
|
81 |
+
The finetuning was done by [Julien Van den Avenne](https://huggingface.co/vandeju)
|