Update README.md
Browse files
README.md
CHANGED
@@ -31,6 +31,7 @@ pipeline_tag: text-generation
|
|
31 |
library_name: transformers
|
32 |
base_model:
|
33 |
- openGPT-X/Teuken-7B-base-v0.4
|
|
|
34 |
---
|
35 |
# Model Card for Teuken-7B-instruct-v0.4
|
36 |
|
@@ -174,7 +175,7 @@ More information are available in our [preprint](http://arxiv.org/abs/2410.08800
|
|
174 |
|
175 |
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
176 |
Instruction fined tuned version of [Teuken-7B-base-v0.4](https://huggingface.co/openGPT-X/Teuken-7B-base-v0.4).
|
177 |
-
|
178 |
|
179 |
#### Training Hyperparameters
|
180 |
|
@@ -184,13 +185,15 @@ Instruction fined tuned version of [Teuken-7B-base-v0.4](https://huggingface.co/
|
|
184 |
|
185 |
<!-- This section describes the evaluation protocols and provides the results. -->
|
186 |
|
|
|
|
|
187 |
### Testing Data, Factors & Metrics
|
188 |
|
189 |
#### Testing Data
|
190 |
|
191 |
<!-- This should link to a Dataset Card if possible. -->
|
192 |
|
193 |
-
|
194 |
|
195 |
## Technical Specifications
|
196 |
|
|
|
31 |
library_name: transformers
|
32 |
base_model:
|
33 |
- openGPT-X/Teuken-7B-base-v0.4
|
34 |
+
license: apache-2.0
|
35 |
---
|
36 |
# Model Card for Teuken-7B-instruct-v0.4
|
37 |
|
|
|
175 |
|
176 |
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
177 |
Instruction fined tuned version of [Teuken-7B-base-v0.4](https://huggingface.co/openGPT-X/Teuken-7B-base-v0.4).
|
178 |
+
More information regarding the challenges during pre-training are available [here](https://arxiv.org/abs/2410.03730)
|
179 |
|
180 |
#### Training Hyperparameters
|
181 |
|
|
|
185 |
|
186 |
<!-- This section describes the evaluation protocols and provides the results. -->
|
187 |
|
188 |
+
More information regarding our translated benchmarks are available in our [preprint](https://arxiv.org/abs/2410.08928).
|
189 |
+
|
190 |
### Testing Data, Factors & Metrics
|
191 |
|
192 |
#### Testing Data
|
193 |
|
194 |
<!-- This should link to a Dataset Card if possible. -->
|
195 |
|
196 |
+
Teuken-7B-instruct-commercial was evaluated in 21 languages on ARC, GSM8K, HellaSwag, TruthfulQA, Translation and MMLU. Results can be seen in the [European LLM Leaderboard](https://huggingface.co/spaces/openGPT-X/european-llm-leaderboard).
|
197 |
|
198 |
## Technical Specifications
|
199 |
|