alimosavian
commited on
Update README.md
Browse files
README.md
CHANGED
@@ -13,9 +13,12 @@ language:
|
|
13 |
|
14 |
### Model Description
|
15 |
|
16 |
-
|
|
|
|
|
|
|
|
|
17 |
|
18 |
-
This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
|
19 |
|
20 |
- **Funded, Developed and shared by:** [42 Labs](https://www.42labs.ai)
|
21 |
- **Model type:** Auto-regressive transformer
|
|
|
13 |
|
14 |
### Model Description
|
15 |
|
16 |
+
This is the first release of a series of Swedish large language models we call "Lynx". Micro is a small model (2 billion params), but punches way above its weight!
|
17 |
+
|
18 |
+
Lynx micro is a fine-tune of Google DeepMind Gemma 2B, scores just below GPT-3.5 Turbo on Scandeval (https://www.scandeval.com). In fact, the only non OpenAI model (currently) topping the Swedish NLG board on scandeval is a fine-tune of Llama-3 by AI Sweden based on our data recipe.
|
19 |
+
|
20 |
+
This is a really good model (for its size), but keep in mind that it is still a small model and hasn't memorized as much as larger models tend to do.
|
21 |
|
|
|
22 |
|
23 |
- **Funded, Developed and shared by:** [42 Labs](https://www.42labs.ai)
|
24 |
- **Model type:** Auto-regressive transformer
|