daviddrzik
commited on
Commit
•
be16b9b
1
Parent(s):
2c3ee41
Update README.md
Browse files
README.md
CHANGED
@@ -9,7 +9,7 @@ library_name: transformers
|
|
9 |
---
|
10 |
# Slovak Morphological Baby Language Model (SK_Morph_BLM)
|
11 |
|
12 |
-
**SK_Morph_BLM** is a pretrained small language model for the Slovak language, based on the RoBERTa architecture. The model utilizes a custom morphological tokenizer specifically designed for the Slovak language, which focuses on **preserving the integrity of root morphemes**. This tokenizer is not compatible with the standard `RobertaTokenizer` from the Hugging Face library due to its unique approach to tokenization. The model is case-insensitive, meaning it operates in lowercase. While the pretrained model can be used for masked language modeling, it is primarily intended for fine-tuning on downstream NLP tasks.
|
13 |
|
14 |
## How to Use the Model
|
15 |
|
|
|
9 |
---
|
10 |
# Slovak Morphological Baby Language Model (SK_Morph_BLM)
|
11 |
|
12 |
+
**SK_Morph_BLM** is a pretrained small language model for the Slovak language, based on the RoBERTa architecture. The model utilizes a custom morphological tokenizer (**SKMT**, more info [here](https://github.com/daviddrzik/Slovak_subword_tokenizers)) specifically designed for the Slovak language, which focuses on **preserving the integrity of root morphemes**. This tokenizer is not compatible with the standard `RobertaTokenizer` from the Hugging Face library due to its unique approach to tokenization. The model is case-insensitive, meaning it operates in lowercase. While the pretrained model can be used for masked language modeling, it is primarily intended for fine-tuning on downstream NLP tasks.
|
13 |
|
14 |
## How to Use the Model
|
15 |
|