Commit
·
9598918
1
Parent(s):
95d9bd2
Update README.md
Browse files
README.md
CHANGED
|
@@ -10,6 +10,9 @@ datasets:
|
|
| 10 |
|
| 11 |
This repository contains the a Romanian cased version of DistilBERT (named DistilMulti-BERT-base-ro in the paper) that was obtained by distilling an ensemble of two teacher models: [dumitrescustefan/bert-base-romanian-cased-v1](https://huggingface.co/dumitrescustefan/bert-base-romanian-cased-v1) and [readerbench/RoBERT-base](https://huggingface.co/readerbench/RoBERT-base).
|
| 12 |
|
|
|
|
|
|
|
|
|
|
| 13 |
## Usage
|
| 14 |
|
| 15 |
```python
|
|
|
|
| 10 |
|
| 11 |
This repository contains the a Romanian cased version of DistilBERT (named DistilMulti-BERT-base-ro in the paper) that was obtained by distilling an ensemble of two teacher models: [dumitrescustefan/bert-base-romanian-cased-v1](https://huggingface.co/dumitrescustefan/bert-base-romanian-cased-v1) and [readerbench/RoBERT-base](https://huggingface.co/readerbench/RoBERT-base).
|
| 12 |
|
| 13 |
+
It was introduced in [this paper](https://arxiv.org/abs/2112.12650). The adjacent code can be found
|
| 14 |
+
[here](https://github.com/racai-ai/Romanian-DistilBERT).
|
| 15 |
+
|
| 16 |
## Usage
|
| 17 |
|
| 18 |
```python
|