julien-c HF staff commited on
Commit
889efdd
·
1 Parent(s): 27dbefa

Migrate model card from transformers-repo

Browse files

Read announcement at https://discuss.huggingface.co/t/announcement-all-model-cards-will-be-migrated-to-hf-co-model-repos/2755
Original file history: https://github.com/huggingface/transformers/commits/master/model_cards/deepset/gelectra-base-generator/README.md

Files changed (1) hide show
  1. README.md +46 -0
README.md ADDED
@@ -0,0 +1,46 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: de
3
+ license: mit
4
+ datasets:
5
+ - wikipedia
6
+ - OPUS
7
+ - OpenLegalData
8
+ ---
9
+
10
+ # German ELECTRA base generator
11
+
12
+ Released, Oct 2020, this is the generator component of the German ELECTRA language model trained collaboratively by the makers of the original German BERT (aka "bert-base-german-cased") and the dbmdz BERT (aka bert-base-german-dbmdz-cased). In our [paper](https://arxiv.org/pdf/2010.10906.pdf), we outline the steps taken to train our model.
13
+
14
+ The generator is useful for performing masking experiments. If you are looking for a regular language model for embedding extraction, or downstream tasks like NER, classification or QA, please use deepset/gelectra-base.
15
+
16
+ ## Overview
17
+ **Paper:** [here](https://arxiv.org/pdf/2010.10906.pdf)
18
+ **Architecture:** ELECTRA base (generator)
19
+ **Language:** German
20
+
21
+ See also:
22
+ deepset/gbert-base
23
+ deepset/gbert-large
24
+ deepset/gelectra-base
25
+ deepset/gelectra-large
26
+ deepset/gelectra-base-generator
27
+ deepset/gelectra-large-generator
28
+
29
+ ## Authors
30
+ Branden Chan: `branden.chan [at] deepset.ai`
31
+ Stefan Schweter: `stefan [at] schweter.eu`
32
+ Timo Möller: `timo.moeller [at] deepset.ai`
33
+
34
+ ## About us
35
+ ![deepset logo](https://raw.githubusercontent.com/deepset-ai/FARM/master/docs/img/deepset_logo.png)
36
+
37
+ We bring NLP to the industry via open source!
38
+ Our focus: Industry specific language models & large scale QA systems.
39
+
40
+ Some of our work:
41
+ - [German BERT (aka "bert-base-german-cased")](https://deepset.ai/german-bert)
42
+ - [FARM](https://github.com/deepset-ai/FARM)
43
+ - [Haystack](https://github.com/deepset-ai/haystack/)
44
+
45
+ Get in touch:
46
+ [Twitter](https://twitter.com/deepset_ai) | [LinkedIn](https://www.linkedin.com/company/deepset-ai/) | [Website](https://deepset.ai)