pere commited on
Commit
fe66d78
1 Parent(s): cd5ea82

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +13 -5
README.md CHANGED
@@ -5,12 +5,20 @@ tags:
5
  - norwegian
6
  - GPT2
7
  - casual language modeling
8
- datasets:
9
- - oscar
10
  ---
11
 
12
- # Norwegian GPT-2 - Oscar
13
 
14
  ## Description
15
-
16
- This is a sample reference model trained only on the Oscar Corpus for a day on a TPU v3-8. Pretrained model on Norwegian language using a causal language modeling (CLM) objective.
 
 
 
 
 
 
 
 
 
 
 
5
  - norwegian
6
  - GPT2
7
  - casual language modeling
 
 
8
  ---
9
 
10
+ # Norwegian GPT-2 - Social
11
 
12
  ## Description
13
+ Experimental Norwegian GPT-2-model trained on a 37GB mainly social corpus.
14
+ The following sub-corpora are used:
15
+ wikipedia_download_nb.jsonl
16
+ wikipedia_download_nn.jsonl
17
+ newspapers_online_nb.jsonl
18
+ newspapers_online_nn.jsonl
19
+ twitter_2016_2018_no.jsonl
20
+ twitter_news_2016_2018_no.jsonl
21
+ open_subtitles_no.jsonl
22
+ facebook_no.jsonl
23
+ reddit_no.jsonl
24
+ vgdebatt_no.jsonl