iliemihai commited on
Commit
96ed2e0
1 Parent(s): eed2ee9

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -1
README.md CHANGED
@@ -14,7 +14,7 @@ tags:
14
 
15
  This model is a GPT-Neo transformer decoder model designed using EleutherAI's replication of the GPT-3 architecture.
16
 
17
- It was trained on a thoroughly cleaned corpus of Romanian text of about 40GB composed of Oscar, Opus, Wikipedia, literature and various other bits and pieces of text, joined together and deduplicated. It was trained for about a month, totaling 1.5M steps on a v3-32 TPU machine.
18
 
19
  ### Authors:
20
  * Dumitrescu Stefan
 
14
 
15
  This model is a GPT-Neo transformer decoder model designed using EleutherAI's replication of the GPT-3 architecture.
16
 
17
+ It was trained on a thoroughly cleaned corpus of Romanian text of about 40GB composed of Oscar, Opus, Wikipedia, literature and various other bits and pieces of text, joined together and deduplicated. It was trained for about a month, totaling 5.8M steps on a v3 TPU machine.
18
 
19
  ### Authors:
20
  * Dumitrescu Stefan