sade-adrien
commited on
Commit
·
f35a87d
1
Parent(s):
7ce28a0
Update README.md
Browse files
README.md
CHANGED
@@ -28,7 +28,7 @@ More information needed
|
|
28 |
|
29 |
## Training and evaluation data
|
30 |
|
31 |
-
Data is a 9k sample from the RedPajama datset. The context is <=7200 with a decreasing exponential
|
32 |
|
33 |
## Training procedure
|
34 |
|
|
|
28 |
|
29 |
## Training and evaluation data
|
30 |
|
31 |
+
Data is a 9k sample from the RedPajama datset. The context is <=7200 with a decreasing exponential distribution of scale 1500.
|
32 |
|
33 |
## Training procedure
|
34 |
|