naxalpha commited on
Commit
113af5d
1 Parent(s): fafecad

add read me

Browse files
Files changed (1) hide show
  1. README.md +4 -0
README.md ADDED
@@ -0,0 +1,4 @@
 
 
 
 
 
1
+ # GPT-2 (125M) 4k tokens
2
+
3
+ Fine-tuned GPT2 Smallest model on The Pile with a token length of 4k.
4
+ Weights are included and it follows Karpathy's nanoGPT implementation.