Model Card for Model ID
Pretrained GPT-NeoX model with 2.06GB English news dataset. Took about 10 hours to reach 20,000 iterations. Trained on p3.16xlarge.
Different hyperparameter: gradient_accumulation_step 4
Model Details
Model Description
- Developed by: Eunyoung Lee
- Model type: GPT-NeoX
- Language(s) (NLP): English
- Downloads last month
- 5
Inference Providers
NEW
This model isn't deployed by any Inference Provider.
🙋
Ask for provider support