metadata

language:
  - eng
pipeline_tag: text-generation
Trained: Pretrain
Config file: 1.3B
Data: Vietnamese Dataset 30GB(CulturaX) + Project(1.3B)

Model Card for Model ID

Developed by: Eunyoung Lee
Model type: GPT-NeoX
Language(s) (NLP): Vietnamese

Pretrained GPT-NeoX model with 31.3 Vietnamese dataset. Took about 4.5 hours to reach 40,000 iterations. Trained on A100 40GB GPU and 48 core CPU.

Model Details