|
--- |
|
language: |
|
- eng |
|
pipeline_tag: text-generation |
|
|
|
Trained: Pretrain |
|
Config file: 1.3B |
|
Data: Vietnamese Dataset 30GB(CulturaX) + Project(1.3B) |
|
--- |
|
# Model Card for Model ID |
|
|
|
<!-- Provide a quick summary of what the model is/does. --> |
|
|
|
Pretrained GPT-NeoX model with 31.3 Vietnamese dataset. Took about 4.5 hours to reach 40,000 iterations. Trained on A100 40GB GPU and 48 core CPU. |
|
|
|
## Model Details |
|
|
|
### Model Description |
|
|
|
<!-- Provide a longer summary of what this model is. --> |
|
|
|
|
|
|
|
- **Developed by:** Eunyoung Lee |
|
- **Model type:** GPT-NeoX |
|
- **Language(s) (NLP):** Vietnamese |
|
|
