|
|
|
--- |
|
language: en |
|
thumbnail: "https://i.ibb.co/HBqvBFY/mountain-xianxia-chinese-scenic-landscape-craggy-mist-action-scene-pagoda-s-2336925014-1.png" |
|
tags: |
|
- text generation |
|
- pytorch |
|
|
|
--- |
|
|
|
## Qilin-lit-6b (V1.1.0) |
|
|
|
Fine-tuned version of EleutherAI/gpt-j-6B on Coreweave's infrastructure (<https://www.coreweave.com/>) using an A40 over ~80 hours. |
|
|
|
3150 steps, 1 epoch trained on 550 MB of primarily Xianxia genre Webnovels. (Translated to English) |
|
|
|
--- |
|
|
|
## Version History |
|
|
|
1.0.0 - 100 MB dataset 300 steps epoch 1 |
