metadata
language: en
thumbnail: >-
https://i.ibb.co/HBqvBFY/mountain-xianxia-chinese-scenic-landscape-craggy-mist-action-scene-pagoda-s-2336925014-1.png
tags:
- text generation
- pytorch
Qilin-lit-6b (V1.1.0)
Fine-tuned version of EleutherAI/gpt-j-6B on Coreweave's infrastructure (https://www.coreweave.com/) using an A40 over ~80 hours.
3150 steps, 1 epoch trained on 550 MB of primarily Xianxia genre Webnovels. (Translated to English)
Version History
1.0.0 - 100 MB dataset 300 steps epoch 1