license: apache-2.0
tags:
- code
- safetensors
- chatbot
- 0.7B
datasets:
- Keynote-Technology/PLANE-2K
- togethercomputer/RedPajama-Data-V2
TinyKAI 0.7B
Model Details
TinyKAI-0.7B is one of the world's SMALLEST "large" language models EVER! We acheived such a feat by essentially compressing GPT2 and squeezing it to be UNDER 1 billion parameters!
Uses
Due to being one of the tiniest "large" language models on huggingface, many corners had to be cut. TinyKAI-0.7B has a max output of only 150 characters per computation (without repeating itself). Therefore, TinyKAI is only intended for research purposes.
Banned Use
TinyKAI-1B is governed by the apache 2.0 liscense, and therefore means that whatever the license deems unacceptable shall not be allowed. We specificaly ban the use of ANY AND ALL KAI MODELS for hate speech towards a paricular thing, person, our particular group due to legal and ethical issues.
Limitations
100 characters max output length, English only, and extremely small.
Recommendations
TinyKAI-0.7B is a very small model, and is good for AI research especially.