Update README.md
Browse files
README.md
CHANGED
@@ -91,10 +91,11 @@ while True:
|
|
91 |
|
92 |
# Using Model in OST
|
93 |
|
|
|
94 |
|
95 |
### LGeM 🚀
|
96 |
|
97 |
-
- what is LGeM, LGeM is a CausalLM Model that is trained on self instruct data (Alpaca data) and for
|
98 |
|
99 |
- it's Decoder Only
|
100 |
- built-in Pytorch
|
|
|
91 |
|
92 |
# Using Model in OST
|
93 |
|
94 |
+
## [Open Source Transformers](https://github.com/erfanzar/OST-OpenSourceTransformers)
|
95 |
|
96 |
### LGeM 🚀
|
97 |
|
98 |
+
- what is LGeM, LGeM is a CausalLM Model that is trained on self instruct data (Alpaca data) and for initialization of the first train of the main model (weights are available) I used pre weights from Alpaca LoRA (open source)
|
99 |
|
100 |
- it's Decoder Only
|
101 |
- built-in Pytorch
|