llama-lite-134m / README.md
skeskinen's picture
Update README.md
cc5d773
---
license: apache-2.0
---
134m parameter, 768 width version of Llama for creating sentence embeddings
https://github.com/skeskinen/llama-lite
Currently trained on just the alpaca dataset, but might contain better weights later.