llama-lite-134m / README.md
skeskinen's picture
Update README.md
cc5d773
metadata
license: apache-2.0

134m parameter, 768 width version of Llama for creating sentence embeddings

https://github.com/skeskinen/llama-lite

Currently trained on just the alpaca dataset, but might contain better weights later.