---
license: apache-2.0
---


134m parameter, 768 width version of Llama for creating sentence embeddings

https://github.com/skeskinen/llama-lite

Currently trained on just the alpaca dataset, but might contain better weights later.