---
library_name: peft
base_model: meta-llama/Llama-2-70b-hf
pipeline_tag: text-generation
tags:
- lora
---

Low-rank decomposition of [Xwin-LM/Xwin-LM-70B-V0.1](https://huggingface.co/Xwin-LM/Xwin-LM-70B-V0.1) using [meta-llama/Llama-2-70b-hf](https://huggingface.co/meta-llama/Llama-2-70b-hf) as base.

Created using my fork(script included in files) of [LoRD](https://github.com/thomasgauthier/LoRD).