UnstableLlama/Rombos-LLM-V2.6-Nemotron-70b-exl2

Rombos-LLM-V2.6-Nemotron-70b by Rombodawg

---

ExLlamaV2 Quantization

Quantized with ExLlamaV2 v0.2.3

2.2 Bits Per Weight

4.65 Bits Per Weight

---

I applied the last step of my continuous finetuning method to the Nemotron-70b model from Nvidia. More details bellow:

• https://docs.google.com/document/d/1OjbjU5AOz4Ftn9xHQrX3oFQGhQ6RDUuXQipnQ9gn6tU/edit?usp=sharing

Quants: (Coming Soon)

Open-LLM-Leaderboard scores: (Coming soon)