Update README.md
Browse files
README.md
CHANGED
|
@@ -34,11 +34,12 @@ This repository includes the quantized models for the [ReMM V2.2](https://huggin
|
|
| 34 |
|
| 35 |
There are a couple places you can use an exl2 model, here are a few:
|
| 36 |
|
|
|
|
|
|
|
|
|
|
| 37 |
- [oobabooga's Text Gen Webui](https://github.com/oobabooga/text-generation-webui)
|
| 38 |
- When using the downloader, make sure to format like this: Anthonyg5005/ReMM-v2.2-L2-13B-exl2**\:QuantBranch**
|
| 39 |
- With 5-Bit download: [R136a1/ReMM-v2.2-L2-13B-exl2](https://huggingface.co/R136a1/ReMM-v2.2-L2-13B-exl2)
|
| 40 |
-
- [tabbyAPI](https://github.com/theroyallab/tabbyAPI)
|
| 41 |
-
- [ExUI](https://github.com/turboderp/exui)
|
| 42 |
- [KoboldAI](https://github.com/henk717/KoboldAI) (Clone repo, don't use snapshot)
|
| 43 |
|
| 44 |
## WARNING
|
|
|
|
| 34 |
|
| 35 |
There are a couple places you can use an exl2 model, here are a few:
|
| 36 |
|
| 37 |
+
- [tabbyAPI](https://github.com/theroyallab/tabbyAPI)
|
| 38 |
+
- [Aphrodite Engine](https://github.com/PygmalionAI/aphrodite-engine)
|
| 39 |
+
- [ExUI](https://github.com/turboderp/exui)
|
| 40 |
- [oobabooga's Text Gen Webui](https://github.com/oobabooga/text-generation-webui)
|
| 41 |
- When using the downloader, make sure to format like this: Anthonyg5005/ReMM-v2.2-L2-13B-exl2**\:QuantBranch**
|
| 42 |
- With 5-Bit download: [R136a1/ReMM-v2.2-L2-13B-exl2](https://huggingface.co/R136a1/ReMM-v2.2-L2-13B-exl2)
|
|
|
|
|
|
|
| 43 |
- [KoboldAI](https://github.com/henk717/KoboldAI) (Clone repo, don't use snapshot)
|
| 44 |
|
| 45 |
## WARNING
|