pszemraj
/

stablelm-7b-sft-v7e3-autogptq-4bit-128g

Text Generation

Model card Files Files and versions Community

pszemraj commited on Jun 2, 2023

Commit

97b3799

·

1 Parent(s): 5695767

link AutoGPTQ

https://github.com/PanQiWei/AutoGPTQ

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -18,7 +18,7 @@ language:
   <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
 </a>
-A GPTQ version of the [Open-Assistant StableLM-7B SFT-7 Model](https://huggingface.co/OpenAssistant/stablelm-7b-sft-v7-epoch-3) quantized via auto-gptq.
 Will update this more later - take a look at the colab for now to see an inference example, or a [stripped-down version of the notebook here](https://gist.github.com/pszemraj/fc5b03b6bb7386991163eaaa9e0dc14d)

   <img src="https://colab.research.google.com/assets/colab-badge.svg" alt="Open In Colab"/>
 </a>
+A GPTQ version of the [Open-Assistant StableLM-7B SFT-7 Model](https://huggingface.co/OpenAssistant/stablelm-7b-sft-v7-epoch-3) quantized via [AutoGPTQ](https://github.com/PanQiWei/AutoGPTQ)
 Will update this more later - take a look at the colab for now to see an inference example, or a [stripped-down version of the notebook here](https://gist.github.com/pszemraj/fc5b03b6bb7386991163eaaa9e0dc14d)