TheBloke
/

OpenAssistant-SFT-7-Llama-30B-GPTQ

Text Generation

text-generation-inference

4-bit precision

Model card Files Files and versions Community

TheBloke commited on Apr 29, 2023

Commit

dd08d1c

•

1 Parent(s): 1dd6eed

Update README.md

Files changed (1) hide show

README.md +1 -1

README.md CHANGED Viewed

@@ -66,7 +66,7 @@ Open the text-generation-webui UI as normal.
 3. Click **Download**.
 4. Wait until it says it's finished downloading.
 5. Click the **Refresh** icon next to **Model** in the top left.
-6. In the **Model drop-down**: choose the model you just downloaded, eg `OpenAssistant-SFT-7-Llama-30B-GPTQ`.
 7. If you see an error in the bottom right, ignore it - it's temporary.
 8. Fill out the `GPTQ parameters` on the right: `Bits = 4`, `Groupsize = 1024`, `model_type = Llama`
 9. Click **Save settings for this model** in the top right.

 3. Click **Download**.
 4. Wait until it says it's finished downloading.
 5. Click the **Refresh** icon next to **Model** in the top left.
+6. In the **Model drop-down**: choose the model you just downloaded, `OpenAssistant-SFT-7-Llama-30B-GPTQ`.
 7. If you see an error in the bottom right, ignore it - it's temporary.
 8. Fill out the `GPTQ parameters` on the right: `Bits = 4`, `Groupsize = 1024`, `model_type = Llama`
 9. Click **Save settings for this model** in the top right.