Update README.md
Browse files
README.md
CHANGED
@@ -8,6 +8,8 @@ tags:
|
|
8 |
- quantization
|
9 |
- sft
|
10 |
- openassistant
|
|
|
|
|
11 |
---
|
12 |
|
13 |
# Open-Assistant StableLM-7B SFT-7 Model: GPTQ 4-bit
|
@@ -19,7 +21,7 @@ tags:
|
|
19 |
A GPTQ version of the [Open-Assistant StableLM-7B SFT-7 Model](https://huggingface.co/OpenAssistant/stablelm-7b-sft-v7-epoch-3) quantized via auto-gptq.
|
20 |
|
21 |
|
22 |
-
Will update this more later - take a look at the colab for now to see an inference example.
|
23 |
|
24 |
|
25 |
> Note: this model uses special tokens, structured as: `<|prompter|>What's the Earth total population<|endoftext|><|assistant|>`
|
|
|
8 |
- quantization
|
9 |
- sft
|
10 |
- openassistant
|
11 |
+
language:
|
12 |
+
- en
|
13 |
---
|
14 |
|
15 |
# Open-Assistant StableLM-7B SFT-7 Model: GPTQ 4-bit
|
|
|
21 |
A GPTQ version of the [Open-Assistant StableLM-7B SFT-7 Model](https://huggingface.co/OpenAssistant/stablelm-7b-sft-v7-epoch-3) quantized via auto-gptq.
|
22 |
|
23 |
|
24 |
+
Will update this more later - take a look at the colab for now to see an inference example, or a [stripped-down version of the notebook here](https://gist.github.com/pszemraj/fc5b03b6bb7386991163eaaa9e0dc14d)
|
25 |
|
26 |
|
27 |
> Note: this model uses special tokens, structured as: `<|prompter|>What's the Earth total population<|endoftext|><|assistant|>`
|