Hugging Face's logo

Kooten
/
Pasta-Lake-7b-8bpw-exl2

Text Generation
Transformers
Safetensors
mistral
mergekit
Merge
text-generation-inference
Inference Endpoints
Model card Files Community
Kooten commited on
Commit
aa207c4
·
verified ·
1 Parent(s): 310ad88

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +5 -0
README.md CHANGED
@@ -12,7 +12,12 @@ tags:
12
  # Pasta-Lake-7b 8bpw
13
  Exllama quant of [Test157t/Pasta-Lake-7b](https://huggingface.co/Test157t/Pasta-Lake-7b)
14
 
 
 
 
 
15
  ## Prompt Format: ChatML
 
16
 
17
  ```
18
  <|im_start|>system<|im_end|>
 
12
  # Pasta-Lake-7b 8bpw
13
  Exllama quant of [Test157t/Pasta-Lake-7b](https://huggingface.co/Test157t/Pasta-Lake-7b)
14
 
15
+ ## Other quants:
16
+ EXL2: [8bpw](https://huggingface.co/Kooten/Pasta-Lake-7b-8bpw-exl2), [6bpw](https://huggingface.co/Kooten/Pasta-Lake-7b-6bpw-exl2), [5bpw](https://huggingface.co/Kooten/Pasta-Lake-7b-5bpw-exl2), [4bpw](https://huggingface.co/Kooten/Pasta-Lake-7b-4bpw-exl2)
17
+
18
+
19
  ## Prompt Format: ChatML
20
+ The merge contains multiple formats, alpaca, mistral and chatml however chatml should be a good place to start.
21
 
22
  ```
23
  <|im_start|>system<|im_end|>