Hugging Face's logo

Kooten
/
MiquMaid-v1-70B-3bpw-exl2

Text Generation
Transformers
PyTorch
llama
text-generation-inference
Inference Endpoints
Model card Files Community
1
Kooten commited on
Commit
6123d46
·
verified ·
1 Parent(s): 0c7a2d3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -4
README.md CHANGED
@@ -3,14 +3,13 @@
3
  ## Description
4
  Exllama quant of [NeverSleep/MiquMaid-v1-70B](https://huggingface.co/NeverSleep/MiquMaid-v1-70B)
5
 
6
- ## Other quants: [NOT DONE YET]
7
  EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-2.4bpw-exl2)
8
 
9
  GGUF:
10
-
11
  [2bit Imatrix GGUF](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF)
12
 
13
- [NeverSleeps Official Quants](https://huggingface.co/NeverSleep/MiquMaid-v1-70B-GGUF)
14
 
15
  ### Custom format:
16
  ```
@@ -23,5 +22,8 @@ GGUF:
23
  ### Response:
24
  {reply}
25
  ```
 
26
  ## Contact
27
- Kooten on discord
 
 
 
3
  ## Description
4
  Exllama quant of [NeverSleep/MiquMaid-v1-70B](https://huggingface.co/NeverSleep/MiquMaid-v1-70B)
5
 
6
+ ## Other quants:
7
  EXL2: [3.5bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3.5bpw-exl2), [3bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-3bpw-exl2), [2.4bpw](https://huggingface.co/Kooten/MiquMaid-v1-70B-2.4bpw-exl2)
8
 
9
  GGUF:
 
10
  [2bit Imatrix GGUF](https://huggingface.co/Kooten/MiquMaid-v1-70B-IQ2-GGUF)
11
 
12
+ [XS](), [XXS]()
13
 
14
  ### Custom format:
15
  ```
 
22
  ### Response:
23
  {reply}
24
  ```
25
+
26
  ## Contact
27
+ Kooten on discord
28
+
29
+ [ko-fi.com/kooten](https://ko-fi.com/kooten)