Hugging Face's logo

JayhC
/
L3-ChaoticSoliloquy-v2-4x8B-test-8bpw-h8-exl2

Text Generation
Transformers
Safetensors
English
mixtral
Mixture of Experts
conversational
text-generation-inference
Inference Endpoints
8-bit precision
exl2
Model card Files Community
1
JayhC commited on
Commit
cdcb54f
·
verified ·
1 Parent(s): 38292f3

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +7 -0
README.md CHANGED
@@ -6,6 +6,13 @@ language:
6
  - en
7
  ---
8
 
 
 
 
 
 
 
 
9
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/K3jwX1gq_nohz7Fe78xev.png)
10
  (Maybe i'll change the waifu picture later.)
11
 
 
6
  - en
7
  ---
8
 
9
+ <br/><br/>
10
+ 8bpw/h8 exl2 quantization of [xxx777xxxASD/L3-ChaoticSoliloquy-v2-4x8B-test](https://huggingface.co/xxx777xxxASD/L3-ChaoticSoliloquy-v2-4x8B-test) using default exllamav2 calibration dataset.
11
+
12
+ ---
13
+
14
+ **ORIGINAL CARD:**
15
+
16
  ![image/png](https://cdn-uploads.huggingface.co/production/uploads/64f5e51289c121cb864ba464/K3jwX1gq_nohz7Fe78xev.png)
17
  (Maybe i'll change the waifu picture later.)
18