Hugging Face's logo

Undi95
/
Toppy-Mix-4x7B-GGUF

GGUF
Not-For-All-Audiences
nsfw
Inference Endpoints
conversational
Model card Files Community
1
Undi95 commited on
Commit
9113a2b
•
1 Parent(s): e62fd1c

Upload folder using huggingface_hub

Browse files
Files changed (7) hide show
  1. .gitattributes +6 -0
  2. Toppy-Mix-4x7B.q2_k.gguf +3 -0
  3. Toppy-Mix-4x7B.q3_k_m.gguf +3 -0
  4. Toppy-Mix-4x7B.q4_k_m.gguf +3 -0
  5. Toppy-Mix-4x7B.q5_k_m.gguf +3 -0
  6. Toppy-Mix-4x7B.q6_k.gguf +3 -0
  7. Toppy-Mix-4x7B.q8_0.gguf +3 -0
.gitattributes CHANGED
@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
 
 
 
 
 
 
 
33
  *.zip filter=lfs diff=lfs merge=lfs -text
34
  *.zst filter=lfs diff=lfs merge=lfs -text
35
  *tfevents* filter=lfs diff=lfs merge=lfs -text
36
+ Toppy-Mix-4x7B.q2_k.gguf filter=lfs diff=lfs merge=lfs -text
37
+ Toppy-Mix-4x7B.q3_k_m.gguf filter=lfs diff=lfs merge=lfs -text
38
+ Toppy-Mix-4x7B.q4_k_m.gguf filter=lfs diff=lfs merge=lfs -text
39
+ Toppy-Mix-4x7B.q5_k_m.gguf filter=lfs diff=lfs merge=lfs -text
40
+ Toppy-Mix-4x7B.q6_k.gguf filter=lfs diff=lfs merge=lfs -text
41
+ Toppy-Mix-4x7B.q8_0.gguf filter=lfs diff=lfs merge=lfs -text
Toppy-Mix-4x7B.q2_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b071d33e9db415cb38628915f2ff4af40d4f4ddaf6f5b6ee1340e4ce10eae41a
3
+ size 8060709088
Toppy-Mix-4x7B.q3_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:932e6f347f56ebb8000ca01e4d71ba80442f92c597e16ca3ea03ca429ff12a79
3
+ size 10522446048
Toppy-Mix-4x7B.q4_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2955f54ece4c71e112a0939cf33bf8152ddb94553e2ac91c3331dc351cd3b5e7
3
+ size 13639968992
Toppy-Mix-4x7B.q5_k_m.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:11a59fabcecd11ba82252954431d3ea8c79a50c90f14e72a31a78d8ca0b2cc23
3
+ size 16634308832
Toppy-Mix-4x7B.q6_k.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:88ab2e97d082dd1cdacb7a982de48f429b4030d52f9229ec2d57d225543f753c
3
+ size 19815794912
Toppy-Mix-4x7B.q8_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:655338b6a4b5cde0f20784210834b2d76b77e0ca9473e9508e71df01b1df1ab3
3
+ size 25665325280