Hugging Face's logo

second-state
/
Yi-34Bx2-MoE-60B-GGUF

Text Generation
Transformers
GGUF
mixtral
Mixture of Experts
Inference Endpoints
conversational
Model card Files Community
1
apepkuss79 commited on
Commit
2e6a701
•
1 Parent(s): 9a1ec38

Upload Q5 and Q6 models

Browse files
Files changed (4) hide show
  1. Yi-34Bx2-MoE-60B-Q5_0.gguf +3 -0
  2. Yi-34Bx2-MoE-60B-Q5_K_M.gguf +3 -0
  3. Yi-34Bx2-MoE-60B-Q5_K_S.gguf +3 -0
  4. Yi-34Bx2-MoE-60B-Q6_K.gguf +3 -0
Yi-34Bx2-MoE-60B-Q5_0.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:eff1cad09f69d1470774100d77c739d1c15f0b6db432fce58970238d61eea431
3
+ size 41877717824
Yi-34Bx2-MoE-60B-Q5_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:3c25dd525abce20a9906993e32b4224558b1d7113d1a968fbdb84345842c3325
3
+ size 43076780864
Yi-34Bx2-MoE-60B-Q5_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:dd55473197471802f91041d37ed2955d69302fef1f7476c3ded94b5d5fbf1afa
3
+ size 41877717824
Yi-34Bx2-MoE-60B-Q6_K.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ad2b1fd0319d90464a04d185ea6ed4879c0c0d909223912d81cdaa8ec9dd1ee2
3
+ size 49893405504