Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
second-state
/
Yi-34Bx2-MoE-60B-GGUF
like
2
Follow
Second State
97
Text Generation
Transformers
GGUF
mixtral
Mixture of Experts
Inference Endpoints
conversational
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
e804cd8
Yi-34Bx2-MoE-60B-GGUF
2 contributors
History:
5 commits
Xin Liu
Add Q5 models
e804cd8
12 months ago
.gitattributes
Safe
1.56 kB
Add Q2 model
12 months ago
README.md
Safe
1.35 kB
Add Q2 model
12 months ago
Yi-34Bx2-MoE-60B-Q2_K.gguf
Safe
22.4 GB
LFS
Add Q2 model
12 months ago
Yi-34Bx2-MoE-60B-Q3_K_L.gguf
Safe
31.8 GB
LFS
Add Q3 models
12 months ago
Yi-34Bx2-MoE-60B-Q3_K_M.gguf
Safe
29.2 GB
LFS
Add Q3 models
12 months ago
Yi-34Bx2-MoE-60B-Q3_K_S.gguf
Safe
26.3 GB
LFS
Add Q3 models
12 months ago
Yi-34Bx2-MoE-60B-Q4_0.gguf
Safe
34.3 GB
LFS
Add Q4 models
12 months ago
Yi-34Bx2-MoE-60B-Q4_K_M.gguf
Safe
36.7 GB
LFS
Add Q4 models
12 months ago
Yi-34Bx2-MoE-60B-Q4_K_S.gguf
Safe
34.6 GB
LFS
Add Q4 models
12 months ago
Yi-34Bx2-MoE-60B-Q5_0.gguf
Safe
41.9 GB
LFS
Add Q5 models
12 months ago
Yi-34Bx2-MoE-60B-Q5_K_M.gguf
Safe
43.1 GB
LFS
Add Q5 models
12 months ago
Yi-34Bx2-MoE-60B-Q5_K_S.gguf
Safe
41.9 GB
LFS
Add Q5 models
12 months ago
