Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
second-state
/
Yi-34Bx2-MoE-60B-GGUF
like
2
Follow
Second State
95
Text Generation
Transformers
GGUF
mixtral
Mixture of Experts
Inference Endpoints
conversational
License:
cc-by-nc-4.0
Model card
Files
Files and versions
Community
1
Train
Deploy
Use this model
main
Yi-34Bx2-MoE-60B-GGUF
2 contributors
History:
31 commits
apepkuss79
Upload README.md with huggingface_hub
88ff284
verified
8 months ago
.gitattributes
Safe
1.56 kB
Add Q2 model
11 months ago
README.md
Safe
6.1 kB
Upload README.md with huggingface_hub
8 months ago
Yi-34Bx2-MoE-60B-Q2_K.gguf
Safe
22.4 GB
LFS
Upload Yi-34Bx2-MoE-60B-Q2_K.gguf with huggingface_hub
8 months ago
Yi-34Bx2-MoE-60B-Q3_K_L.gguf
Safe
31.8 GB
LFS
Upload Yi-34Bx2-MoE-60B-Q3_K_L.gguf with huggingface_hub
8 months ago
Yi-34Bx2-MoE-60B-Q3_K_M.gguf
Safe
29.2 GB
LFS
Upload Yi-34Bx2-MoE-60B-Q3_K_M.gguf with huggingface_hub
8 months ago
Yi-34Bx2-MoE-60B-Q3_K_S.gguf
Safe
26.3 GB
LFS
Upload Yi-34Bx2-MoE-60B-Q3_K_S.gguf with huggingface_hub
8 months ago
Yi-34Bx2-MoE-60B-Q4_0.gguf
Safe
34.3 GB
LFS
Upload Q4 models
8 months ago
Yi-34Bx2-MoE-60B-Q4_K_M.gguf
Safe
36.7 GB
LFS
Upload Q4 models
8 months ago
Yi-34Bx2-MoE-60B-Q4_K_S.gguf
Safe
34.6 GB
LFS
Upload Q4 models
8 months ago
Yi-34Bx2-MoE-60B-Q5_0.gguf
Safe
41.9 GB
LFS
Upload Q5 and Q6 models
8 months ago
Yi-34Bx2-MoE-60B-Q5_K_M.gguf
Safe
43.1 GB
LFS
Upload Q5 and Q6 models
8 months ago
Yi-34Bx2-MoE-60B-Q5_K_S.gguf
Safe
41.9 GB
LFS
Upload Q5 and Q6 models
8 months ago
Yi-34Bx2-MoE-60B-Q6_K.gguf
Safe
49.9 GB
LFS
Upload Q5 and Q6 models
8 months ago
Yi-34Bx2-MoE-60B-Q8_0-00001-of-00003.gguf
Safe
32.2 GB
LFS
Add Q8 model
8 months ago
Yi-34Bx2-MoE-60B-Q8_0-00002-of-00003.gguf
Safe
32.1 GB
LFS
Add Q8 model
8 months ago
Yi-34Bx2-MoE-60B-Q8_0-00003-of-00003.gguf
Safe
312 MB
LFS
Add Q8 model
8 months ago
Yi-34Bx2-MoE-60B-f16-00001-of-00008.gguf
Safe
31.9 GB
LFS
Add f16 model
8 months ago
Yi-34Bx2-MoE-60B-f16-00002-of-00008.gguf
Safe
31.7 GB
LFS
Add f16 model
8 months ago
Yi-34Bx2-MoE-60B-f16-00003-of-00008.gguf
Safe
31.7 GB
LFS
Add f16 model
8 months ago
Yi-34Bx2-MoE-60B-f16-00004-of-00008.gguf
Safe
31.7 GB
LFS
Add f16 model
8 months ago
Yi-34Bx2-MoE-60B-f16-00005-of-00008.gguf
Safe
31.7 GB
LFS
Add f16 model
8 months ago
Yi-34Bx2-MoE-60B-f16-00006-of-00008.gguf
Safe
31.7 GB
LFS
Add f16 model
8 months ago
Yi-34Bx2-MoE-60B-f16-00007-of-00008.gguf
Safe
31.7 GB
LFS
Add f16 model
8 months ago
Yi-34Bx2-MoE-60B-f16-00008-of-00008.gguf
Safe
21.1 GB
LFS
Add f16 model
8 months ago
config.json
Safe
868 Bytes
Upload config.json
9 months ago