Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Qwen1.5-8x7b-v0.1-GGUF
like
6
Text Generation
Transformers
GGUF
PyTorch
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
mixtral
axolotl
Generated from Trainer
Mixture of Experts
qwen
text-generation-inference
conversational
dataset:Crystalcareai/MoD-150k
Inference Endpoints
License:
tongyi-qianwen
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
5e836bc
Qwen1.5-8x7b-v0.1-GGUF
1 contributor
History:
10 commits
MaziyarPanahi
a111af601b57fab75c2d97ac8cd10d26690305d080a453b86b587d20dcb3e6b1
5e836bc
verified
12 months ago
.gitattributes
2.11 kB
a111af601b57fab75c2d97ac8cd10d26690305d080a453b86b587d20dcb3e6b1
12 months ago
Qwen1.5-8x7b-v0.1.Q2_K.gguf
14.9 GB
LFS
2a502d29eefcf1d562d5d63cceea41d05914c2c2fd58e6008e6160febfdf2101
12 months ago
Qwen1.5-8x7b-v0.1.Q3_K_L.gguf
20.2 GB
LFS
183ff2a97e31b2ec4cb531a2af793e297fa2560cd4e196e83b7689ea0f478f4a
12 months ago
Qwen1.5-8x7b-v0.1.Q3_K_M.gguf
19 GB
LFS
6153d909ab12183a001bc207cb11c7a27060fa8ef32ceaeb40a170de902d17bc
12 months ago
Qwen1.5-8x7b-v0.1.Q3_K_S.gguf
17.4 GB
LFS
9a0c5ff71eb4270e55342f0942b4f80311c77631ec148dda4086b154b4dd5341
12 months ago
Qwen1.5-8x7b-v0.1.Q4_K_M.gguf
23.6 GB
LFS
f620247a5c19e0ddf170eeb05a076c7fc8eb3513cd67643e95e12281190f8281
12 months ago
Qwen1.5-8x7b-v0.1.Q4_K_S.gguf
22.3 GB
LFS
d4595c8238a9627d6eccdf2dde79b20875a82bff9e28b76898dd35072202062c
12 months ago
Qwen1.5-8x7b-v0.1.Q5_K_M.gguf
27.4 GB
LFS
bd92b40bdceb2ff794b557027edae5aef392db436785434e8c4824861d4a12b4
12 months ago
Qwen1.5-8x7b-v0.1.Q5_K_S.gguf
26.6 GB
LFS
573cab237fd0414efe9f369c0114b71edf61b70795ba22e7cd699ccac0ccfa5f
12 months ago
Qwen1.5-8x7b-v0.1.Q6_K.gguf
31.5 GB
LFS
a111af601b57fab75c2d97ac8cd10d26690305d080a453b86b587d20dcb3e6b1
12 months ago
