Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
Megrez-3B-Instruct-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
e9f87a8
Megrez-3B-Instruct-GGUF
1 contributor
History:
6 commits
MaziyarPanahi
a2bdaabb7c2ebdba5d02645321d8186a23a63b41b8e1585ffdffe60f05e5a260
e9f87a8
verified
11 days ago
.gitattributes
Safe
1.92 kB
a2bdaabb7c2ebdba5d02645321d8186a23a63b41b8e1585ffdffe60f05e5a260
11 days ago
Megrez-3B-Instruct-GGUF_imatrix.dat
2.89 MB
LFS
01e14fb849a1eb9005a34617c76ebfc0eea5fcde58ce8a9a1706373a7720e1dc
11 days ago
Megrez-3B-Instruct.Q5_K_M.gguf
Safe
2.09 GB
LFS
01e14fb849a1eb9005a34617c76ebfc0eea5fcde58ce8a9a1706373a7720e1dc
11 days ago
Megrez-3B-Instruct.Q5_K_S.gguf
Safe
2.05 GB
LFS
a2bdaabb7c2ebdba5d02645321d8186a23a63b41b8e1585ffdffe60f05e5a260
11 days ago
Megrez-3B-Instruct.Q6_K.gguf
Safe
2.4 GB
LFS
f9fe0f35d2466aeccc0e8fa7fe9fe7f01f4305d8abb4892f08606177ec2c42ec
11 days ago
Megrez-3B-Instruct.Q8_0.gguf
Safe
3.1 GB
LFS
b9fa8796155d031f08da82a8839dfd0459889cb0cf5d84c11e8e01227c59db75
11 days ago
Megrez-3B-Instruct.fp16.gguf
Safe
5.84 GB
LFS
0c47ea14940e1fc75ae8a4d818a2318c327054760525001eaa8e93e48814fb39
11 days ago
README.md
Safe
2.97 kB
a2bdaabb7c2ebdba5d02645321d8186a23a63b41b8e1585ffdffe60f05e5a260
11 days ago
