Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama3.1-8B-Chinese-Chat-GGUF
like
1
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
34cc015
Llama3.1-8B-Chinese-Chat-GGUF
1 contributor
History:
12 commits
MaziyarPanahi
413543d193d0a497cf58f8b2ff6b8fc2f5e5f5a20337cfa65518c69deb68ef32
34cc015
verified
28 days ago
.gitattributes
2.32 kB
413543d193d0a497cf58f8b2ff6b8fc2f5e5f5a20337cfa65518c69deb68ef32
28 days ago
Llama3.1-8B-Chinese-Chat.IQ1_M.gguf
2.16 GB
LFS
63b0efee153bc79b9d42021d8707af6a71543f6f193edac6c024470a037ef117
28 days ago
Llama3.1-8B-Chinese-Chat.IQ2_XS.gguf
2.61 GB
LFS
2f3f2fa18f2b58d3d881353a22aac744f9ba109497f500243802fb97198af8dd
28 days ago
Llama3.1-8B-Chinese-Chat.IQ3_XS.gguf
3.52 GB
LFS
d155dd9fae67f3ded4680951beb0e768ee7569694b41529fba765c6e04431d66
28 days ago
Llama3.1-8B-Chinese-Chat.IQ4_XS.gguf
4.45 GB
LFS
efc04e52f4e8476eeae700176d0ca8cf83605d28ae607c886bb752d7089457d2
28 days ago
Llama3.1-8B-Chinese-Chat.Q2_K.gguf
3.18 GB
LFS
6b43115b03eac0becfb66c9ab66b34089df6450cd76811c8234582607099d468
28 days ago
Llama3.1-8B-Chinese-Chat.Q3_K_L.gguf
4.32 GB
LFS
977da4aa54c6afe4ffd3468ceb1a986af7742ac45d7103eb1ca04224cc3c88c7
28 days ago
Llama3.1-8B-Chinese-Chat.Q3_K_M.gguf
4.02 GB
LFS
4a4152c48d4b16d6180d2ae526e6b1bbdba5b0e67af273e7a2a43e4fa6491ba5
28 days ago
Llama3.1-8B-Chinese-Chat.Q3_K_S.gguf
3.66 GB
LFS
2aa5ae69c506eb459187c68bdad25dc9221fbf78b55a03160bf29c2c9ac58d91
28 days ago
Llama3.1-8B-Chinese-Chat.Q4_K_M.gguf
4.92 GB
LFS
e79acb53277f08b41a8c8a867b73e94a3dab99c4b6b5ee5d91d49c6f7a51e5b7
28 days ago
Llama3.1-8B-Chinese-Chat.Q4_K_S.gguf
4.69 GB
LFS
29541a6e0712b8893640606f518a1a6e31b8849f22cdc5e848bd819169cf1cfa
28 days ago
Llama3.1-8B-Chinese-Chat.Q5_K_M.gguf
5.73 GB
LFS
413543d193d0a497cf58f8b2ff6b8fc2f5e5f5a20337cfa65518c69deb68ef32
28 days ago
