Hugging Face
Models
Datasets
Spaces
Posts
Docs
Solutions
Pricing
Log In
Sign Up
MaziyarPanahi
/
Llama3.1-8B-Chinese-Chat-GGUF
like
1
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
imatrix
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
006621a
Llama3.1-8B-Chinese-Chat-GGUF
1 contributor
History:
17 commits
MaziyarPanahi
adf103b3babeaed880bed12b1c00995e9bb9ecd29f609d41e1886d50985d7a07
006621a
verified
28 days ago
.gitattributes
Safe
2.76 kB
adf103b3babeaed880bed12b1c00995e9bb9ecd29f609d41e1886d50985d7a07
28 days ago
Llama3.1-8B-Chinese-Chat-GGUF_imatrix.dat
4.99 MB
LFS
adf103b3babeaed880bed12b1c00995e9bb9ecd29f609d41e1886d50985d7a07
28 days ago
Llama3.1-8B-Chinese-Chat.IQ1_M.gguf
Safe
2.16 GB
LFS
63b0efee153bc79b9d42021d8707af6a71543f6f193edac6c024470a037ef117
28 days ago
Llama3.1-8B-Chinese-Chat.IQ1_S.gguf
Safe
2.02 GB
LFS
adf103b3babeaed880bed12b1c00995e9bb9ecd29f609d41e1886d50985d7a07
28 days ago
Llama3.1-8B-Chinese-Chat.IQ2_XS.gguf
Safe
2.61 GB
LFS
2f3f2fa18f2b58d3d881353a22aac744f9ba109497f500243802fb97198af8dd
28 days ago
Llama3.1-8B-Chinese-Chat.IQ3_XS.gguf
Safe
3.52 GB
LFS
d155dd9fae67f3ded4680951beb0e768ee7569694b41529fba765c6e04431d66
28 days ago
Llama3.1-8B-Chinese-Chat.IQ4_XS.gguf
Safe
4.45 GB
LFS
efc04e52f4e8476eeae700176d0ca8cf83605d28ae607c886bb752d7089457d2
28 days ago
Llama3.1-8B-Chinese-Chat.Q2_K.gguf
Safe
3.18 GB
LFS
6b43115b03eac0becfb66c9ab66b34089df6450cd76811c8234582607099d468
28 days ago
Llama3.1-8B-Chinese-Chat.Q3_K_L.gguf
Safe
4.32 GB
LFS
977da4aa54c6afe4ffd3468ceb1a986af7742ac45d7103eb1ca04224cc3c88c7
28 days ago
Llama3.1-8B-Chinese-Chat.Q3_K_M.gguf
Safe
4.02 GB
LFS
4a4152c48d4b16d6180d2ae526e6b1bbdba5b0e67af273e7a2a43e4fa6491ba5
28 days ago
Llama3.1-8B-Chinese-Chat.Q3_K_S.gguf
Safe
3.66 GB
LFS
2aa5ae69c506eb459187c68bdad25dc9221fbf78b55a03160bf29c2c9ac58d91
28 days ago
Llama3.1-8B-Chinese-Chat.Q4_K_M.gguf
Safe
4.92 GB
LFS
e79acb53277f08b41a8c8a867b73e94a3dab99c4b6b5ee5d91d49c6f7a51e5b7
28 days ago
Llama3.1-8B-Chinese-Chat.Q4_K_S.gguf
Safe
4.69 GB
LFS
29541a6e0712b8893640606f518a1a6e31b8849f22cdc5e848bd819169cf1cfa
28 days ago
Llama3.1-8B-Chinese-Chat.Q5_K_M.gguf
Safe
5.73 GB
LFS
413543d193d0a497cf58f8b2ff6b8fc2f5e5f5a20337cfa65518c69deb68ef32
28 days ago
Llama3.1-8B-Chinese-Chat.Q5_K_S.gguf
Safe
5.6 GB
LFS
a76f9199719b6ff437c7341e9320c7707b2ff9c1e3db3b6bdcc0c75586597041
28 days ago
Llama3.1-8B-Chinese-Chat.Q6_K.gguf
Safe
6.6 GB
LFS
130e1683d3d52a2edc2f4c3971a8905239346bd4cca6814b9018ce3d55251874
28 days ago
Llama3.1-8B-Chinese-Chat.Q8_0.gguf
Safe
8.54 GB
LFS
efe112dc5be7c5c5d7ab37ddc764d2f3563d0aceb48581667433f12c9ec5f70e
28 days ago
Llama3.1-8B-Chinese-Chat.fp16.gguf
Safe
16.1 GB
LFS
eb9e67ea8b3e5fc4692591b3a5e09a2866c6c6999546e58868d6390f71326aa6
28 days ago
README.md
Safe
3.05 kB
adf103b3babeaed880bed12b1c00995e9bb9ecd29f609d41e1886d50985d7a07
28 days ago
