Hugging Face's logo

MaziyarPanahi
/
Llama-3.2-1B-Instruct-GGUF

Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card Files Community
1
MaziyarPanahi commited on
Commit
5abbfe4
·
verified ·
1 Parent(s): 775c4d8

e2dcabd59cef2df1aa990d31d1671a12ced67caf00a46b7378bb182d1ff1371c

Browse files
Files changed (4) hide show
  1. .gitattributes +3 -0
  2. Llama-3.2-1B-Instruct.Q3_K_M.gguf +3 -0
  3. Llama-3.2-1B-Instruct.Q3_K_S.gguf +3 -0
  4. Llama-3.2-1B-Instruct.Q4_K_M.gguf +3 -0
.gitattributes CHANGED
@@ -41,3 +41,6 @@ Llama-3.2-1B-Instruct.IQ3_XS.gguf filter=lfs diff=lfs merge=lfs -text
41
  Llama-3.2-1B-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
  Llama-3.2-1B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
43
  Llama-3.2-1B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
 
 
 
 
41
  Llama-3.2-1B-Instruct.IQ4_XS.gguf filter=lfs diff=lfs merge=lfs -text
42
  Llama-3.2-1B-Instruct.Q2_K.gguf filter=lfs diff=lfs merge=lfs -text
43
  Llama-3.2-1B-Instruct.Q3_K_L.gguf filter=lfs diff=lfs merge=lfs -text
44
+ Llama-3.2-1B-Instruct.Q3_K_M.gguf filter=lfs diff=lfs merge=lfs -text
45
+ Llama-3.2-1B-Instruct.Q3_K_S.gguf filter=lfs diff=lfs merge=lfs -text
46
+ Llama-3.2-1B-Instruct.Q4_K_M.gguf filter=lfs diff=lfs merge=lfs -text
Llama-3.2-1B-Instruct.Q3_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e7c566338dfc879e014cdcbf9d9dfacf742223e70bd25ca040d87876253246ab
3
+ size 690843744
Llama-3.2-1B-Instruct.Q3_K_S.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:44d30d1ceb9428cf8f1115871306829c8ca7ebe3afa443596b48696680a53b16
3
+ size 641691744
Llama-3.2-1B-Instruct.Q4_K_M.gguf ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:e4650dd6b45ef456066b11e4927f775eef4dd1e0e8473c3c0f27dd19ee13cc4e
3
+ size 807694432