Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
MaziyarPanahi
/
light-3B-GGUF
like
0
Text Generation
GGUF
mistral
quantized
2-bit
3-bit
4-bit precision
5-bit
6-bit
8-bit precision
GGUF
conversational
Model card
Files
Files and versions
Community
1
Train
Use this model
83f1b57
light-3B-GGUF
1 contributor
History:
4 commits
MaziyarPanahi
331036c27bcc2784dee933de748930fe457c6c931d0ef85a53b84e72f757b660
83f1b57
verified
about 1 month ago
.gitattributes
1.69 kB
331036c27bcc2784dee933de748930fe457c6c931d0ef85a53b84e72f757b660
about 1 month ago
light-3B.Q5_K_M.gguf
2.44 GB
LFS
b01ad70bc078324059bd6242951fde5c601ce56ea3fd5e38a1ad11d70e93deb6
about 1 month ago
light-3B.Q5_K_S.gguf
2.38 GB
LFS
3c2e7126e0353cf1ab8b7aa2ab7d0ffbdcc2e3f4147eb513b44f60d85e917197
about 1 month ago
light-3B.Q6_K.gguf
2.79 GB
LFS
331036c27bcc2784dee933de748930fe457c6c931d0ef85a53b84e72f757b660
about 1 month ago
