MaziyarPanahi
/

light-3B-GGUF

Text Generation

4-bit precision

8-bit precision

Model card Files Files and versions Community

1 contributor

History: 6 commits

MaziyarPanahi's picture

f8166306b0c30ca6346faf936d48262efcc2bbd8c8a0155a79cf99d7e7d16a43

22e203e verified about 1 month ago

.gitattributes

1.8 kB

f8166306b0c30ca6346faf936d48262efcc2bbd8c8a0155a79cf99d7e7d16a43 about 1 month ago
light-3B.Q5_K_M.gguf

2.44 GB
LFS

b01ad70bc078324059bd6242951fde5c601ce56ea3fd5e38a1ad11d70e93deb6 about 1 month ago
light-3B.Q5_K_S.gguf

2.38 GB
LFS

3c2e7126e0353cf1ab8b7aa2ab7d0ffbdcc2e3f4147eb513b44f60d85e917197 about 1 month ago
light-3B.Q6_K.gguf

2.79 GB
LFS

331036c27bcc2784dee933de748930fe457c6c931d0ef85a53b84e72f757b660 about 1 month ago
light-3B.Q8_0.gguf

3.62 GB
LFS

4f4135f8062d2c371f0e62a10a3657970df67940f4668232a484a859657ad0b7 about 1 month ago
light-3B.fp16.gguf

6.8 GB
LFS

f8166306b0c30ca6346faf936d48262efcc2bbd8c8a0155a79cf99d7e7d16a43 about 1 month ago