GGUF imatrix quants for raincandy-u/phillama-3.8b-v0.1.

Downloads last month
44
GGUF

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Examples
Unable to determine this model's library. Check the docs .

Model tree for iyadycb/phillama-3.8b-v0.1-gguf-imatrix

Quantized
(3)
this model