This repo only contains the Q8, Q6, Q5, & Q4 GGUF files of Aglow Vulca v0.1

For the details of this model, please refer to the orginal model card here.

Downloads last month
2
GGUF
Model size
8.03B params
Architecture
llama

4-bit

5-bit

6-bit

8-bit

Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and HF Inference API was unable to determine this model’s pipeline type.

Model tree for kromquant/L3.1-Aglow-Vulca-v0.1-8B-GGUFs

Quantized
(10)
this model