GreenBit LLMs

This is GreenBitAI's pretrained low-bit LLMs with extreme compression yet still strong performance.

Please refer to our Github page for the code to run the model and more information.

Downloads last month
4
Safetensors
Model size
1.65B params
Tensor type
FP16
·
I32
·
I16
·
Inference Providers NEW
This model is not currently available via any of the supported third-party Inference Providers, and the model is not deployed on the HF Inference API.

Collection including GreenBitAI/Llama-2-13B-layer-mix-bpw-2.5