Hugging Face's logo

Melvin56
/
Hammer2.1-7b-GGUF

Text Generation
GGUF
English
Qwen2.5-Coder-7B
Inference Endpoints
conversational
Model card Files Community

Melvin56/Hammer2.1-7b-GGUF

Original Model : MadeAgents/Hammer2.1-7b

All quants are made using the imatrix option.

Model Size (GB)
Q2_K_S 2.82
Q2_K 3.01
Q3_K_M 3.80
Q3_K_M 3.80
Q4_0 4.43
Q4_K_M 4.67
Q5_K_M 5.43
Q6_K 6.25
Q8_0 8.09
F16 15.23
Downloads last month
104
GGUF
Model size
7.61B params
Architecture
qwen2

2-bit

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

Inference Providers NEW
Text Generation
This model is not currently available via any of the supported Inference Providers.
The model cannot be deployed to the HF Inference API: The model has no library tag.

Model tree for Melvin56/Hammer2.1-7b-GGUF

Base model

Qwen/Qwen2.5-7B
Finetuned
Qwen/Qwen2.5-Coder-7B
Finetuned
Qwen/Qwen2.5-Coder-7B-Instruct
Finetuned
MadeAgents/Hammer2.1-7b
Quantized
(9)
this model

Datasets used to train Melvin56/Hammer2.1-7b-GGUF

Collection including Melvin56/Hammer2.1-7b-GGUF