ijohn07
/

Llama-3.1-Minitron-4B-Width-Base-Q5_K_M-GGUF

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-Minitron-4B-Width-Base-Q5_K_M-GGUF

1 contributor

History: 6 commits

ijohn07's picture

Update README.md

e41407c verified 2 months ago

.gitattributes

1.65 kB

Upload imatrix.dat with huggingface_hub 2 months ago
README.md

2.31 kB

Update README.md 2 months ago
imatrix.dat

3.68 MB
LFS

Upload imatrix.dat with huggingface_hub 2 months ago
llama-3.1-minitron-4b-width-base-q5_k_m-imat.gguf

3.23 GB
LFS

Upload llama-3.1-minitron-4b-width-base-q5_k_m-imat.gguf with huggingface_hub 2 months ago