ymcki
/

Llama-3_1-Nemotron-51B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-3_1-Nemotron-51B-Instruct-GGUF

1 contributor

History: 33 commits

ymcki's picture

Upload README.md

eb37505 verified about 1 month ago

.gitattributes

2.78 kB

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_XXS.gguf about 1 month ago
Llama-3_1-Nemotron-51B-Instruct.imatrix

19.5 MB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix about 2 months ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_M.gguf
23.5 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_M.gguf about 2 months ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_S.gguf
22.7 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_S.gguf about 2 months ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_XXS.gguf

20.2 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ3_XXS.gguf about 1 month ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ4_XS.gguf
27.7 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.IQ4_XS.gguf about 2 months ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.Q4_0_4_8.gguf
29.3 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.Q4_0_4_8.gguf about 2 months ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.Q4_K_M.gguf
31 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.Q4_K_M.gguf about 2 months ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.Q5_K_M.gguf
36.5 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.Q5_K_M.gguf about 2 months ago
Llama-3_1-Nemotron-51B-Instruct.imatrix.Q6_K.gguf
42.3 GB
LFS

Upload Llama-3_1-Nemotron-51B-Instruct.imatrix.Q6_K.gguf about 2 months ago
README.md

9.59 kB

Upload README.md about 1 month ago
tokenizer_config.json

55.4 kB

Upload tokenizer_config.json about 2 months ago