bartowski
/

Meta-Llama-3.1-70B-Instruct-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Meta-Llama-3.1-70B-Instruct-GGUF

2 contributors

History: 12 commits

bartowski's picture

Upload Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf with huggingface_hub

8c7f398 verified 3 months ago

Meta-Llama-3.1-70B-Instruct-Q5_K_L
Upload folder using huggingface_hub 3 months ago
Meta-Llama-3.1-70B-Instruct-Q5_K_M
Upload folder using huggingface_hub 3 months ago
Meta-Llama-3.1-70B-Instruct-Q6_K
Upload folder using huggingface_hub 3 months ago
Meta-Llama-3.1-70B-Instruct-Q6_K_L
Upload folder using huggingface_hub 3 months ago
Meta-Llama-3.1-70B-Instruct-Q8_0
Upload folder using huggingface_hub 3 months ago
.gitattributes

3.22 kB

Upload Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf with huggingface_hub 3 months ago
Meta-Llama-3.1-70B-Instruct-IQ3_M.gguf
31.9 GB
LFS

Upload Meta-Llama-3.1-70B-Instruct-IQ3_M.gguf with huggingface_hub 3 months ago
Meta-Llama-3.1-70B-Instruct-IQ4_XS.gguf
37.9 GB
LFS

Upload Meta-Llama-3.1-70B-Instruct-IQ4_XS.gguf with huggingface_hub 3 months ago
Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf
30.9 GB
LFS

Upload Meta-Llama-3.1-70B-Instruct-Q3_K_S.gguf with huggingface_hub 3 months ago
Meta-Llama-3.1-70B-Instruct-Q4_K_L.gguf
43.3 GB
LFS

Upload Meta-Llama-3.1-70B-Instruct-Q4_K_L.gguf with huggingface_hub 3 months ago
Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf
42.5 GB
LFS

Upload Meta-Llama-3.1-70B-Instruct-Q4_K_M.gguf with huggingface_hub 3 months ago
Meta-Llama-3.1-70B-Instruct-Q5_K_S.gguf
36.1 GB
LFS

Upload Meta-Llama-3.1-70B-Instruct-Q5_K_S.gguf with huggingface_hub 3 months ago