mav23
/

Llama-3.1-70B-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

Llama-3.1-70B-GGUF

1 contributor

History: 15 commits

mav23's picture

Upload folder using huggingface_hub

24daf13 verified 5 months ago

.gitattributes

2.37 kB

Upload folder using huggingface_hub 5 months ago
README.md

40.9 kB

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q2_K.gguf

26.4 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q3_K.gguf

34.3 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q3_K_L.gguf

37.1 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q3_K_M.gguf

34.3 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q3_K_S.gguf

30.9 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q4_0.gguf

40 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q4_1.gguf

44.3 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q4_K.gguf

42.5 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q4_K_M.gguf

42.5 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q4_K_S.gguf

40.3 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q5_0.gguf

48.7 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q5_K.gguf

49.9 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q5_K_M.gguf

49.9 GB
LFS

Upload folder using huggingface_hub 5 months ago
llama-3.1-70b.Q5_K_S.gguf

48.7 GB
LFS

Upload folder using huggingface_hub 5 months ago