tensorblock
/

internlm2_5-7b-GGUF

Inference Endpoints

Model card Files Files and versions Community

internlm2_5-7b-GGUF

1 contributor

History: 2 commits

morriszms's picture

Upload folder using huggingface_hub

5cf77ce verified 7 days ago

.gitattributes

2.27 kB

Upload folder using huggingface_hub 7 days ago
README.md

4.26 kB

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q2_K.gguf

3.01 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q3_K_L.gguf

4.13 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q3_K_M.gguf

3.83 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q3_K_S.gguf

3.48 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q4_0.gguf

4.45 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q4_K_M.gguf

4.71 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q4_K_S.gguf

4.48 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q5_0.gguf

5.37 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q5_K_M.gguf

5.51 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q5_K_S.gguf

5.37 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q6_K.gguf

6.35 GB
LFS

Upload folder using huggingface_hub 7 days ago
internlm2_5-7b-Q8_0.gguf

8.22 GB
LFS

Upload folder using huggingface_hub 7 days ago