leafspark
/

DeepSeek-V2-Chat-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

DeepSeek-V2-Chat-GGUF

1 contributor

History: 65 commits

leafspark's picture

Upload DeepSeek-V2-Chat.q2_k.gguf/DeepSeek-V2-Chat.Q2_K-00001-of-00005.gguf with huggingface_hub

39a948d verified 7 months ago

DeepSeek-V2-Chat.bf16.gguf
Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-22-of-22.gguf with huggingface_hub 7 months ago
DeepSeek-V2-Chat.q2_k.gguf
Upload DeepSeek-V2-Chat.q2_k.gguf/DeepSeek-V2-Chat.Q2_K-00001-of-00005.gguf with huggingface_hub 7 months ago
DeepSeek-V2-Chat.q3_k_m.gguf
Add readme for q3_k_m 7 months ago
DeepSeek-V2-Chat.q4_k_m.gguf
Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00006-of-00008.gguf with huggingface_hub 7 months ago
DeepSeek-V2-Chat.q5_k_m.gguf
Create DeepSeek-V2-Chat.q5_k_m.gguf/readme.md 7 months ago
DeepSeek-V2-Chat.q6_k.gguf
Create DeepSeek-V2-Chat.q6_k.gguf/readme.md 7 months ago
DeepSeek-V2-Chat.q8_0.gguf
delete: Use gguf-split instead of Python script 7 months ago
.gitattributes

4.88 kB

Upload DeepSeek-V2-Chat.q2_k.gguf/DeepSeek-V2-Chat.Q2_K-00001-of-00005.gguf with huggingface_hub 7 months ago
README.md

3.52 kB

readme: add detailed instructions 7 months ago
imatrix.dat

456 MB
LFS

imatrix: update after 6 chunks 7 months ago
llama.cpp-039896407afd40e54321d47c5063c46a52da3e01.zip
Pickle imports
- No problematic imports detected
What is a pickle import?
25.4 MB
LFS

build: add precompiled llama.cpp 7 months ago