Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
leafspark
/
DeepSeek-V2-Chat-GGUF
like
25
Text Generation
Transformers
GGUF
English
Chinese
code
deepseek
bf16
Inference Endpoints
conversational
License:
mit
Model card
Files
Files and versions
Community
6
Train
Deploy
Use this model
3734c9a
DeepSeek-V2-Chat-GGUF
1 contributor
History:
96 commits
leafspark
readme: update quant info; minor changes to hyperlinks and terms
3734c9a
verified
7 months ago
DeepSeek-V2-Chat.bf16.gguf
Upload DeepSeek-V2-Chat.bf16.gguf/DeepSeek-V2-Chat.bf16.part-22-of-22.gguf with huggingface_hub
7 months ago
DeepSeek-V2-Chat.iq2_xxs.gguf
Upload DeepSeek-V2-Chat.iq2_xxs.gguf/DeepSeek-V2-Chat.IQ2_XXS-00003-of-00003.gguf with huggingface_hub
7 months ago
DeepSeek-V2-Chat.iq3_xs.gguf
Upload DeepSeek-V2-Chat.iq3_xs.gguf/DeepSeek-V2-Chat.IQ3_XS-00008-of-00008.gguf with huggingface_hub
7 months ago
DeepSeek-V2-Chat.q2_k.gguf
tool: add kv overrides to start command (win)
7 months ago
DeepSeek-V2-Chat.q3_k_m.gguf
Add readme for q3_k_m
7 months ago
DeepSeek-V2-Chat.q4_k_m.gguf
Upload DeepSeek-V2-Chat.q4_k_m.gguf/DeepSeek-V2-Chat.q4_k_m.split-00006-of-00008.gguf with huggingface_hub
7 months ago
DeepSeek-V2-Chat.q5_k_m.gguf
Create DeepSeek-V2-Chat.q5_k_m.gguf/readme.md
7 months ago
DeepSeek-V2-Chat.q6_k.gguf
Create DeepSeek-V2-Chat.q6_k.gguf/readme.md
7 months ago
DeepSeek-V2-Chat.q8_0.gguf
Upload DeepSeek-V2-Chat.q8_0.gguf/DeepSeek-V2-Chat.Q8_0-00001-of-00012.gguf with huggingface_hub
7 months ago
.gitattributes
Safe
6.67 kB
Upload DeepSeek-V2-Chat.q8_0.gguf/DeepSeek-V2-Chat.Q8_0-00001-of-00012.gguf with huggingface_hub
7 months ago
README.md
Safe
3.96 kB
readme: update quant info; minor changes to hyperlinks and terms
7 months ago
imatrix.dat
Safe
456 MB
LFS
imatrix: add chunk 63 (final)
7 months ago
llama.cpp-039896407afd40e54321d47c5063c46a52da3e01.zip
Safe
pickle
Pickle imports
No problematic imports detected
What is a pickle import?
25.4 MB
LFS
build: add precompiled llama.cpp
7 months ago