Post
3154
Deepseek V3, including GGUF + bf16 versions are now uploaded!
Includes 2, 3, 4, 5, 6 and 8-bit quantized versions.
GGUFs: unsloth/DeepSeek-V3-GGUF
bf16: unsloth/DeepSeek-V3-bf16
Min. hardware requirements to run: 48GB RAM + 250GB of disk space for 2-bit.
See how to run them with examples and the full collection: unsloth/deepseek-v3-all-versions-677cf5cfd7df8b7815fc723c
Includes 2, 3, 4, 5, 6 and 8-bit quantized versions.
GGUFs: unsloth/DeepSeek-V3-GGUF
bf16: unsloth/DeepSeek-V3-bf16
Min. hardware requirements to run: 48GB RAM + 250GB of disk space for 2-bit.
See how to run them with examples and the full collection: unsloth/deepseek-v3-all-versions-677cf5cfd7df8b7815fc723c