Hugging Face's logo

unsloth
/
DeepSeek-R1-GGUF

Text Generation
Transformers
GGUF
English
deepseek_v3
deepseek
unsloth
custom_code
Inference Endpoints
conversational
Model card Files Community
19
DeepSeek-R1-GGUF
File size: 12,232 Bytes 
cee1771
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
eb5143e
6e257f0
7a46c51
f2a5fcb
13fe81b
c18b4b1
5ea4779
511ba5a
01a5c5e
37ed4c2
1c74d86
999f7cb
b10351e
483d063
4aaa0f0
1d33ad8
ed3456c
a7d0b1b
8a17097
9588464
829ee4b
a4973f1
d3813cf
14a2eb1
d60f58c
660ab3b
bdd1ee2
f1b1ca9
cae5bbc
d92dfe6
e1ef419
44cd04c
e4f839c
1808b98
5046b45
cd9ad9e
682ba45
2d6a1e8
9cd2c23
2f9e72b
9be83b8
7f9a351
7aaeb60
55d05ad
73a4f39
95d8024
a327fac
644e4cf
f7df152
196a244
b4a39e1
da91436
903b67e
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7b636fc
 
 
 
 
 
 
 
 
 
 
 
38a2a8b
 
 
 
 
 
 
 
 
 
 
 
64961ae
 
 
 
 
 
 
 
 
 
c0b6265
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
 
*.7z filter=lfs diff=lfs merge=lfs -text
*.arrow filter=lfs diff=lfs merge=lfs -text
*.bin filter=lfs diff=lfs merge=lfs -text
*.bz2 filter=lfs diff=lfs merge=lfs -text
*.ckpt filter=lfs diff=lfs merge=lfs -text
*.ftz filter=lfs diff=lfs merge=lfs -text
*.gz filter=lfs diff=lfs merge=lfs -text
*.h5 filter=lfs diff=lfs merge=lfs -text
*.joblib filter=lfs diff=lfs merge=lfs -text
*.lfs.* filter=lfs diff=lfs merge=lfs -text
*.mlmodel filter=lfs diff=lfs merge=lfs -text
*.model filter=lfs diff=lfs merge=lfs -text
*.msgpack filter=lfs diff=lfs merge=lfs -text
*.npy filter=lfs diff=lfs merge=lfs -text
*.npz filter=lfs diff=lfs merge=lfs -text
*.onnx filter=lfs diff=lfs merge=lfs -text
*.ot filter=lfs diff=lfs merge=lfs -text
*.parquet filter=lfs diff=lfs merge=lfs -text
*.pb filter=lfs diff=lfs merge=lfs -text
*.pickle filter=lfs diff=lfs merge=lfs -text
*.pkl filter=lfs diff=lfs merge=lfs -text
*.pt filter=lfs diff=lfs merge=lfs -text
*.pth filter=lfs diff=lfs merge=lfs -text
*.rar filter=lfs diff=lfs merge=lfs -text
*.safetensors filter=lfs diff=lfs merge=lfs -text
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
*.tar.* filter=lfs diff=lfs merge=lfs -text
*.tar filter=lfs diff=lfs merge=lfs -text
*.tflite filter=lfs diff=lfs merge=lfs -text
*.tgz filter=lfs diff=lfs merge=lfs -text
*.wasm filter=lfs diff=lfs merge=lfs -text
*.xz filter=lfs diff=lfs merge=lfs -text
*.zip filter=lfs diff=lfs merge=lfs -text
*.zst filter=lfs diff=lfs merge=lfs -text
*tfevents* filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K_L/DeepSeek-R1-Q2_K_L-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K_XS/DeepSeek-R1-Q2_K_XS-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K_XS/DeepSeek-R1-Q2_K_XS-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K_XS/DeepSeek-R1-Q2_K_XS-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K_XS/DeepSeek-R1-Q2_K_XS-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K_XS/DeepSeek-R1-Q2_K_XS-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00001-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00002-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00003-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00004-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00005-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00001-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00006-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00002-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q3_K_M/DeepSeek-R1-Q3_K_M-00007-of-00007.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00003-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Zero-Q4_K_M-00001-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00004-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Zero-Q4_K_M-00002-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00005-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Zero-Q4_K_M-00003-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00006-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Zero-Q4_K_M-00004-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00007-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Zero-Q4_K_M-00005-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00008-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Zero-Q4_K_M-00006-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00009-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Zero-Q4_K_M-00007-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Zero-Q5_K_M-00001-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00010-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Zero-Q4_K_M-00008-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Zero-Q5_K_M-00002-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00011-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q4_K_M/DeepSeek-R1-Zero-Q4_K_M-00009-of-00009.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Zero-Q5_K_M-00003-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00012-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Zero-Q5_K_M-00004-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00013-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Zero-Q5_K_M-00005-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Zero-Q5_K_M-00006-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Zero-Q5_K_M-00007-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Zero-Q5_K_M-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00014-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Zero-Q5_K_M-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00015-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Zero-Q5_K_M-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1-BF16-256x20B-Q8_0-00016-of-00016.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00015-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00003-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00002-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00014-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00005-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00004-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q2_K/DeepSeek-R1-Q2_K-00001-of-00005.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00012-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00006-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00008-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00013-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00011-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00002-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00004-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00009-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00010-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00003-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00005-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00001-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q8_0/DeepSeek-R1.Q8_0-00007-of-00015.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00006-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00003-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00009-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00001-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00002-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00007-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00008-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00012-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00011-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00005-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00010-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q6_K/DeepSeek-R1-Q6_K-00004-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00007-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00004-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00012-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00009-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00006-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00001-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00011-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00002-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00008-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00005-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00010-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q6_K/DeepSeek-R1-Q6_K-00003-of-00012.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_M/DeepSeek-R1-Q5_K_M-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_M/DeepSeek-R1-Q5_K_M-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_M/DeepSeek-R1-Q5_K_M-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_M/DeepSeek-R1-Q5_K_M-00003-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_M/DeepSeek-R1-Q5_K_M-00007-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_M/DeepSeek-R1-Q5_K_M-00002-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_M/DeepSeek-R1-Q5_K_M-00001-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_M/DeepSeek-R1-Q5_K_M-00005-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_M/DeepSeek-R1-Q5_K_M-00006-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
Q5_K_M/DeepSeek-R1-Q5_K_M-00004-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00001-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00002-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00003-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00010-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00007-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00009-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00008-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00006-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00005-of-00010.gguf filter=lfs diff=lfs merge=lfs -text
DeepSeek-R1-Q5_K_M/DeepSeek-R1-Q5_K_M-00004-of-00010.gguf filter=lfs diff=lfs merge=lfs -text