Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
Llama-8B-Distill-CoT-i1-GGUF
like
1
Transformers
GGUF
English
llama
deepseek
Inference Endpoints
imatrix
conversational
License:
llama3.1
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
98c7b69
Llama-8B-Distill-CoT-i1-GGUF
1 contributor
History:
23 commits
mradermacher
uploaded from rain
98c7b69
verified
20 days ago
.gitattributes
Safe
3 kB
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-IQ1_M.gguf
Safe
2.16 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-IQ1_S.gguf
Safe
2.02 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-IQ2_M.gguf
Safe
2.95 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-IQ2_S.gguf
Safe
2.76 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-IQ2_XS.gguf
Safe
2.61 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-IQ2_XXS.gguf
Safe
2.4 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-IQ3_M.gguf
Safe
3.78 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-IQ3_XXS.gguf
Safe
3.27 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-IQ4_NL.gguf
Safe
4.68 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-IQ4_XS.gguf
Safe
4.45 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-Q2_K.gguf
Safe
3.18 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-Q2_K_S.gguf
Safe
2.99 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-Q3_K_L.gguf
Safe
4.32 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-Q3_K_M.gguf
Safe
4.02 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-Q3_K_S.gguf
Safe
3.66 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-Q4_K_M.gguf
Safe
4.92 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-Q4_K_S.gguf
Safe
4.69 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-Q5_K_M.gguf
Safe
5.73 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-Q5_K_S.gguf
Safe
5.6 GB
LFS
uploaded from rain
20 days ago
Llama-8B-Distill-CoT.i1-Q6_K.gguf
Safe
6.6 GB
LFS
uploaded from rain
20 days ago
README.md
Safe
242 Bytes
uploaded from rain
20 days ago
imatrix.dat
4.99 MB
LFS
uploaded from rain
20 days ago