Hugging Face
Models
Datasets
Spaces
Posts
Docs
Enterprise
Pricing
Log In
Sign Up
mradermacher
/
SmolLumi-8B-Instruct-i1-GGUF
like
2
Transformers
GGUF
HuggingFaceTB/smol-smoltalk
English
text-generation-inference
unsloth
llama
trl
sft
Inference Endpoints
imatrix
conversational
License:
apache-2.0
Model card
Files
Files and versions
Community
Train
Deploy
Use this model
6912622
SmolLumi-8B-Instruct-i1-GGUF
1 contributor
History:
24 commits
mradermacher
uploaded from backup1
6912622
verified
25 days ago
.gitattributes
Safe
3.07 kB
uploaded from backup1
25 days ago
README.md
Safe
236 Bytes
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-IQ1_M.gguf
Safe
2.16 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-IQ1_S.gguf
Safe
2.02 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-IQ2_M.gguf
Safe
2.95 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-IQ2_S.gguf
Safe
2.76 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-IQ2_XS.gguf
Safe
2.61 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-IQ2_XXS.gguf
Safe
2.4 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-IQ3_M.gguf
Safe
3.78 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-IQ3_XS.gguf
Safe
3.52 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-IQ3_XXS.gguf
Safe
3.27 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-IQ4_XS.gguf
Safe
4.45 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q2_K.gguf
Safe
3.18 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q3_K_L.gguf
Safe
4.32 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q3_K_M.gguf
Safe
4.02 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q3_K_S.gguf
Safe
3.66 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q4_0.gguf
Safe
4.68 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q4_0_4_4.gguf
Safe
4.66 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q4_K_M.gguf
Safe
4.92 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q4_K_S.gguf
Safe
4.69 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q5_K_M.gguf
Safe
5.73 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q5_K_S.gguf
Safe
5.6 GB
LFS
uploaded from backup1
25 days ago
SmolLumi-8B-Instruct.i1-Q6_K.gguf
Safe
6.6 GB
LFS
uploaded from backup1
25 days ago
imatrix.dat
4.99 MB
LFS
uploaded from backup1
25 days ago