DevQuasar
/

PowerInfer.SmallThinker-3B-Preview-GGUF

Text Generation

Inference Endpoints

Model card Files Files and versions Community

PowerInfer.SmallThinker-3B-Preview-GGUF

1 contributor

History: 9 commits

csabakecskemeti's picture

csabakecskemeti

Upload PowerInfer.SmallThinker-3B-Preview.f16.gguf

a0e481c verified 7 days ago

.gitattributes

2.09 kB

Upload PowerInfer.SmallThinker-3B-Preview.f16.gguf 7 days ago
PowerInfer.SmallThinker-3B-Preview.Q2_K.gguf

1.38 GB
LFS

Upload PowerInfer.SmallThinker-3B-Preview.Q2_K.gguf with huggingface_hub 7 days ago
PowerInfer.SmallThinker-3B-Preview.Q3_K_M.gguf

1.72 GB
LFS

Upload PowerInfer.SmallThinker-3B-Preview.Q3_K_M.gguf with huggingface_hub 7 days ago
PowerInfer.SmallThinker-3B-Preview.Q4_K_M.gguf

2.1 GB
LFS

Upload PowerInfer.SmallThinker-3B-Preview.Q4_K_M.gguf with huggingface_hub 7 days ago
PowerInfer.SmallThinker-3B-Preview.Q5_K_M.gguf

2.44 GB
LFS

Upload PowerInfer.SmallThinker-3B-Preview.Q5_K_M.gguf with huggingface_hub 7 days ago
PowerInfer.SmallThinker-3B-Preview.Q6_K.gguf

2.79 GB
LFS

Upload PowerInfer.SmallThinker-3B-Preview.Q6_K.gguf with huggingface_hub 7 days ago
PowerInfer.SmallThinker-3B-Preview.Q8_0.gguf

3.62 GB
LFS

Upload PowerInfer.SmallThinker-3B-Preview.Q8_0.gguf with huggingface_hub 7 days ago
PowerInfer.SmallThinker-3B-Preview.f16.gguf

6.8 GB
LFS

Upload PowerInfer.SmallThinker-3B-Preview.f16.gguf 7 days ago
README.md

330 Bytes

Upload README.md with huggingface_hub 7 days ago