| base_model: | |
| - PowerInfer/SmallThinker-3B-Preview | |
| tags: | |
| - abliterated | |
| - uncensored | |
| [](https://hf.co/QuantFactory) | |
| # QuantFactory/SmallThinker-3B-Preview-abliterated-GGUF | |
| This is quantized version of [huihui-ai/SmallThinker-3B-Preview-abliterated](https://huggingface.co/huihui-ai/SmallThinker-3B-Preview-abliterated) created using llama.cpp | |
| # Original Model Card | |
| # huihui-ai/SmallThinker-3B-Preview-abliterated | |
| This is an uncensored version of [PowerInfer/SmallThinker-3B-Preview](https://huggingface.co/PowerInfer/SmallThinker-3B-Preview) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it). | |
| This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens. | |
| ## Use with ollama | |
| You can use [huihui_ai/smallthinker-abliterated](https://ollama.com/huihui_ai/smallthinker-abliterated) directly | |
| ``` | |
| ollama run huihui_ai/smallthinker-abliterated | |