README.md

---

base_model:
- PowerInfer/SmallThinker-3B-Preview
tags:
- abliterated
- uncensored

---

[![QuantFactory Banner](https://lh7-rt.googleusercontent.com/docsz/AD_4nXeiuCm7c8lEwEJuRey9kiVZsRn2W-b4pWlu3-X534V3YmVuVc2ZL-NXg2RkzSOOS2JXGHutDuyyNAUtdJI65jGTo8jT9Y99tMi4H4MqL44Uc5QKG77B0d6-JfIkZHFaUA71-RtjyYZWVIhqsNZcx8-OMaA?key=xt3VSDoCbmTY7o-cwwOFwQ)](https://hf.co/QuantFactory)


# QuantFactory/SmallThinker-3B-Preview-abliterated-GGUF
This is quantized version of [huihui-ai/SmallThinker-3B-Preview-abliterated](https://huggingface.co/huihui-ai/SmallThinker-3B-Preview-abliterated) created using llama.cpp

# Original Model Card


# huihui-ai/SmallThinker-3B-Preview-abliterated


This is an uncensored version of [PowerInfer/SmallThinker-3B-Preview](https://huggingface.co/PowerInfer/SmallThinker-3B-Preview) created with abliteration (see [remove-refusals-with-transformers](https://github.com/Sumandora/remove-refusals-with-transformers) to know more about it).  
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.    

## Use with ollama

You can use [huihui_ai/smallthinker-abliterated](https://ollama.com/huihui_ai/smallthinker-abliterated) directly
```
ollama run huihui_ai/smallthinker-abliterated