Hugging Face's logo

QuantFactory
/
SmallThinker-3B-Preview-abliterated-GGUF

GGUF
abliterated
uncensored
Inference Endpoints
conversational
Model card Files Community
SmallThinker-3B-Preview-abliterated-GGUF / README.md
aashish1904's picture
aashish1904
Upload README.md with huggingface_hub
33661fc verified
preview code
|
raw
history blame
1.27 kB
metadata
base_model:
  - PowerInfer/SmallThinker-3B-Preview
tags:
  - abliterated
  - uncensored

QuantFactory Banner

QuantFactory/SmallThinker-3B-Preview-abliterated-GGUF

This is quantized version of huihui-ai/SmallThinker-3B-Preview-abliterated created using llama.cpp

Original Model Card

huihui-ai/SmallThinker-3B-Preview-abliterated

This is an uncensored version of PowerInfer/SmallThinker-3B-Preview created with abliteration (see remove-refusals-with-transformers to know more about it).
This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens.

Use with ollama

You can use huihui_ai/smallthinker-abliterated directly

ollama run huihui_ai/smallthinker-abliterated