Hugging Face's logo

AetherArchitectural
/
EXAONE-3.5-2.4B-Instruct-abliterated-GGUF-IQ-ARM-Imatrix-Community

GGUF
English
imatrix
conversational
Model card Files Community
aetherarchio-flat-banner Check Community Request - #81 for details.

Model name:
EXAONE-3.5-2.4B-Instruct-abliterated

Model link:
https://huggingface.co/huihui-ai/EXAONE-3.5-2.4B-Instruct-abliterated

[huihui-ai]
"This is an uncensored version of LGAI-EXAONE/EXAONE-3.5-2.4B-Instruct created with abliteration (see remove-refusals-with-transformers to know more about it). This is a crude, proof-of-concept implementation to remove refusals from an LLM model without using TransformerLens."

Downloads last month
304
GGUF
Model size
2.67B params
Architecture
exaone

3-bit

4-bit

5-bit

6-bit

8-bit

16-bit

View +2 files
Inference API
Inference API (serverless) has been turned off for this model.

Model tree for AetherArchitectural/EXAONE-3.5-2.4B-Instruct-abliterated-GGUF-IQ-ARM-Imatrix-Community

Base model

LGAI-EXAONE/EXAONE-3.5-2.4B-Instruct
Finetuned
huihui-ai/EXAONE-3.5-2.4B-Instruct-abliterated
Quantized
(4)
this model

Collection including AetherArchitectural/EXAONE-3.5-2.4B-Instruct-abliterated-GGUF-IQ-ARM-Imatrix-Community