haramberesearch/llama2_xs_460M_uncensored-GGUF

Quantized GGUF model files for llama2_xs_460M_uncensored from haramberesearch

Name	Quant method	Size
llama2_xs_460m_uncensored.fp16.gguf	fp16	925.45 MB
llama2_xs_460m_uncensored.q2_k.gguf	q2_k	212.56 MB
llama2_xs_460m_uncensored.q3_k_m.gguf	q3_k_m	238.87 MB
llama2_xs_460m_uncensored.q4_k_m.gguf	q4_k_m	288.52 MB
llama2_xs_460m_uncensored.q5_k_m.gguf	q5_k_m	333.29 MB
llama2_xs_460m_uncensored.q6_k.gguf	q6_k	380.87 MB
llama2_xs_460m_uncensored.q8_0.gguf	q8_0	492.67 MB

Original Model Card:

llama2_xs_460M_uncensored

Model Details

llama2_xs_460M_experimental DPO finedtuned to remove alignment (3 epochs QLoRa).

Model Description

• Developed by: Harambe Research
• Model type: llama2
• Finetuned from model: llama2_xs_460M_experimental

Out-of-Scope Use

Don't use this to do bad things. Bad things are bad.

Recommendations

Users (both direct and downstream) should be aware of the risks, biases and limitations of the model.

How to Get Started with the Model

https://github.com/oobabooga/text-generation-webui