+
+
Model Description
+
“Luna AI Llama2 Uncensored” is a Llama2 based Chat model
fine-tuned on over 40,000 long form chat discussions
+ This model was fine-tuned by Tap, the creator of Luna AI.
+ The result is an enhanced Llama2 7b model that rivals ChatGPT in performance
across a variety of tasks.
+
This model stands out for its long responses, low hallucination rate, and absence of censorship mechanisms.
+
+
Model Training
+
The fine-tuning process was performed on an 8x a100 80GB machine.
+
The model was trained almost entirely on synthetic outputs.
+
This includes data from diverse sources which we included to create our custom dataset, it includes multiple rounds of chats between Human & AI.
+
+
+
Prompt Format
+
The model follows the Vicuna 1.1/ OpenChat format:
+
+```
+USER: I have difficulties in making friends, and I really need someone to talk to. Would you be my friend?
+
+ASSISTANT: Of course! Friends are always here for each other. What do you like to do?
+
+```
+
+
+
Future Plans
+
The model is currently being uploaded in FP16 format,
and there are plans to convert the model to GGML and GPTQ 4bit quantizations.
+
+
Benchmark Results
+
+||||||
+|---:|---:|---:|---:|---:|
+|Task|Version| Metric |Value |Stderr|
+|arc_challenge|0|acc_norm|0.5512|0.0146|
+|hellaswag|0||||
+|mmlu|0||||
+|truthfulqa_mc|1|mc2|0.4716|0.0155|
+|Average|-|-|0.5114|0.0150|
+
+
Ethical considerations
+
The data used to train the model is collected from various sources, mostly from the Web.
+ As such, it contains offensive, harmful and biased content.
We thus expect the model to exhibit such biases from the training data.
+
+
Human life
+
The model is not intended to inform decisions about matters central to human life,
and should not be used in such a way.
+
+
Risks and harms
+
Risks and harms of large language models include the generation of harmful, offensive or biased content.
+ These models are often prone to generating incorrect information, sometimes referred to as hallucinations.
+
We do not expect our model to be an exception in this regard.
+
+
+
+
diff --git a/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/USE_POLICY.md b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/USE_POLICY.md
new file mode 100644
index 0000000000000000000000000000000000000000..abbcc199b2d1e4feb5d7e40c0bd67e1b0ce29e97
--- /dev/null
+++ b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/USE_POLICY.md
@@ -0,0 +1,50 @@
+# Llama 2 Acceptable Use Policy
+
+Meta is committed to promoting safe and fair use of its tools and features, including Llama 2. If you access or use Llama 2, you agree to this Acceptable Use Policy (“Policy”). The most recent copy of this policy can be found at [ai.meta.com/llama/use-policy](http://ai.meta.com/llama/use-policy).
+
+## Prohibited Uses
+We want everyone to use Llama 2 safely and responsibly. You agree you will not use, or allow others to use, Llama 2 to:
+
+1. Violate the law or others’ rights, including to:
+ 1. Engage in, promote, generate, contribute to, encourage, plan, incite, or further illegal or unlawful activity or content, such as:
+ 1. Violence or terrorism
+ 2. Exploitation or harm to children, including the solicitation, creation, acquisition, or dissemination of child exploitative content or failure to report Child Sexual Abuse Material
+ 3. Human trafficking, exploitation, and sexual violence
+ 4. The illegal distribution of information or materials to minors, including obscene materials, or failure to employ legally required age-gating in connection with such information or materials.
+ 5. Sexual solicitation
+ 6. Any other criminal activity
+ 2. Engage in, promote, incite, or facilitate the harassment, abuse, threatening, or bullying of individuals or groups of individuals
+ 3. Engage in, promote, incite, or facilitate discrimination or other unlawful or harmful conduct in the provision of employment, employment benefits, credit, housing, other economic benefits, or other essential goods and services
+ 4. Engage in the unauthorized or unlicensed practice of any profession including, but not limited to, financial, legal, medical/health, or related professional practices
+ 5. Collect, process, disclose, generate, or infer health, demographic, or other sensitive personal or private information about individuals without rights and consents required by applicable laws
+ 6. Engage in or facilitate any action or generate any content that infringes, misappropriates, or otherwise violates any third-party rights, including the outputs or results of any products or services using the Llama 2 Materials
+ 7. Create, generate, or facilitate the creation of malicious code, malware, computer viruses or do anything else that could disable, overburden, interfere with or impair the proper working, integrity, operation or appearance of a website or computer system
+
+
+
+2. Engage in, promote, incite, facilitate, or assist in the planning or development of activities that present a risk of death or bodily harm to individuals, including use of Llama 2 related to the following:
+ 1. Military, warfare, nuclear industries or applications, espionage, use for materials or activities that are subject to the International Traffic Arms Regulations (ITAR) maintained by the United States Department of State
+ 2. Guns and illegal weapons (including weapon development)
+ 3. Illegal drugs and regulated/controlled substances
+ 4. Operation of critical infrastructure, transportation technologies, or heavy machinery
+ 5. Self-harm or harm to others, including suicide, cutting, and eating disorders
+ 6. Any content intended to incite or promote violence, abuse, or any infliction of bodily harm to an individual
+
+
+
+3. Intentionally deceive or mislead others, including use of Llama 2 related to the following:
+ 1. Generating, promoting, or furthering fraud or the creation or promotion of disinformation
+ 2. Generating, promoting, or furthering defamatory content, including the creation of defamatory statements, images, or other content
+ 3. Generating, promoting, or further distributing spam
+ 4. Impersonating another individual without consent, authorization, or legal right
+ 5. Representing that the use of Llama 2 or outputs are human-generated
+ 6. Generating or facilitating false online engagement, including fake reviews and other means of fake online engagement
+4. Fail to appropriately disclose to end users any known dangers of your AI system
+
+Please report any violation of this Policy, software “bug,” or other problems that could lead to a violation of this Policy through one of the following means:
+
+* Reporting issues with the model: [github.com/facebookresearch/llama](http://github.com/facebookresearch/llama)
+* Reporting risky content generated by the model: [developers.facebook.com/llama_output_feedback](http://developers.facebook.com/llama_output_feedback)
+* Reporting bugs and security concerns: [facebook.com/whitehat/info](http://facebook.com/whitehat/info)
+* Reporting violations of the Acceptable Use Policy or unlicensed uses of Llama: [LlamaUseReport@meta.com](mailto:LlamaUseReport@meta.com)
+
diff --git a/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/config.json b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/config.json
new file mode 100644
index 0000000000000000000000000000000000000000..0ebe5ca73205075e07d1d85fb842e5737c159645
--- /dev/null
+++ b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/config.json
@@ -0,0 +1,24 @@
+{
+ "_name_or_path": "TheBloke/Llama-2-7B-fp16",
+ "architectures": [
+ "LlamaForCausalLM"
+ ],
+ "bos_token_id": 1,
+ "eos_token_id": 2,
+ "hidden_act": "silu",
+ "hidden_size": 4096,
+ "initializer_range": 0.02,
+ "intermediate_size": 11008,
+ "max_length": 4096,
+ "max_position_embeddings": 4096,
+ "model_type": "llama",
+ "num_attention_heads": 32,
+ "num_hidden_layers": 32,
+ "pad_token_id": 0,
+ "rms_norm_eps": 1e-05,
+ "tie_word_embeddings": false,
+ "torch_dtype": "float32",
+ "transformers_version": "4.28.1",
+ "use_cache": true,
+ "vocab_size": 32000
+}
\ No newline at end of file
diff --git a/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/generation_config.json b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/generation_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..1372199d8db4c7b56921c19c5306013ce5b3c62d
--- /dev/null
+++ b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/generation_config.json
@@ -0,0 +1,7 @@
+{
+ "_from_model_config": true,
+ "bos_token_id": 1,
+ "eos_token_id": 2,
+ "pad_token_id": 0,
+ "transformers_version": "4.28.1"
+}
diff --git a/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/gptq_model-4bit-128g.safetensors b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/gptq_model-4bit-128g.safetensors
new file mode 100644
index 0000000000000000000000000000000000000000..ac646bdd5eec4cc48244d79ebc6bed6658aaad02
--- /dev/null
+++ b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/gptq_model-4bit-128g.safetensors
@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:f73e6dd431a174f949e4322c7b806c536434998488e334a4dcc378813394526b
+size 3896726080
diff --git a/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/huggingface-metadata.txt b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/huggingface-metadata.txt
new file mode 100644
index 0000000000000000000000000000000000000000..72b29bebb1255637b07dd644f047aafbfdb28dc4
--- /dev/null
+++ b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/huggingface-metadata.txt
@@ -0,0 +1,6 @@
+url: https://huggingface.co/TheBloke/Luna-AI-Llama2-Uncensored-GPTQ
+branch: main
+download date: 2023-07-26 17:19:22
+sha256sum:
+ f73e6dd431a174f949e4322c7b806c536434998488e334a4dcc378813394526b gptq_model-4bit-128g.safetensors
+ 9e556afd44213b6bd1be2b850ebbbd98f5481437a8021afaf58ee7fb1818d347 tokenizer.model
diff --git a/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/quantize_config.json b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/quantize_config.json
new file mode 100644
index 0000000000000000000000000000000000000000..55cf880c2ffbeb0a6a81be8a55c4981b43113d3b
--- /dev/null
+++ b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/quantize_config.json
@@ -0,0 +1,10 @@
+{
+ "bits": 4,
+ "group_size": 128,
+ "damp_percent": 0.01,
+ "desc_act": false,
+ "sym": true,
+ "true_sequential": true,
+ "model_name_or_path": null,
+ "model_file_base_name": null
+}
\ No newline at end of file
diff --git a/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/special_tokens_map.json b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/special_tokens_map.json
new file mode 100644
index 0000000000000000000000000000000000000000..f928b2409a393d47ce0d9fe519f17e048a471eca
--- /dev/null
+++ b/models/TheBloke_Luna-AI-Llama2-Uncensored-GPTQ/special_tokens_map.json
@@ -0,0 +1,24 @@
+{
+ "bos_token": {
+ "content": "