prithivMLmods commited on
Commit
d0a246c
·
verified ·
1 Parent(s): a0307fa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +58 -1
README.md CHANGED
@@ -11,4 +11,61 @@ tags:
11
  - R1
12
  - Qwen
13
  - Deepseek
14
- ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
11
  - R1
12
  - Qwen
13
  - Deepseek
14
+ ---
15
+ # **Elita-0.1-Distilled-R1-Abliterated**
16
+
17
+ Elita-0.1-Distilled-R1-Abliterated is based on the *Qwen [ KT ] model*, which was distilled by *DeepSeek-AI/DeepSeek-R1-Distill-Qwen-7B*. It has been fine-tuned on the long chain-of-thought reasoning model and specialized datasets, focusing on chain-of-thought (CoT) reasoning for problem-solving. This model is optimized for tasks requiring logical reasoning, detailed explanations, and multi-step problem-solving, making it ideal for applications such as instruction-following, text generation, and complex reasoning tasks.
18
+
19
+ # **Quickstart with Transformers**
20
+
21
+ Here provides a code snippet with `apply_chat_template` to show you how to load the tokenizer and model and how to generate contents.
22
+
23
+ ```python
24
+ from transformers import AutoModelForCausalLM, AutoTokenizer
25
+
26
+ model_name = "prithivMLmods/Elita-0.1-Distilled-R1-Abliterated"
27
+
28
+ model = AutoModelForCausalLM.from_pretrained(
29
+ model_name,
30
+ torch_dtype="auto",
31
+ device_map="auto"
32
+ )
33
+ tokenizer = AutoTokenizer.from_pretrained(model_name)
34
+
35
+ prompt = "Give me a short introduction to large language model."
36
+ messages = [
37
+ {"role": "system", "content": "You are Elita, created by DeepSeek-AI. You are a powerful reasoning assistant."},
38
+ {"role": "user", "content": prompt}
39
+ ]
40
+ text = tokenizer.apply_chat_template(
41
+ messages,
42
+ tokenize=False,
43
+ add_generation_prompt=True
44
+ )
45
+ model_inputs = tokenizer([text], return_tensors="pt").to(model.device)
46
+
47
+ generated_ids = model.generate(
48
+ **model_inputs,
49
+ max_new_tokens=512
50
+ )
51
+ generated_ids = [
52
+ output_ids[len(input_ids):] for input_ids, output_ids in zip(model_inputs.input_ids, generated_ids)
53
+ ]
54
+
55
+ response = tokenizer.batch_decode(generated_ids, skip_special_tokens=True)[0]
56
+ ```
57
+
58
+ ### **Intended Use:**
59
+ 1. **Instruction-Following:** The model excels in understanding and executing detailed instructions, making it ideal for automation systems, virtual assistants, and educational tools.
60
+ 2. **Text Generation:** It can produce coherent, logically structured, and contextually relevant text for use in content creation, summarization, and report writing.
61
+ 3. **Complex Reasoning Tasks:** With its fine-tuning for chain-of-thought reasoning, the model is well-suited for multi-step problem-solving, logical deduction, and question-answering tasks.
62
+ 4. **Research and Development:** It can support researchers and developers in exploring advancements in logical reasoning and fine-tuning methodologies.
63
+ 5. **Educational Applications:** The model can assist in teaching logical reasoning and problem-solving by generating step-by-step solutions.
64
+
65
+ ### **Limitations:**
66
+ 1. **Domain-Specific Knowledge:** While fine-tuned on reasoning datasets, the model may lack deep expertise in highly specialized or technical domains.
67
+ 2. **Hallucination:** Like many large language models, it can generate incorrect or fabricated information, especially when reasoning beyond its training data.
68
+ 3. **Bias in Training Data:** The model's outputs may reflect biases present in the datasets it was fine-tuned on, which could limit its objectivity in certain contexts.
69
+ 4. **Performance on Non-Reasoning Tasks:** The model is optimized for chain-of-thought reasoning and may underperform on tasks that require simpler, less structured responses.
70
+ 5. **Resource-Intensive:** Running the model efficiently requires significant computational resources, which may limit accessibility for smaller-scale deployments.
71
+ 6. **Dependence on Input Quality:** The model’s performance heavily depends on the clarity and quality of the input provided. Ambiguous or poorly structured prompts may yield suboptimal results.