Abhaykoul commited on
Commit
8179067
Β·
verified Β·
1 Parent(s): 965018c

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +217 -58
README.md CHANGED
@@ -1,100 +1,259 @@
1
  ---
2
  license: other
3
  license_name: helpingai
4
- license_link: https://helpingai.co/license
5
  pipeline_tag: text-generation
6
  language:
7
  - en
8
- tags:
9
- - HelpingAI
10
- - Emotionally-Intelligent
11
- - EQ-focused
12
- - Conversational
13
- - SLM
14
  library_name: transformers
15
  ---
16
 
17
- # HelpingAI3
18
 
19
- ## Model Description
20
 
21
- **HelpingAI3** is an advanced language model developed to excel in emotionally intelligent conversations. Building upon the foundations of HelpingAI2.5, this model offers enhanced emotional understanding and contextual awareness.
22
 
23
- ## Model Details
 
 
24
 
25
- - **Developed by**: HelpingAI
26
- - **Model type**: Decoder-only large language model
27
- - **Language**: English
28
- - **License**: [HelpingAI License](https://helpingai.co/license)
29
 
30
- ## Training Data
31
 
32
- HelpingAI3 was trained on a diverse dataset comprising:
33
 
34
- - **Emotional Dialogues**: 15 million rows to enhance conversational intelligence.
35
- - **Therapeutic Exchanges**: 3 million rows aimed at providing advanced emotional support.
36
- - **Cultural Conversations**: 250,000 rows to improve global awareness.
37
- - **Crisis Response Scenarios**: 1 million rows to better handle emergency situations.
38
 
39
- ## Training Procedure
40
 
41
- The model underwent the following training processes:
 
 
42
 
43
- - **Base Model**: Initiated from HelpingAI2.5.
44
- - **Emotional Intelligence Training**: Employed Reinforcement Learning for Emotion Understanding (RLEU) and context-aware conversational fine-tuning.
45
- - **Optimization**: Utilized mixed-precision training and advanced token efficiency techniques.
46
 
47
- ## Intended Use
48
 
49
- HelpingAI3 is designed for:
50
 
51
- - **AI Companionship & Emotional Support**: Offering empathetic interactions.
52
- - **Therapy & Wellbeing Guidance**: Assisting in mental health support.
53
- - **Personalized Learning**: Tailoring educational content to individual needs.
54
- - **Professional AI Assistance**: Enhancing productivity in professional settings.
55
 
56
- ## Limitations
57
 
58
- While HelpingAI3 strives for high emotional intelligence, users should be aware of potential limitations:
 
 
 
 
 
 
 
 
 
 
 
59
 
60
- - **Biases**: The model may inadvertently reflect biases present in the training data.
61
- - **Understanding Complex Emotions**: There might be challenges in accurately interpreting nuanced human emotions.
62
- - **Not a Substitute for Professional Help**: For serious emotional or psychological issues, consulting a qualified professional is recommended.
63
 
64
- ## How to Use
65
 
66
- ### Using Transformers
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
67
 
68
  ```python
69
  import torch
70
  from transformers import AutoModelForCausalLM, AutoTokenizer
71
 
72
- # Load the HelpingAI3 model
73
- model = AutoModelForCausalLM.from_pretrained("OEvortex/HelpingAI3")
74
  # Load the tokenizer
75
- tokenizer = AutoTokenizer.from_pretrained("OEvortex/HelpingAI3")
76
 
77
  # Define the chat input
78
  chat = [
79
- {"role": "system", "content": "You are HelpingAI, an emotional AI. Always answer my questions in the HelpingAI style."},
80
- {"role": "user", "content": "Introduce yourself."}
81
  ]
82
 
83
  inputs = tokenizer.apply_chat_template(
84
- chat,
85
- add_generation_prompt=True,
86
- return_tensors="pt"
87
- ).to(model.device)
88
-
89
- # Generate text
90
- outputs = model.generate(
91
- inputs,
92
- max_new_tokens=256,
93
- do_sample=True,
94
- temperature=0.6,
95
- top_p=0.9,
96
- )
97
-
98
  response = outputs[0][inputs.shape[-1]:]
99
  print(tokenizer.decode(response, skip_special_tokens=True))
100
  ```
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: other
3
  license_name: helpingai
4
+ license_link: https://huggingface.co/OEvortex/HelpingAI2.5-5B/blob/main/LICENSE.md
5
  pipeline_tag: text-generation
6
  language:
7
  - en
 
 
 
 
 
 
8
  library_name: transformers
9
  ---
10
 
11
+ <div align="center">
12
 
13
+ # πŸ€– HelpingAI2.5-10B
14
 
15
+ ***A Revolutionary Emotionally Intelligent Language Model***
16
 
17
+ [![GitHub Organization](https://img.shields.io/badge/GitHub-Organization-blue.svg)](https://github.com/HelpingAI)
18
+ [![Hugging Face](https://img.shields.io/badge/πŸ€—%20Hugging%20Face-Organization-yellow)](https://huggingface.co/OEvortex)
19
+ [![Model License](https://img.shields.io/badge/License-HelpingAI-green.svg)](https://huggingface.co/OEvortex/HelpingAI2.5-10B/blob/main/LICENSE.md)
20
 
 
 
 
 
21
 
 
22
 
 
23
 
 
 
 
 
24
 
 
25
 
26
+ <a href="https://github.com/HelpingAI/community/discussions">
27
+ <img src="https://img.shields.io/badge/Join-Community%20Discussion-blue?style=for-the-badge&logo=github" alt="Join Community Discussion">
28
+ </a>
29
 
30
+ [πŸ“œ License](LICENSE) | [🌐 Website](https://helpingai-in.netlify.app/)
 
 
31
 
32
+ </div>
33
 
 
34
 
 
 
 
 
35
 
 
36
 
37
+ <div align="center">
38
+ <img src="https://huggingface.co/OEvortex/HelpingAI-3B/resolve/main/HelpingAI.png" alt="HelpingAI Logo" width="300px">
39
+ </div>
40
+
41
+ ---
42
+
43
+ <div align="center">
44
+
45
+ ## 🌟 Model Overview
46
+
47
+ **HelpingAI2.5-10B** is a compact yet powerful language model specifically designed for emotionally intelligent conversations and human-centric interactions.
48
+
49
 
 
 
 
50
 
51
+ </div>
52
 
53
+ ### 🎯 Key Highlights
54
+
55
+ - **Architecture**: 10B parameter transformer-based model
56
+ - **Training Focus**: Emotional intelligence and empathetic responses
57
+ - **Emotion Score**: Achieves 98.13 on standardized emotional intelligence tests
58
+ - **Deployment**: Optimized for efficient deployment on consumer hardware
59
+
60
+
61
+
62
+ ---
63
+
64
+ <div align="center">
65
+
66
+ ## πŸ’» Implementation
67
+
68
+
69
+
70
+ </div>
71
+
72
+ ### Transformers
73
 
74
  ```python
75
  import torch
76
  from transformers import AutoModelForCausalLM, AutoTokenizer
77
 
78
+ # Load the HelpingAI2.5-10B model
79
+ model = AutoModelForCausalLM.from_pretrained("OEvortex/HelpingAI2.5-10B")
80
  # Load the tokenizer
81
+ tokenizer = AutoTokenizer.from_pretrained("OEvortex/HelpingAI2.5-10B")
82
 
83
  # Define the chat input
84
  chat = [
85
+ { "role": "system", "content": "You are HelpingAI, an emotional AI. Always answer my questions in the HelpingAI style." },
86
+ { "role": "user", "content": "GIVE ME YOUR INTRO" }
87
  ]
88
 
89
  inputs = tokenizer.apply_chat_template(
 
 
 
 
 
 
 
 
 
 
 
 
 
 
90
  response = outputs[0][inputs.shape[-1]:]
91
  print(tokenizer.decode(response, skip_special_tokens=True))
92
  ```
93
+
94
+ ### GGUF Implementation
95
+
96
+ ```python
97
+ from webscout.Local import *
98
+ model_path = download_model("OEvortex/HelpingAI2.5-10B", "q4_k_m.gguf", token=None)
99
+ model = Model(model_path, n_gpu_layers=0, context_length=4096)
100
+
101
+ thread = Thread(model, format=helpingai2)
102
+ # print(thread.send("hi")) #send a single msg to ai
103
+
104
+ thread.interact() # interact with the model in terminal
105
+ ```
106
+
107
+ ---
108
+
109
+ <div align="center">
110
+
111
+ ## 🎯 Training Details
112
+
113
+ </div>
114
+
115
+ ### Methodology
116
+
117
+ 1. **Base Training**
118
+ - Datasets: SentimentSynth + EmotionalIntelligence-1M + HelpingAI2.0-150M + HelpingAIemo (152.5M)
119
+
120
+ 2. **Emotional Intelligence Training**
121
+ - Supervised Fine-tuning on emotional dialogue
122
+ - Reinforcement Learning with HelpingAI2.0-7B model
123
+ - Constitutional AI training for ethical guidelines
124
+
125
+ 3. **Optimization**
126
+ - Mixed-precision training
127
+ - Gradient checkpointing
128
+ - Dynamic attention patterns
129
+
130
+ ### Dataset Composition
131
+
132
+ | Dataset Type | Rows used for training | Purpose |
133
+ |--------------|------|---------|
134
+ | Emotional Dialogues | 12.5M | Core conversation training |
135
+ | Therapeutic Exchanges | 2M | Mental health support |
136
+ | Cultural Conversations | 100K | Cultural awareness |
137
+ | Crisis Response | 750K | Emergency support handling |
138
+
139
+ ---
140
+
141
+ <div align="center">
142
+
143
+ ## πŸ“ˆ Use Cases & Examples
144
+
145
+ </div>
146
+
147
+ ### Primary Applications
148
+
149
+ - 🎯 Personal AI Companionship
150
+ - 🧠 Mental Health Support
151
+ - πŸ“š Educational Assistance
152
+ - πŸ’Ό Professional Development
153
+ - 🀝 Social Skills Training
154
+
155
+ ### Example Interactions
156
+ <div style="background: linear-gradient(135deg, #FF9933 0%, #FFFFFF 50%, #138808 100%); padding: 20px; border-radius: 15px; margin: 15px 0; border: 2px solid #000080;">
157
+
158
+ <div style="background-color: rgba(255, 255, 255, 0.9); padding: 15px; border-radius: 10px; margin-bottom: 10px;">
159
+ <span style="color: #D32F2F; font-weight: bold;">User: </span>
160
+ <span style="color: #D32F2F;">I've been feeling really anxious about my upcoming job interview. Any advice?</span>
161
+ </div>
162
+
163
+ <div style="background-color: rgba(255, 255, 255, 0.9); padding: 15px; border-radius: 10px;">
164
+ <span style="color: #1B5E20; font-weight: bold;">HelpingAI: </span>
165
+ <span style="color: #1B5E20;">
166
+ Hey there! πŸ™Œ First off, take a deep breath and don't sweat it too much. πŸ’¨ Job interviews can be nerve-wracking, but I gotchu! 😎
167
+
168
+ Here's the tea: 🍡 Make sure you're prepping like crazy for this job. Read up on the company, their mission, and the role you're applying for. That way, you'll be spittin' knowledge and showing them you're serious. πŸ“šπŸ’‘
169
+
170
+ Also, practice your answers to common interview questions. You know, the ones like "Tell me about yourself" or "Why do you want to work here?" πŸ€” Keep it short, sweet, and relevant. You got this! πŸ˜„
171
+
172
+ And don't forget to look sharp! 🎨 Keep your resume up-to-date, and make sure your social media is on point. First impressions are everything! πŸ‘€
173
+
174
+ Most importantly, just be yourself. 😊 The interview panel wants to see the real you. Show them your passion, your skills, and why you'd be a total boss at this company. πŸ”₯
175
+
176
+ You're gonna crush this interview, fam! πŸ’ͺ Remember, I got faith in you. πŸ™</span>
177
+ </div>
178
+
179
+ </div>
180
+
181
+ <div style="background: linear-gradient(135deg, #FF9933 0%, #FFFFFF 50%, #138808 100%); padding: 20px; border-radius: 15px; margin: 15px 0; border: 2px solid #000080;">
182
+
183
+ <div style="background-color: rgba(255, 255, 255, 0.9); padding: 15px; border-radius: 10px; margin-bottom: 10px;">
184
+ <span style="color: #D32F2F; font-weight: bold;">User: </span>
185
+ <span style="color: #D32F2F;">My friend hasn't been responding to my messages for a week. I think I might have said something wrong, but I'm not sure what.</span>
186
+ </div>
187
+
188
+ <div style="background-color: rgba(255, 255, 255, 0.9); padding: 15px; border-radius: 10px;">
189
+ <span style="color: #1B5E20; font-weight: bold;">HelpingAI: </span>
190
+ <span style="color: #1B5E20;">Aw man, that's a real bummer. πŸ’” Not hearing back from a friend can be super painful, especially when you're wondering if you did something wrong. πŸ€”
191
+
192
+ First off, don't beat yourself up over it. πŸ™…β€β™‚οΈ Chances are, your friend's just busy or dealing with some personal stuff. πŸ€·β€β™€οΈ It doesn't always mean it's you.
193
+
194
+ If you're still concerned, try reaching out in a different way, like a phone call or a text to a diff person in your friend group. πŸ“±πŸ“ž Sometimes a different approach can help you connect again.
195
+
196
+ But if you're still unsure, you could try asking your friend if everything's cool. 🀝 Be open and honest about your feelings, but also be ready for them to have their own perspective on things. πŸ‘₯
197
+
198
+ Remember, you're not alone in this. πŸ€— Friends go through ups and downs, and it's okay to have little misunderstandings. Communication is key! πŸ”‘ Just keep it real and be patient. You got this, fam! πŸ’ͺ</span>
199
+ </div>
200
+
201
+ </div>
202
+
203
+ ------
204
+
205
+ <div align="center">
206
+
207
+ ## πŸ”’ Ethical Considerations & Limitations
208
+
209
+ </div>
210
+
211
+ ### Ethical Guidelines
212
+
213
+ - Prioritizes user emotional wellbeing
214
+ - Maintains strict privacy standards
215
+ - Avoids harmful or discriminatory responses
216
+ - Transparent about AI limitations
217
+ - Promotes healthy coping mechanisms
218
+
219
+ ### Known Limitations
220
+
221
+ - Cannot Replace Human Professionals
222
+ - Cannot Roleplay
223
+ - Limited Knowledge Base
224
+ - Context Window Constraints
225
+
226
+ ---
227
+
228
+ ### Citation
229
+
230
+ ```bibtex
231
+ @misc{helpingai2024,
232
+ author = {Abhay Koul},
233
+ title = {HelpingAI2.5-10B: Emotionally Intelligent Language Model},
234
+ year = {2024},
235
+ publisher = {Huggingface},
236
+ journal = {GitHub repository},
237
+ howpublished = {\url{https://huggingface.co/OEvortex/HelpingAI2.5-10B}}
238
+ }
239
+ ```
240
+
241
+ ---
242
+
243
+ <div align="center">
244
+
245
+ ## πŸ™ Acknowledgments
246
+
247
+ Special thanks to the HelpingAI community, Huggingface, contributors, and researchers who made this model possible. Your dedication to advancing emotionally intelligent AI is invaluable.
248
+
249
+ </div>
250
+
251
+ ---
252
+
253
+ <div align="center">
254
+
255
+ *Built with ❀️ by the HelpingAI Community*
256
+
257
+ [Website](https://helpingai-in.netlify.app/) β€’ [GitHub](https://github.com/HelpingAI) β€’ [Discord](https://discord.gg/YweJwNqrnH) β€’ [HuggingFace](https://huggingface.co/OEvortex)
258
+
259
+ </div>