ayeshaNoor1
commited on
Commit
•
462a0a0
1
Parent(s):
cf0a6ba
Updated README.md
Browse files
README.md
CHANGED
@@ -3,4 +3,110 @@ license: llama3.2
|
|
3 |
tags:
|
4 |
- unsloth
|
5 |
- text-generation
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
6 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
3 |
tags:
|
4 |
- unsloth
|
5 |
- text-generation
|
6 |
+
datasets:
|
7 |
+
- marmikpandya/mental-health
|
8 |
+
- Amod/mental_health_counseling_conversations
|
9 |
+
- AdithyaSK/CompanionLLama_instruction_30k
|
10 |
+
base_model:
|
11 |
+
- unsloth/Llama-3.2-3B-Instruct
|
12 |
+
library_name: transformers
|
13 |
---
|
14 |
+
# Model Card for Model ID
|
15 |
+
|
16 |
+
<!-- Provide a quick summary of what the model is/does. -->
|
17 |
+
|
18 |
+
This modelcard aims to be a base template for new models. It has been generated using [this raw template](https://github.com/huggingface/huggingface_hub/blob/main/src/huggingface_hub/templates/modelcard_template.md?plain=1).
|
19 |
+
|
20 |
+
## Model Details
|
21 |
+
|
22 |
+
### Model Description
|
23 |
+
|
24 |
+
<!-- Provide a longer summary of what this model is. -->
|
25 |
+
This model has been fine-tuned for use in a chatbot aimed at mental well-being support. It is designed to offer empathetic, supportive responses to users' mental health inquiries. A combined dataset was created by merging three relevant datasets for training to enhance the model’s ability to understand and respond appropriately in counseling scenarios.
|
26 |
+
|
27 |
+
- **Developed by:** Ayesha Noor
|
28 |
+
- **Model type:** Language model for conversational AI
|
29 |
+
- **Language(s) (NLP):** English
|
30 |
+
- **License:** llama3.2
|
31 |
+
- **Finetuned from model:** unsloth/Llama-3.2-3B-Instruct
|
32 |
+
|
33 |
+
### Model Sources [optional]
|
34 |
+
|
35 |
+
<!-- Provide the basic links for the model. -->
|
36 |
+
|
37 |
+
- **Repository:** ayeshaNoor1/Llama_finetunedModel
|
38 |
+
|
39 |
+
## Uses
|
40 |
+
|
41 |
+
<!-- Address questions around how the model is intended to be used, including the foreseeable users of the model and those affected by the model. -->
|
42 |
+
|
43 |
+
### Direct Use
|
44 |
+
|
45 |
+
<!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
|
46 |
+
|
47 |
+
Intended for mental health chatbot applications, particularly for providing initial support, resources, and empathetic responses in mental well-being conversations.
|
48 |
+
|
49 |
+
### Downstream Use [optional]
|
50 |
+
|
51 |
+
<!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
|
52 |
+
|
53 |
+
May be used as part of broader mental health support applications, integrated into platforms aimed at user well-being.
|
54 |
+
|
55 |
+
### Out-of-Scope Use
|
56 |
+
|
57 |
+
<!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
|
58 |
+
|
59 |
+
Not recommended for critical mental health assessments, as it is not a replacement for professional help. Avoid using for high-stakes decision-making without appropriate oversight.
|
60 |
+
|
61 |
+
|
62 |
+
### Recommendations
|
63 |
+
|
64 |
+
<!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
|
65 |
+
|
66 |
+
Users should be aware of the limitations in handling diverse mental health needs and sensitive conversations. Professional oversight is advised when using in serious or emergency mental health contexts.
|
67 |
+
|
68 |
+
|
69 |
+
## How to Get Started with the Model
|
70 |
+
|
71 |
+
Use the code below to get started with the model.
|
72 |
+
|
73 |
+
from transformers import AutoTokenizer, AutoModelForCausalLM
|
74 |
+
|
75 |
+
tokenizer = AutoTokenizer.from_pretrained("ayeshaNoor1/Llama_finetunedModel")
|
76 |
+
model = AutoModelForCausalLM.from_pretrained("ayeshaNoor1/Llama_finetunedModel")
|
77 |
+
|
78 |
+
inputs = tokenizer("Your text here", return_tensors="pt")
|
79 |
+
outputs = model.generate(**inputs)
|
80 |
+
|
81 |
+
## Training Details
|
82 |
+
|
83 |
+
### Training Data
|
84 |
+
|
85 |
+
<!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
|
86 |
+
A single dataset was created by merging:
|
87 |
+
|
88 |
+
- **First Dataset:** - marmikpandya/mental-health
|
89 |
+
- **Second Dataset:** - Amod/mental_health_counseling_conversations
|
90 |
+
- **Third Dataset:** - AdithyaSK/CompanionLLama_instruction_30k
|
91 |
+
|
92 |
+
### Training Procedure
|
93 |
+
|
94 |
+
<!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
|
95 |
+
|
96 |
+
#### Preprocessing [optional]
|
97 |
+
|
98 |
+
Data was preprocessed to ensure consistency in format, relevance to mental health support, and removal of any sensitive or personal identifiers.
|
99 |
+
|
100 |
+
#### Summary
|
101 |
+
The model demonstrated proficiency in providing supportive responses in well-being conversations.
|
102 |
+
|
103 |
+
|
104 |
+
## Technical Specifications [optional]
|
105 |
+
|
106 |
+
|
107 |
+
### Compute Infrastructure
|
108 |
+
|
109 |
+
#### Software
|
110 |
+
|
111 |
+
- **Libraries:** transformers, datasets, torch, pandas, trl, unsloth
|
112 |
+
- **Framework:** PyTorch
|