PEFT
Safetensors
English
manupinasco commited on
Commit
33f0cdd
·
verified ·
1 Parent(s): 29549d7

Rename README (1).md to README.md

Browse files
Files changed (1) hide show
  1. README (1).md → README.md +21 -119
README (1).md → README.md RENAMED
@@ -3,35 +3,21 @@ base_model: unsloth/meta-llama-3.1-8b-instruct-bnb-4bit
3
  library_name: peft
4
  ---
5
 
6
- # Model Card for Model ID
7
 
8
  <!-- Provide a quick summary of what the model is/does. -->
9
-
10
-
11
 
12
  ## Model Details
13
 
14
  ### Model Description
15
 
16
  <!-- Provide a longer summary of what this model is. -->
 
17
 
18
-
19
-
20
- - **Developed by:** [More Information Needed]
21
- - **Funded by [optional]:** [More Information Needed]
22
- - **Shared by [optional]:** [More Information Needed]
23
- - **Model type:** [More Information Needed]
24
- - **Language(s) (NLP):** [More Information Needed]
25
- - **License:** [More Information Needed]
26
- - **Finetuned from model [optional]:** [More Information Needed]
27
-
28
- ### Model Sources [optional]
29
-
30
- <!-- Provide the basic links for the model. -->
31
-
32
- - **Repository:** [More Information Needed]
33
- - **Paper [optional]:** [More Information Needed]
34
- - **Demo [optional]:** [More Information Needed]
35
 
36
  ## Uses
37
 
@@ -40,65 +26,40 @@ library_name: peft
40
  ### Direct Use
41
 
42
  <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
43
-
44
- [More Information Needed]
45
 
46
  ### Downstream Use [optional]
47
 
48
  <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
49
-
50
- [More Information Needed]
51
 
52
  ### Out-of-Scope Use
53
 
54
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
55
-
56
- [More Information Needed]
57
 
58
  ## Bias, Risks, and Limitations
59
 
60
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
61
 
62
- [More Information Needed]
63
-
64
  ### Recommendations
65
 
66
- <!-- This section is meant to convey recommendations with respect to the bias, risk, and technical limitations. -->
67
-
68
- Users (both direct and downstream) should be made aware of the risks, biases and limitations of the model. More information needed for further recommendations.
69
-
70
- ## How to Get Started with the Model
71
-
72
- Use the code below to get started with the model.
73
-
74
- [More Information Needed]
75
 
76
  ## Training Details
77
 
78
  ### Training Data
79
 
80
  <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
81
-
82
- [More Information Needed]
83
 
84
  ### Training Procedure
85
 
86
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
87
 
88
- #### Preprocessing [optional]
89
-
90
- [More Information Needed]
91
-
92
-
93
  #### Training Hyperparameters
94
 
95
- - **Training regime:** [More Information Needed] <!--fp32, fp16 mixed precision, bf16 mixed precision, bf16 non-mixed precision, fp16 non-mixed precision, fp8 mixed precision -->
96
-
97
- #### Speeds, Sizes, Times [optional]
98
-
99
- <!-- This section provides information about throughput, start/end time, checkpoint size if relevant, etc. -->
100
-
101
- [More Information Needed]
102
 
103
  ## Evaluation
104
 
@@ -109,94 +70,35 @@ Use the code below to get started with the model.
109
  #### Testing Data
110
 
111
  <!-- This should link to a Dataset Card if possible. -->
112
-
113
- [More Information Needed]
114
 
115
  #### Factors
116
 
117
  <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
118
-
119
- [More Information Needed]
120
 
121
  #### Metrics
122
 
123
  <!-- These are the evaluation metrics being used, ideally with a description of why. -->
124
-
125
- [More Information Needed]
126
-
127
- ### Results
128
-
129
- [More Information Needed]
130
 
131
  #### Summary
132
 
133
-
134
-
135
- ## Model Examination [optional]
136
-
137
- <!-- Relevant interpretability work for the model goes here -->
138
-
139
- [More Information Needed]
140
 
141
  ## Environmental Impact
142
 
143
  <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
144
-
145
  Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
146
 
147
- - **Hardware Type:** [More Information Needed]
148
- - **Hours used:** [More Information Needed]
149
- - **Cloud Provider:** [More Information Needed]
150
- - **Compute Region:** [More Information Needed]
151
- - **Carbon Emitted:** [More Information Needed]
152
-
153
- ## Technical Specifications [optional]
154
-
155
- ### Model Architecture and Objective
156
-
157
- [More Information Needed]
158
-
159
- ### Compute Infrastructure
160
-
161
- [More Information Needed]
162
-
163
- #### Hardware
164
-
165
- [More Information Needed]
166
-
167
- #### Software
168
-
169
- [More Information Needed]
170
 
171
- ## Citation [optional]
172
-
173
- <!-- If there is a paper or blog post introducing the model, the APA and Bibtex information for that should go in this section. -->
174
-
175
- **BibTeX:**
176
-
177
- [More Information Needed]
178
-
179
- **APA:**
180
-
181
- [More Information Needed]
182
-
183
- ## Glossary [optional]
184
-
185
- <!-- If relevant, include terms and calculations in this section that can help readers understand the model or model card. -->
186
-
187
- [More Information Needed]
188
-
189
- ## More Information [optional]
190
-
191
- [More Information Needed]
192
-
193
- ## Model Card Authors [optional]
194
-
195
- [More Information Needed]
196
 
197
  ## Model Card Contact
198
 
199
- [More Information Needed]
 
200
  ### Framework versions
201
 
202
- - PEFT 0.12.0
 
3
  library_name: peft
4
  ---
5
 
6
+ # Model Card for Fine-Tuned LLaMA 3.1 on Dependency Parsing
7
 
8
  <!-- Provide a quick summary of what the model is/does. -->
9
+ This model is a fine-tuned version of **LLaMA 3.1** specifically designed to automate dependency parsing of simple sentences, categorizing words into their syntactic roles according to Universal Dependency Parsing tags.
 
10
 
11
  ## Model Details
12
 
13
  ### Model Description
14
 
15
  <!-- Provide a longer summary of what this model is. -->
16
+ The model has been fine-tuned to accurately parse simple sentences by classifying each word into its respective dependency category, such as `nsubj`, `obj`, and `root`, following the Universal Dependency framework. This fine-tuning enhances the LLaMA 3.1 model's ability to understand and analyze sentence structures, making it a valuable tool for linguistic analysis and natural language processing tasks.
17
 
18
+ - **Developed by:** Emanuel Pinasco
19
+ - **Model type:** NLP, Dependency Parsing
20
+ - **Language(s) (NLP):** English
 
 
 
 
 
 
 
 
 
 
 
 
 
 
21
 
22
  ## Uses
23
 
 
26
  ### Direct Use
27
 
28
  <!-- This section is for the model use without fine-tuning or plugging into a larger ecosystem/app. -->
29
+ The model can be used directly for syntactic analysis and linguistic research, where dependency parsing is required to understand sentence structures. It’s particularly suited for tasks involving simple sentence parsing.
 
30
 
31
  ### Downstream Use [optional]
32
 
33
  <!-- This section is for the model use when fine-tuned for a task, or when plugged into a larger ecosystem/app -->
34
+ Ideal for integration into larger NLP systems that require detailed sentence parsing, such as grammar checking tools, machine translation systems, and educational software.
 
35
 
36
  ### Out-of-Scope Use
37
 
38
  <!-- This section addresses misuse, malicious use, and uses that the model will not work well for. -->
39
+ The model is not designed for complex sentence structures, idiomatic expressions, or languages other than English. Misuse may involve attempts to apply it to tasks beyond simple dependency parsing, leading to inaccurate results.
 
40
 
41
  ## Bias, Risks, and Limitations
42
 
43
  <!-- This section is meant to convey both technical and sociotechnical limitations. -->
44
 
 
 
45
  ### Recommendations
46
 
47
+ Users (both direct and downstream) should be aware that the model's accuracy may decline with more complex or less conventional sentence structures. It's recommended to use this model in conjunction with other tools for more comprehensive linguistic analysis.
 
 
 
 
 
 
 
 
48
 
49
  ## Training Details
50
 
51
  ### Training Data
52
 
53
  <!-- This should link to a Dataset Card, perhaps with a short stub of information on what the training data is all about as well as documentation related to data pre-processing or additional filtering. -->
54
+ The model was trained on a curated dataset of simple English sentences annotated with Universal Dependency Parsing tags. The training data focused on ensuring high accuracy in syntactic role assignment.
 
55
 
56
  ### Training Procedure
57
 
58
  <!-- This relates heavily to the Technical Specifications. Content here should link to that section when it is relevant to the training procedure. -->
59
 
 
 
 
 
 
60
  #### Training Hyperparameters
61
 
62
+ - **Training regime:** Mixed precision (fp16)
 
 
 
 
 
 
63
 
64
  ## Evaluation
65
 
 
70
  #### Testing Data
71
 
72
  <!-- This should link to a Dataset Card if possible. -->
73
+ The model was evaluated using a separate dataset of simple sentences annotated with Universal Dependency tags.
 
74
 
75
  #### Factors
76
 
77
  <!-- These are the things the evaluation is disaggregating by, e.g., subpopulations or domains. -->
78
+ Evaluation focused on sentence simplicity, vocabulary diversity, and syntactic structure variations.
 
79
 
80
  #### Metrics
81
 
82
  <!-- These are the evaluation metrics being used, ideally with a description of why. -->
83
+ Accuracy in word classification into dependency categories was the primary metric.
 
 
 
 
 
84
 
85
  #### Summary
86
 
87
+ The fine-tuned model demonstrates high accuracy in dependency parsing of simple English sentences, making it a robust tool for basic syntactic analysis.
 
 
 
 
 
 
88
 
89
  ## Environmental Impact
90
 
91
  <!-- Total emissions (in grams of CO2eq) and additional considerations, such as electricity usage, go here. Edit the suggested text below accordingly -->
 
92
  Carbon emissions can be estimated using the [Machine Learning Impact calculator](https://mlco2.github.io/impact#compute) presented in [Lacoste et al. (2019)](https://arxiv.org/abs/1910.09700).
93
 
94
+ ## Model Card Authors
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
95
 
96
+ Emanuel Pinasco
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
97
 
98
  ## Model Card Contact
99
 
100
+ Emanuel Pinasco
101
+
102
  ### Framework versions
103
 
104
+ - PEFT 0.12.0