Update README.md
Browse files
README.md
CHANGED
@@ -35,7 +35,8 @@ I am not sure to what extend the context part has any effect. Doesn't hurt thoug
|
|
35 |
|
36 |
This is a version 0.2 and finetuned just so it retains the underlaying Vicuna qualities.
|
37 |
|
38 |
-
Example:
|
|
|
39 |
Input
|
40 |
```
|
41 |
USER: Edit the following for spelling and grammar mistakes:
|
@@ -62,9 +63,9 @@ John replied, "Yeah, this crazy little guy follows me everywhere." Just then Jac
|
|
62 |
Tom struggled to keep his balance as he laughed hysterically.
|
63 |
```
|
64 |
|
65 |
-
Goal: to create the best grammar checker you have ever seen
|
66 |
|
67 |
-
To do:
|
68 |
- train on even larger dataset
|
69 |
-
- see if finetuning on just plain LLAMA without Vicuna would work better or worse (the
|
70 |
- explore what different settings (temperature, top_p, top_k do for this type of finetune)
|
|
|
35 |
|
36 |
This is a version 0.2 and finetuned just so it retains the underlaying Vicuna qualities.
|
37 |
|
38 |
+
## Example:
|
39 |
+
|
40 |
Input
|
41 |
```
|
42 |
USER: Edit the following for spelling and grammar mistakes:
|
|
|
63 |
Tom struggled to keep his balance as he laughed hysterically.
|
64 |
```
|
65 |
|
66 |
+
## Goal: to create the best grammar checker you have ever seen
|
67 |
|
68 |
+
## To do:
|
69 |
- train on even larger dataset
|
70 |
+
- see if finetuning on just plain LLAMA without Vicuna would work better or worse (the theory is that it will became very focused on editing and nothing else)
|
71 |
- explore what different settings (temperature, top_p, top_k do for this type of finetune)
|