update model card README.md

README.md

@@ -14,32 +14,22 @@ should probably proofread and complete it, then remove this comment. -->
 
 # tweet_instruct_detect
 
-This model is a fine-tuned version of [microsoft/Multilingual-MiniLM-L12-H384](https://huggingface.co/microsoft/Multilingual-MiniLM-L12-H384) on an dataset combining manually labelled tweets into either instructions or spam, and pre-processed instructions from the flan dataset that are less than 250 characters long to be used as positive instructions.
+This model is a fine-tuned version of [microsoft/Multilingual-MiniLM-L12-H384](https://huggingface.co/microsoft/Multilingual-MiniLM-L12-H384) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.1300
-- Accuracy: 0.9761
+- Loss: 0.1452
+- Accuracy: 0.9680
 
 ## Model description
 
-This model is trained to help determine if tweets are useful instructions. This can be used to filter the large corpus of tweet data online into useful instruction datasets for instruction fine-tuning.
+More information needed
 
 ## Intended uses & limitations
 
-Intended to be used to determine if tweets are useful instructions.
-
-The model will be biased towards english data, and maybe be biased towards certain ways of phrasing "instructions". Instructions in this case may also be questions.
-
-Current version of the model is very basic and can get confused by simple things. For example, simply adding a ? character will bias it heavily towards an instruction, even if using the same sentence so it is highly sensitive to certain characters and ways of phrasing things. This can hopefully be fixed by better training data or model tuning.
+More information needed
 
 ## Training and evaluation data
 
-Model was fine-tuned on a relatively small number of tweets and instructions.
-
-Train data: 749 examples
-Test data: 251 examples
-
-Out of the total number of examples, 526 of them were manually labelled tweets, most of which were spam due to the high noise ratio in tweets.
-Spam in this case can refer to actual spam, gibberish, or also statements that are generally fine but not useful as an instruction or question.
+More information needed
 
 ## Training procedure
 
@@ -52,17 +42,32 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- num_epochs: 5
+- num_epochs: 20
 
 ### Training results
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|
-| No log        | 1.0   | 47   | 0.3832          | 0.9562   |
-| No log        | 2.0   | 94   | 0.2004          | 0.9681   |
-| No log        | 3.0   | 141  | 0.1501          | 0.9721   |
-| No log        | 4.0   | 188  | 0.1362          | 0.9721   |
-| No log        | 5.0   | 235  | 0.1300          | 0.9761   |
+| No log        | 1.0   | 53   | 0.3291          | 0.9537   |
+| No log        | 2.0   | 106  | 0.1896          | 0.9537   |
+| No log        | 3.0   | 159  | 0.1724          | 0.9573   |
+| No log        | 4.0   | 212  | 0.1102          | 0.9751   |
+| No log        | 5.0   | 265  | 0.1450          | 0.9644   |
+| No log        | 6.0   | 318  | 0.1223          | 0.9715   |
+| No log        | 7.0   | 371  | 0.1434          | 0.9680   |
+| No log        | 8.0   | 424  | 0.1400          | 0.9680   |
+| No log        | 9.0   | 477  | 0.1349          | 0.9715   |
+| 0.1523        | 10.0  | 530  | 0.1370          | 0.9715   |
+| 0.1523        | 11.0  | 583  | 0.1376          | 0.9715   |
+| 0.1523        | 12.0  | 636  | 0.1385          | 0.9715   |
+| 0.1523        | 13.0  | 689  | 0.1392          | 0.9715   |
+| 0.1523        | 14.0  | 742  | 0.1399          | 0.9715   |
+| 0.1523        | 15.0  | 795  | 0.1395          | 0.9715   |
+| 0.1523        | 16.0  | 848  | 0.1402          | 0.9715   |
+| 0.1523        | 17.0  | 901  | 0.1462          | 0.9680   |
+| 0.1523        | 18.0  | 954  | 0.1533          | 0.9680   |
+| 0.0492        | 19.0  | 1007 | 0.1472          | 0.9680   |
+| 0.0492        | 20.0  | 1060 | 0.1452          | 0.9680   |
 
 
 ### Framework versions