Hugging Face's logo

nickmuchi
/
finbert-tone-finetuned-fintwitter-classification

Text Classification
Transformers
PyTorch
TensorBoard
Safetensors
bert
Generated from Trainer
financial-tweets-sentiment-analysis
sentiment-analysis
financial
stocks
sentiment
Eval Results
Inference Endpoints
Model card Files Metrics Community
3
nickmuchi commited on
Commit
e845cd9
•
1 Parent(s): c8ed10a

update model card README.md

Browse files
Files changed (1) hide show
  1. README.md +84 -0
README.md ADDED
@@ -0,0 +1,84 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ tags:
3
+ - generated_from_trainer
4
+ metrics:
5
+ - accuracy
6
+ - f1
7
+ - precision
8
+ - recall
9
+ model-index:
10
+ - name: finbert-tone-finetuned-fintwitter-classification
11
+ results: []
12
+ ---
13
+
14
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
15
+ should probably proofread and complete it, then remove this comment. -->
16
+
17
+ # finbert-tone-finetuned-fintwitter-classification
18
+
19
+ This model is a fine-tuned version of [yiyanghkust/finbert-tone](https://huggingface.co/yiyanghkust/finbert-tone) on an unknown dataset.
20
+ It achieves the following results on the evaluation set:
21
+ - Loss: 1.4236
22
+ - Accuracy: 0.8823
23
+ - F1: 0.8823
24
+ - Precision: 0.8825
25
+ - Recall: 0.8823
26
+
27
+ ## Model description
28
+
29
+ More information needed
30
+
31
+ ## Intended uses & limitations
32
+
33
+ More information needed
34
+
35
+ ## Training and evaluation data
36
+
37
+ More information needed
38
+
39
+ ## Training procedure
40
+
41
+ ### Training hyperparameters
42
+
43
+ The following hyperparameters were used during training:
44
+ - learning_rate: 2e-05
45
+ - train_batch_size: 16
46
+ - eval_batch_size: 16
47
+ - seed: 42
48
+ - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
49
+ - lr_scheduler_type: linear
50
+ - num_epochs: 20
51
+ - mixed_precision_training: Native AMP
52
+
53
+ ### Training results
54
+
55
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
56
+ |:-------------:|:-----:|:-----:|:---------------:|:--------:|:------:|:---------:|:------:|
57
+ | 0.6385 | 1.0 | 597 | 0.3688 | 0.8668 | 0.8693 | 0.8744 | 0.8668 |
58
+ | 0.3044 | 2.0 | 1194 | 0.3994 | 0.8744 | 0.8726 | 0.8739 | 0.8744 |
59
+ | 0.1833 | 3.0 | 1791 | 0.6212 | 0.8781 | 0.8764 | 0.8762 | 0.8781 |
60
+ | 0.1189 | 4.0 | 2388 | 0.8370 | 0.8740 | 0.8743 | 0.8748 | 0.8740 |
61
+ | 0.0759 | 5.0 | 2985 | 0.9107 | 0.8807 | 0.8798 | 0.8796 | 0.8807 |
62
+ | 0.0291 | 6.0 | 3582 | 0.9711 | 0.8836 | 0.8825 | 0.8821 | 0.8836 |
63
+ | 0.0314 | 7.0 | 4179 | 1.1305 | 0.8819 | 0.8811 | 0.8812 | 0.8819 |
64
+ | 0.0217 | 8.0 | 4776 | 1.0190 | 0.8811 | 0.8813 | 0.8816 | 0.8811 |
65
+ | 0.0227 | 9.0 | 5373 | 1.1940 | 0.8844 | 0.8832 | 0.8838 | 0.8844 |
66
+ | 0.0156 | 10.0 | 5970 | 1.2595 | 0.8752 | 0.8768 | 0.8801 | 0.8752 |
67
+ | 0.0135 | 11.0 | 6567 | 1.1931 | 0.8760 | 0.8768 | 0.8780 | 0.8760 |
68
+ | 0.009 | 12.0 | 7164 | 1.2154 | 0.8857 | 0.8852 | 0.8848 | 0.8857 |
69
+ | 0.0058 | 13.0 | 7761 | 1.3874 | 0.8748 | 0.8759 | 0.8776 | 0.8748 |
70
+ | 0.009 | 14.0 | 8358 | 1.4193 | 0.8740 | 0.8754 | 0.8780 | 0.8740 |
71
+ | 0.0042 | 15.0 | 8955 | 1.2999 | 0.8807 | 0.8800 | 0.8796 | 0.8807 |
72
+ | 0.0028 | 16.0 | 9552 | 1.3428 | 0.8802 | 0.8805 | 0.8817 | 0.8802 |
73
+ | 0.0029 | 17.0 | 10149 | 1.3959 | 0.8807 | 0.8807 | 0.8810 | 0.8807 |
74
+ | 0.0022 | 18.0 | 10746 | 1.4149 | 0.8827 | 0.8823 | 0.8824 | 0.8827 |
75
+ | 0.0037 | 19.0 | 11343 | 1.4078 | 0.8840 | 0.8838 | 0.8838 | 0.8840 |
76
+ | 0.001 | 20.0 | 11940 | 1.4236 | 0.8823 | 0.8823 | 0.8825 | 0.8823 |
77
+
78
+
79
+ ### Framework versions
80
+
81
+ - Transformers 4.25.1
82
+ - Pytorch 1.13.0+cu116
83
+ - Datasets 2.8.0
84
+ - Tokenizers 0.13.2