torchstack commited on
Commit
bc3946f
·
verified ·
1 Parent(s): 6c5cc5d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +11 -5
README.md CHANGED
@@ -8,6 +8,10 @@ metrics:
8
  model-index:
9
  - name: hf-bert-finetuning
10
  results: []
 
 
 
 
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
@@ -15,25 +19,27 @@ should probably proofread and complete it, then remove this comment. -->
15
 
16
  # hf-bert-finetuning
17
 
18
- This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on an unknown dataset.
19
  It achieves the following results on the evaluation set:
20
  - Loss: 2.2672
21
  - Accuracy: 0.805
22
 
23
  ## Model description
24
 
25
- More information needed
26
 
27
  ## Intended uses & limitations
28
 
29
- More information needed
30
 
31
  ## Training and evaluation data
32
 
33
- More information needed
34
 
35
  ## Training procedure
36
 
 
 
37
  ### Training hyperparameters
38
 
39
  The following hyperparameters were used during training:
@@ -81,4 +87,4 @@ The following hyperparameters were used during training:
81
  - Transformers 4.40.1
82
  - Pytorch 2.3.0
83
  - Datasets 2.19.0
84
- - Tokenizers 0.19.1
 
8
  model-index:
9
  - name: hf-bert-finetuning
10
  results: []
11
+ datasets:
12
+ - zeroshot/twitter-financial-news-sentiment
13
+ language:
14
+ - en
15
  ---
16
 
17
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
 
19
 
20
  # hf-bert-finetuning
21
 
22
+ This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on the [twitter-financial-news-sentiment](https://huggingface.co/datasets/zeroshot/twitter-financial-news-sentiment) dataset.
23
  It achieves the following results on the evaluation set:
24
  - Loss: 2.2672
25
  - Accuracy: 0.805
26
 
27
  ## Model description
28
 
29
+ The base model is [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased). It was fine-tuned to perform ternary classification (bullish/neutral/bearish) on financial tweets.
30
 
31
  ## Intended uses & limitations
32
 
33
+ This model is intended to be used for demonstrating how to fine-tune a BERT model using the HuggingFace API. The outputs from the model are not meant to be used in a real production use-case (e.g. to classify whether a tweet is bearish or bullish).
34
 
35
  ## Training and evaluation data
36
 
37
+ The training and evaluation dataset were taken from the [twitter-financial-news-sentiment](https://huggingface.co/datasets/zeroshot/twitter-financial-news-sentiment) dataset on HuggingFace.
38
 
39
  ## Training procedure
40
 
41
+ 100 training and evaluation examples were randomly sampled from the dataset. This was used to train the BERT model for 100 epochs.
42
+
43
  ### Training hyperparameters
44
 
45
  The following hyperparameters were used during training:
 
87
  - Transformers 4.40.1
88
  - Pytorch 2.3.0
89
  - Datasets 2.19.0
90
+ - Tokenizers 0.19.1