Yousefmd commited on
Commit
dc1d8c2
1 Parent(s): 5ef40da

Model save

Browse files
Files changed (2) hide show
  1. README.md +6 -6
  2. config.json +8 -8
README.md CHANGED
@@ -16,9 +16,9 @@ should probably proofread and complete it, then remove this comment. -->
16
 
17
  This model is a fine-tuned version of [aubmindlab/bert-large-arabertv2](https://huggingface.co/aubmindlab/bert-large-arabertv2) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
- - Loss: 0.6083
20
- - Macro F1: 0.6233
21
- - Accuracy: 0.7756
22
 
23
  ## Model description
24
 
@@ -40,7 +40,7 @@ The following hyperparameters were used during training:
40
  - learning_rate: 2e-05
41
  - train_batch_size: 16
42
  - eval_batch_size: 128
43
- - seed: 25
44
  - gradient_accumulation_steps: 2
45
  - total_train_batch_size: 32
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
@@ -51,8 +51,8 @@ The following hyperparameters were used during training:
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Macro F1 | Accuracy |
53
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
54
- | No log | 1.0 | 491 | 0.6442 | 0.5825 | 0.7603 |
55
- | 0.8094 | 2.0 | 982 | 0.6083 | 0.6233 | 0.7756 |
56
 
57
 
58
  ### Framework versions
 
16
 
17
  This model is a fine-tuned version of [aubmindlab/bert-large-arabertv2](https://huggingface.co/aubmindlab/bert-large-arabertv2) on an unknown dataset.
18
  It achieves the following results on the evaluation set:
19
+ - Loss: 0.5849
20
+ - Macro F1: 0.6310
21
+ - Accuracy: 0.7822
22
 
23
  ## Model description
24
 
 
40
  - learning_rate: 2e-05
41
  - train_batch_size: 16
42
  - eval_batch_size: 128
43
+ - seed: 42
44
  - gradient_accumulation_steps: 2
45
  - total_train_batch_size: 32
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss | Macro F1 | Accuracy |
53
  |:-------------:|:-----:|:----:|:---------------:|:--------:|:--------:|
54
+ | No log | 1.0 | 497 | 0.6328 | 0.5838 | 0.7719 |
55
+ | 0.7505 | 2.0 | 994 | 0.5849 | 0.6310 | 0.7822 |
56
 
57
 
58
  ### Framework versions
config.json CHANGED
@@ -9,18 +9,18 @@
9
  "hidden_dropout_prob": 0.1,
10
  "hidden_size": 1024,
11
  "id2label": {
12
- "0": "LABEL_0",
13
- "1": "LABEL_1",
14
- "2": "LABEL_2",
15
- "3": "LABEL_3"
16
  },
17
  "initializer_range": 0.02,
18
  "intermediate_size": 4096,
19
  "label2id": {
20
- "LABEL_0": 0,
21
- "LABEL_1": 1,
22
- "LABEL_2": 2,
23
- "LABEL_3": 3
24
  },
25
  "layer_norm_eps": 1e-12,
26
  "max_position_embeddings": 512,
 
9
  "hidden_dropout_prob": 0.1,
10
  "hidden_size": 1024,
11
  "id2label": {
12
+ "0": "Positive",
13
+ "1": "Negative",
14
+ "2": "Neutral",
15
+ "3": "Mixed"
16
  },
17
  "initializer_range": 0.02,
18
  "intermediate_size": 4096,
19
  "label2id": {
20
+ "Mixed": 3,
21
+ "Negative": 1,
22
+ "Neutral": 2,
23
+ "Positive": 0
24
  },
25
  "layer_norm_eps": 1e-12,
26
  "max_position_embeddings": 512,