vnktrmnb commited on
Commit
b9c369a
1 Parent(s): 9c1cd74

Training in progress epoch 0

Browse files
README.md CHANGED
@@ -15,12 +15,12 @@ probably proofread and complete it, then remove this comment. -->
15
 
16
  This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
- - Train Loss: 1.4728
19
- - Train End Logits Accuracy: 0.6358
20
- - Train Start Logits Accuracy: 0.6745
21
- - Validation Loss: 0.5634
22
- - Validation End Logits Accuracy: 0.8067
23
- - Validation Start Logits Accuracy: 0.8802
24
  - Epoch: 0
25
 
26
  ## Model description
@@ -40,19 +40,19 @@ More information needed
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
- - optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 453, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
44
  - training_precision: float32
45
 
46
  ### Training results
47
 
48
  | Train Loss | Train End Logits Accuracy | Train Start Logits Accuracy | Validation Loss | Validation End Logits Accuracy | Validation Start Logits Accuracy | Epoch |
49
  |:----------:|:-------------------------:|:---------------------------:|:---------------:|:------------------------------:|:--------------------------------:|:-----:|
50
- | 1.4728 | 0.6358 | 0.6745 | 0.5634 | 0.8067 | 0.8802 | 0 |
51
 
52
 
53
  ### Framework versions
54
 
55
  - Transformers 4.31.0
56
  - TensorFlow 2.12.0
57
- - Datasets 2.13.1
58
  - Tokenizers 0.13.3
 
15
 
16
  This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Train Loss: 1.4894
19
+ - Train End Logits Accuracy: 0.6342
20
+ - Train Start Logits Accuracy: 0.6715
21
+ - Validation Loss: 0.5434
22
+ - Validation End Logits Accuracy: 0.8209
23
+ - Validation Start Logits Accuracy: 0.8737
24
  - Epoch: 0
25
 
26
  ## Model description
 
40
  ### Training hyperparameters
41
 
42
  The following hyperparameters were used during training:
43
+ - optimizer: {'name': 'Adam', 'weight_decay': None, 'clipnorm': None, 'global_clipnorm': None, 'clipvalue': None, 'use_ema': False, 'ema_momentum': 0.99, 'ema_overwrite_frequency': None, 'jit_compile': True, 'is_legacy_optimizer': False, 'learning_rate': {'class_name': 'PolynomialDecay', 'config': {'initial_learning_rate': 2e-05, 'decay_steps': 906, 'end_learning_rate': 0.0, 'power': 1.0, 'cycle': False, 'name': None}}, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-08, 'amsgrad': False}
44
  - training_precision: float32
45
 
46
  ### Training results
47
 
48
  | Train Loss | Train End Logits Accuracy | Train Start Logits Accuracy | Validation Loss | Validation End Logits Accuracy | Validation Start Logits Accuracy | Epoch |
49
  |:----------:|:-------------------------:|:---------------------------:|:---------------:|:------------------------------:|:--------------------------------:|:-----:|
50
+ | 1.4894 | 0.6342 | 0.6715 | 0.5434 | 0.8209 | 0.8737 | 0 |
51
 
52
 
53
  ### Framework versions
54
 
55
  - Transformers 4.31.0
56
  - TensorFlow 2.12.0
57
+ - Datasets 2.14.4
58
  - Tokenizers 0.13.3
tf_model.h5 CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:188dd7327bb976516f59cd040599c9fdab2c4ae8b47cab9aa06a3682243ffd2f
3
  size 709326800
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7b519147ee389bf3a3f46e9f379d69203d2df42d707233e822c759305b5308f8
3
  size 709326800
train/events.out.tfevents.1691829138.ea91cf0ddd35.227.0.v2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:7cd3d1e295ff812f8acf23003ba5c4b49105f3089ad438fc6a8b2362b6585eb7
3
+ size 2645337
validation/events.out.tfevents.1691829748.ea91cf0ddd35.227.1.v2 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9f9a3caac6214206c068cd2576b94080fbf88b1d923aa10276c1bd7bf7804aeb
3
+ size 604