LennyBijan commited on
Commit
362dcb4
·
verified ·
1 Parent(s): ad33065

Model save

Browse files
README.md CHANGED
@@ -1,10 +1,8 @@
1
  ---
2
  license: apache-2.0
 
3
  tags:
4
  - generated_from_trainer
5
- base_model: openai/whisper-large-v2
6
- metrics:
7
- - wer
8
  model-index:
9
  - name: BA_Model_V3
10
  results: []
@@ -16,10 +14,6 @@ should probably proofread and complete it, then remove this comment. -->
16
  # BA_Model_V3
17
 
18
  This model is a fine-tuned version of [openai/whisper-large-v2](https://huggingface.co/openai/whisper-large-v2) on an unknown dataset.
19
- It achieves the following results on the evaluation set:
20
- - Loss: 0.4521
21
- - Wer: 22.8402
22
- - Cer: 12.5097
23
 
24
  ## Model description
25
 
@@ -38,35 +32,21 @@ More information needed
38
  ### Training hyperparameters
39
 
40
  The following hyperparameters were used during training:
41
- - learning_rate: 1.5e-05
42
  - train_batch_size: 8
43
  - eval_batch_size: 8
44
  - seed: 42
45
  - gradient_accumulation_steps: 2
46
  - total_train_batch_size: 16
47
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
48
- - lr_scheduler_type: linear
49
  - lr_scheduler_warmup_ratio: 0.05
50
  - num_epochs: 8
51
  - mixed_precision_training: Native AMP
52
 
53
- ### Training results
54
-
55
- | Training Loss | Epoch | Step | Validation Loss | Wer | Cer |
56
- |:-------------:|:-----:|:----:|:---------------:|:-------:|:-------:|
57
- | 0.3437 | 1.0 | 278 | 0.3292 | 23.6377 | 13.0135 |
58
- | 0.1749 | 2.0 | 556 | 0.3337 | 22.6309 | 12.1392 |
59
- | 0.0823 | 3.0 | 834 | 0.3635 | 23.1891 | 12.9637 |
60
- | 0.0397 | 4.0 | 1112 | 0.3959 | 23.1559 | 12.5382 |
61
- | 0.0202 | 5.0 | 1390 | 0.4146 | 24.8771 | 13.9211 |
62
- | 0.0097 | 6.0 | 1668 | 0.4196 | 22.1192 | 12.0233 |
63
- | 0.0038 | 7.0 | 1946 | 0.4424 | 22.2455 | 12.3308 |
64
- | 0.0018 | 8.0 | 2224 | 0.4521 | 22.8402 | 12.5097 |
65
-
66
-
67
  ### Framework versions
68
 
69
- - Transformers 4.38.1
70
  - Pytorch 2.2.1+cu121
71
- - Datasets 2.17.2.dev0
72
  - Tokenizers 0.15.2
 
1
  ---
2
  license: apache-2.0
3
+ base_model: openai/whisper-large-v2
4
  tags:
5
  - generated_from_trainer
 
 
 
6
  model-index:
7
  - name: BA_Model_V3
8
  results: []
 
14
  # BA_Model_V3
15
 
16
  This model is a fine-tuned version of [openai/whisper-large-v2](https://huggingface.co/openai/whisper-large-v2) on an unknown dataset.
 
 
 
 
17
 
18
  ## Model description
19
 
 
32
  ### Training hyperparameters
33
 
34
  The following hyperparameters were used during training:
35
+ - learning_rate: 5e-06
36
  - train_batch_size: 8
37
  - eval_batch_size: 8
38
  - seed: 42
39
  - gradient_accumulation_steps: 2
40
  - total_train_batch_size: 16
41
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
+ - lr_scheduler_type: cosine
43
  - lr_scheduler_warmup_ratio: 0.05
44
  - num_epochs: 8
45
  - mixed_precision_training: Native AMP
46
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
47
  ### Framework versions
48
 
49
+ - Transformers 4.38.2
50
  - Pytorch 2.2.1+cu121
51
+ - Datasets 2.18.0
52
  - Tokenizers 0.15.2
config.json CHANGED
@@ -45,8 +45,8 @@
45
  "scale_embedding": false,
46
  "suppress_tokens": [],
47
  "torch_dtype": "float32",
48
- "transformers_version": "4.38.1",
49
- "use_cache": true,
50
  "use_weighted_layer_sum": false,
51
  "vocab_size": 51865
52
  }
 
45
  "scale_embedding": false,
46
  "suppress_tokens": [],
47
  "torch_dtype": "float32",
48
+ "transformers_version": "4.38.2",
49
+ "use_cache": false,
50
  "use_weighted_layer_sum": false,
51
  "vocab_size": 51865
52
  }
generation_config.json CHANGED
@@ -313,5 +313,5 @@
313
  "transcribe": 50359,
314
  "translate": 50358
315
  },
316
- "transformers_version": "4.38.1"
317
  }
 
313
  "transcribe": 50359,
314
  "translate": 50358
315
  },
316
+ "transformers_version": "4.38.2"
317
  }
model-00001-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:2e2fb7baa2247bb382d1c718bb9af5861bdb30f856fa17786ea090a7cd1dd71e
3
  size 4992706480
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:fbf62b6fad08b53a4c4f3f2501c914d54545041d83bf4ae9fcc303d2df4e58c5
3
  size 4992706480
model-00002-of-00002.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:613fe399bd020824967306096f1cf5452953ed84131f9dcbac61fb581d8a8bb4
3
  size 1180663192
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:f7e9190c13606f587e424346e247126eeeaa77d6edecb74f29dbe52b2e521fca
3
  size 1180663192
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:4adc7162078682c4051827cd4b01c41268f8295667f1a3dcebce25da8326b7fa
3
  size 5048
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:1f0c9782730544f872b0be94d347a79be93802c9a31acfd3dbfb4675eb2f981e
3
  size 5048