Hugging Face's logo

CocoRoF
/
KoModernBERT-base-mlm-v04-retry-model-chp12

Fill-Mask
Transformers
Safetensors
modernbert
Generated from Trainer
Inference Endpoints
Model card Files Community
CocoRoF commited on
Commit
3e4d53e
·
verified ·
1 Parent(s): 8d4e96d

new_try Done

Browse files
Files changed (2) hide show
  1. README.md +7 -14
  2. model.safetensors +1 -1
README.md CHANGED
@@ -1,23 +1,21 @@
1
  ---
2
  library_name: transformers
3
- base_model: CocoRoF/KoModernBERT-base-mlm-v04-retry-model-chp10
4
  tags:
5
  - generated_from_trainer
6
- datasets:
7
- - miracl-corpus
8
  model-index:
9
- - name: KoModernBERT-base-mlm-v04-retry-model-chp11
10
  results: []
11
  ---
12
 
13
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
14
  should probably proofread and complete it, then remove this comment. -->
15
 
16
- # KoModernBERT-base-mlm-v04-retry-model-chp11
17
 
18
- This model is a fine-tuned version of [CocoRoF/KoModernBERT-base-mlm-v04-retry-model-chp10](https://huggingface.co/CocoRoF/KoModernBERT-base-mlm-v04-retry-model-chp10) on the miracl-corpus dataset.
19
  It achieves the following results on the evaluation set:
20
- - Loss: 1.6514
21
 
22
  ## Model description
23
 
@@ -53,13 +51,8 @@ The following hyperparameters were used during training:
53
 
54
  | Training Loss | Epoch | Step | Validation Loss |
55
  |:-------------:|:------:|:----:|:---------------:|
56
- | 112.1792 | 0.1413 | 100 | 1.7653 |
57
- | 110.9146 | 0.2826 | 200 | 1.7264 |
58
- | 109.9796 | 0.4239 | 300 | 1.7024 |
59
- | 107.8193 | 0.5651 | 400 | 1.6842 |
60
- | 106.8794 | 0.7064 | 500 | 1.6747 |
61
- | 106.3015 | 0.8477 | 600 | 1.6712 |
62
- | 106.583 | 0.9890 | 700 | 1.6514 |
63
 
64
 
65
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
+ base_model: CocoRoF/KoModernBERT-base-mlm-v04-retry-model-chp11
4
  tags:
5
  - generated_from_trainer
 
 
6
  model-index:
7
+ - name: KoModernBERT-base-mlm-v04-retry-model-chp12
8
  results: []
9
  ---
10
 
11
  <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
  should probably proofread and complete it, then remove this comment. -->
13
 
14
+ # KoModernBERT-base-mlm-v04-retry-model-chp12
15
 
16
+ This model is a fine-tuned version of [CocoRoF/KoModernBERT-base-mlm-v04-retry-model-chp11](https://huggingface.co/CocoRoF/KoModernBERT-base-mlm-v04-retry-model-chp11) on an unknown dataset.
17
  It achieves the following results on the evaluation set:
18
+ - Loss: 1.3515
19
 
20
  ## Model description
21
 
 
51
 
52
  | Training Loss | Epoch | Step | Validation Loss |
53
  |:-------------:|:------:|:----:|:---------------:|
54
+ | 89.2271 | 0.4672 | 2000 | 1.3848 |
55
+ | 86.415 | 0.9344 | 4000 | 1.3515 |
 
 
 
 
 
56
 
57
 
58
  ### Framework versions
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:062f7ceb18e2b2e72f6b7c8405ecb67263d54f0d4feb0f5eac0e684ec2f23971
3
  size 368988278
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:517491d8759942f27beaaca2325a4b97a206a4bc50d01b37f43e9dbfa7a419a1
3
  size 368988278