maulairfani commited on
Commit
40ddb3e
1 Parent(s): 3233840

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +1 -59
README.md CHANGED
@@ -1,59 +1 @@
1
- ---
2
- license: mit
3
- base_model: indobenchmark/indobert-large-p2
4
- tags:
5
- - generated_from_trainer
6
- model-index:
7
- - name: Indonesian-LegalBERT-lite
8
- results: []
9
- ---
10
-
11
- <!-- This model card has been generated automatically according to the information the Trainer had access to. You
12
- should probably proofread and complete it, then remove this comment. -->
13
-
14
- # Indonesian-LegalBERT-lite
15
-
16
- This model is a fine-tuned version of [indobenchmark/indobert-large-p2](https://huggingface.co/indobenchmark/indobert-large-p2) on an unknown dataset.
17
- It achieves the following results on the evaluation set:
18
- - Loss: 1.0589
19
-
20
- ## Model description
21
-
22
- More information needed
23
-
24
- ## Intended uses & limitations
25
-
26
- More information needed
27
-
28
- ## Training and evaluation data
29
-
30
- More information needed
31
-
32
- ## Training procedure
33
-
34
- ### Training hyperparameters
35
-
36
- The following hyperparameters were used during training:
37
- - learning_rate: 2e-05
38
- - train_batch_size: 128
39
- - eval_batch_size: 128
40
- - seed: 42
41
- - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
42
- - lr_scheduler_type: linear
43
- - num_epochs: 3
44
-
45
- ### Training results
46
-
47
- | Training Loss | Epoch | Step | Validation Loss |
48
- |:-------------:|:-----:|:----:|:---------------:|
49
- | 1.8363 | 1.0 | 2870 | 1.1978 |
50
- | 1.2286 | 2.0 | 5740 | 1.0848 |
51
- | 1.1488 | 3.0 | 8610 | 1.0526 |
52
-
53
-
54
- ### Framework versions
55
-
56
- - Transformers 4.31.0
57
- - Pytorch 2.0.1+cu118
58
- - Datasets 2.14.0
59
- - Tokenizers 0.13.3
 
1
+ No description yet.