Model description:
Model: bert-base-multilingual-cased
Dataset: TASTEset
Unshuffled ratio: ['0']
Shuffled ratio: ['1']
Best exact match epoch: 9
Best exact match: 89.29
Best epoch: 9
Drop duplicates: ['1']
Max epochs = 10
Optimizer lr = 3e-05
Optimizer eps = 1e-08
Batch size = 32
Dataset path = pgajo/EW-TT-PE_U0_S1_Tingredient_P0.75_DROP1_mbert
Results
epoch | train_loss | train_f1 | train_exact | dev_loss | dev_f1 | dev_exact | test_loss | test_f1 | test_exact |
---|---|---|---|---|---|---|---|---|---|
1 | 3.23 | 10.64 | 2.55 | 2.56 | 18.12 | 8.52 | 0 | 0 | 0 |
2 | 1.2 | 59 | 48.62 | 0.59 | 83.96 | 75.27 | 0 | 0 | 0 |
3 | 0.37 | 88.86 | 83.61 | 0.46 | 91.16 | 85.16 | 0 | 0 | 0 |
4 | 0.17 | 94.22 | 91.18 | 0.48 | 90.52 | 85.44 | 0 | 0 | 0 |
5 | 0.09 | 97.37 | 95.8 | 0.5 | 89.31 | 83.79 | 0 | 0 | 0 |
6 | 0.06 | 98.07 | 96.76 | 0.47 | 91.89 | 89.01 | 0 | 0 | 0 |
7 | 0.04 | 98.67 | 97.59 | 0.53 | 92.25 | 87.36 | 0 | 0 | 0 |
8 | 0.04 | 98.93 | 97.93 | 0.48 | 92.88 | 89.01 | 0 | 0 | 0 |
9 | 0.03 | 99.31 | 98.9 | 0.51 | 93.68 | 89.29 | 0 | 0 | 0 |
10 | 0.01 | 99.57 | 99.24 | 0.5 | 94.13 | 89.29 | 0 | 0 | 0 |
- Downloads last month
- 10
This model does not have enough activity to be deployed to Inference API (serverless) yet. Increase its social
visibility and check back later, or deploy to Inference Endpoints (dedicated)
instead.