|
--- |
|
license: apache-2.0 |
|
tags: |
|
- eu |
|
- public procurement |
|
- cpv |
|
- sector |
|
- multilingual |
|
widget: |
|
- text: "This is a sample public procurement description text." |
|
--- |
|
|
|
# multilingual-cpv-sector-classifier |
|
This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on the Tenders Economic Daily Public Procurement Data. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.1574 |
|
- F1 Score: 0.686 |
|
|
|
## Model description |
|
More information needed |
|
## Intended uses & limitations |
|
More information needed |
|
## Training and evaluation data |
|
More information needed |
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
The following hyperparameters were used during training: |
|
- learning_rate: 2e-05 |
|
- num_epochs: 3 |
|
- gradient_accumulation_steps: 8 |
|
- batch_size_per_device: 4 |
|
- total_train_batch_size: 32 |
|
|
|
### Training results |
|
| Epoch | Step | Validation Loss | Accuracy | |
|
|:-----:|:------:|:---------------:|:--------:| |
|
| 1.0 | 18,609 | 0.2172 | 0.630 | |
|
| 2.0 | 37,218 | 0.0092 | 0.674 | |
|
| 3.0 | 55,827 | 0.1574 | 0.686 | |
|
|
