|
--- |
|
license: apache-2.0 |
|
tags: |
|
- eu |
|
- public procurement |
|
- cpv |
|
- sector |
|
- multilingual |
|
widget: |
|
- text: "Oppegård municipality, hereafter called the contracting authority, intends to enter into a framework agreement with one supplier for the procurement of fresh bread and bakery products for Oppegård municipality. The contract is estimated to NOK 1 400 000 per annum excluding VAT The total for the entire period including options is NOK 5 600 000 excluding VAT" |
|
--- |
|
|
|
# multilingual-cpv-sector-classifier |
|
This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on the Tenders Economic Daily Public Procurement Data. |
|
It achieves the following results on the evaluation set: |
|
- Loss: 0.1574 |
|
- F1 Score: 0.686 |
|
|
|
## Model description |
|
More information needed |
|
## Intended uses & limitations |
|
More information needed |
|
## Training and evaluation data |
|
More information needed |
|
## Training procedure |
|
|
|
### Training hyperparameters |
|
The following hyperparameters were used during training: |
|
- learning_rate: 2e-05 |
|
- num_epochs: 3 |
|
- gradient_accumulation_steps: 8 |
|
- batch_size_per_device: 4 |
|
- total_train_batch_size: 32 |
|
|
|
### Training results |
|
| Epoch | Step | Validation Loss | Accuracy | |
|
|:-----:|:------:|:---------------:|:--------:| |
|
| 1.0 | 18,609 | 0.2172 | 0.630 | |
|
| 2.0 | 37,218 | 0.0092 | 0.674 | |
|
| 3.0 | 55,827 | 0.1574 | 0.686 | |
|
|
|
| Language| F1 Score| Test Size| |
|
|:-------------:|:-------------:|:-------------:| |
|
| PL| 0.759| 13950| |
|
| RO| 0.736| 3522| |
|
| SK| 0.719| 1122| |
|
| LT| 0.687| 2424| |
|
| HU| 0.681| 1879| |
|
| BG| 0.675| 2459| |
|
| CS| 0.668| 2694| |
|
| LV| 0.664| 836| |
|
| DE| 0.645| 35354| |
|
| FI| 0.644| 1898| |
|
| ES| 0.643| 7483| |
|
| PT| 0.631| 874| |
|
| EN| 0.631| 16615| |
|
| HR| 0.626| 865| |
|
| IT| 0.626| 8035| |
|
| NL| 0.624| 5640| |
|
| EL| 0.623| 1724| |
|
| SL| 0.615| 482| |
|
| SV| 0.607| 3326| |
|
| DA| 0.603| 1925| |
|
| FR| 0.601| 33113| |
|
| ET| 0.572| 458|| |
|
|
|
|
