metadata
license: apache-2.0
tags:
- eu
- public procurement
- cpv
- sector
- multilingual
widget:
- text: >-
Oppegård municipality, hereafter called the contracting authority, intends
to enter into a framework agreement with one supplier for the procurement
of fresh bread and bakery products for Oppegård municipality. The
contract is estimated to NOK 1 400 000 per annum excluding VAT The total
for the entire period including options is NOK 5 600 000 excluding VAT
multilingual-cpv-sector-classifier
This model is a fine-tuned version of bert-base-multilingual-cased on the Tenders Economic Daily Public Procurement Data. It achieves the following results on the evaluation set:
- Loss: 0.1574
- F1 Score: 0.686
Model description
More information needed
Intended uses & limitations
More information needed
Training and evaluation data
More information needed
Training procedure
Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- num_epochs: 3
- gradient_accumulation_steps: 8
- batch_size_per_device: 4
- total_train_batch_size: 32
Training results
| Epoch | Step | Validation Loss | Accuracy |
|---|---|---|---|
| 1.0 | 18,609 | 0.2172 | 0.630 |
| 2.0 | 37,218 | 0.0092 | 0.674 |
| 3.0 | 55,827 | 0.1574 | 0.686 |
| Language | F1 Score | Test Size |
|---|---|---|
| PL | 0.759 | 13950 |
| RO | 0.736 | 3522 |
| SK | 0.719 | 1122 |
| LT | 0.687 | 2424 |
| HU | 0.681 | 1879 |
| BG | 0.675 | 2459 |
| CS | 0.668 | 2694 |
| LV | 0.664 | 836 |
| DE | 0.645 | 35354 |
| FI | 0.644 | 1898 |
| ES | 0.643 | 7483 |
| PT | 0.631 | 874 |
| EN | 0.631 | 16615 |
| HR | 0.626 | 865 |
| IT | 0.626 | 8035 |
| NL | 0.624 | 5640 |
| EL | 0.623 | 1724 |
| SL | 0.615 | 482 |
| SV | 0.607 | 3326 |
| DA | 0.603 | 1925 |
| FR | 0.601 | 33113 |
| ET | 0.572 | 458 |