---
license: apache-2.0
tags:
- eu
- public procurement
- cpv
- sector
- multilingual
widget:
- text: "This is a sample public procurement description text."
---

# multilingual-cpv-sector-classifier
This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on the Tenders Economic Daily Public Procurement Data.
It achieves the following results on the evaluation set:
- Loss: 0.1574
- F1 Score: 0.686

## Model description
More information needed
## Intended uses & limitations
More information needed
## Training and evaluation data
More information needed
## Training procedure

### Training hyperparameters
The following hyperparameters were used during training:
- learning_rate: 2e-05
- num_epochs: 3
- gradient_accumulation_steps: 8
- batch_size_per_device: 4
- total_train_batch_size: 32

### Training results
| Epoch |  Step  | Validation Loss | Accuracy |
|:-----:|:------:|:---------------:|:--------:|
| 1.0   | 18,609 | 0.2172          | 0.630    |
| 2.0   | 37,218 | 0.0092          | 0.674    |
| 3.0   | 55,827 | 0.1574          | 0.686    |