MKaan commited on
Commit
5223ab4
1 Parent(s): 7998f6b

Create README.md

Browse files
Files changed (1) hide show
  1. README.md +40 -0
README.md ADDED
@@ -0,0 +1,40 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ license: apache-2.0
3
+ tags:
4
+ - eu
5
+ - public procurement
6
+ - cpv
7
+ - sector
8
+ - multilingual
9
+ widget:
10
+ - text: "This is a sample public procurement description text."
11
+ ---
12
+
13
+ # multilingual-cpv-sector-classifier
14
+ This model is a fine-tuned version of [bert-base-multilingual-cased](https://huggingface.co/bert-base-multilingual-cased) on the Tenders Economic Daily Public Procurement Data.
15
+ It achieves the following results on the evaluation set:
16
+ - Loss: 0.1574
17
+ - F1 Score: 0.686
18
+
19
+ ## Model description
20
+ More information needed
21
+ ## Intended uses & limitations
22
+ More information needed
23
+ ## Training and evaluation data
24
+ More information needed
25
+ ## Training procedure
26
+
27
+ ### Training hyperparameters
28
+ The following hyperparameters were used during training:
29
+ - learning_rate: 2e-05
30
+ - num_epochs: 3
31
+ - gradient_accumulation_steps: 8
32
+ - batch_size_per_device: 4
33
+ - total_train_batch_size: 32
34
+
35
+ ### Training results
36
+ | Epoch | Step | Validation Loss | Accuracy |
37
+ |:-----:|:------:|:---------------:|:--------:|
38
+ | 1.0 | 18,609 | 0.2172 | 0.630 |
39
+ | 2.0 | 37,218 | 0.0092 | 0.674 |
40
+ | 3.0 | 55,827 | 0.1574 | 0.686 |