elihoole commited on
Commit
57798c2
·
verified ·
1 Parent(s): 60e7aba

Model save

Browse files
Files changed (2) hide show
  1. README.md +52 -26
  2. tokenizer.json +2 -16
README.md CHANGED
@@ -1,45 +1,71 @@
1
-
2
  ---
3
- language: en
4
- license: mit
5
- datasets:
6
- - your_dataset_name
7
  tags:
8
- - text-classification
9
- - bert
10
- - query-classification
11
  metrics:
12
- - accuracy: 0.9789272030651341
13
- - f1: 0.9789776553861008
 
 
 
 
 
14
  ---
15
 
16
- # BERT Fine-tuned for Query Classification
 
 
 
17
 
18
- This model is a fine-tuned version of [bert-base-uncased](https://huggingface.co/answerdotai/ModernBERT-base) on a query classification dataset.
 
 
 
 
 
 
19
 
20
  ## Model description
21
 
22
- The model was fine-tuned on queries to classify them into specific categories.
 
 
 
 
23
 
24
  ## Training and evaluation data
25
 
26
- The model was trained on [describe your dataset here].
27
 
28
  ## Training procedure
29
 
30
- The model was trained with the following hyperparameters:
31
- - Learning rate: 2e-05
32
- - Batch size: 8
33
- - Number of epochs: 5
34
- - Optimizer: AdamW
35
- - Weight decay: 0.01
36
 
37
- ## Evaluation results
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
38
 
39
- The model achieved the following results on the validation set:
40
- - Accuracy: 0.9789
41
- - F1 Score: 0.9790
42
 
43
- ## Uses and limitations
44
 
45
- [Discuss the intended uses and limitations of your model]
 
 
 
 
 
1
  ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: answerdotai/ModernBERT-base
 
5
  tags:
6
+ - generated_from_trainer
 
 
7
  metrics:
8
+ - accuracy
9
+ - f1
10
+ - precision
11
+ - recall
12
+ model-index:
13
+ - name: modern-bert-finetuned-query-classification
14
+ results: []
15
  ---
16
 
17
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
18
+ should probably proofread and complete it, then remove this comment. -->
19
+
20
+ # modern-bert-finetuned-query-classification
21
 
22
+ This model is a fine-tuned version of [answerdotai/ModernBERT-base](https://huggingface.co/answerdotai/ModernBERT-base) on an unknown dataset.
23
+ It achieves the following results on the evaluation set:
24
+ - Loss: 0.1555
25
+ - Accuracy: 0.9789
26
+ - F1: 0.9790
27
+ - Precision: 0.9792
28
+ - Recall: 0.9789
29
 
30
  ## Model description
31
 
32
+ More information needed
33
+
34
+ ## Intended uses & limitations
35
+
36
+ More information needed
37
 
38
  ## Training and evaluation data
39
 
40
+ More information needed
41
 
42
  ## Training procedure
43
 
44
+ ### Training hyperparameters
 
 
 
 
 
45
 
46
+ The following hyperparameters were used during training:
47
+ - learning_rate: 2e-05
48
+ - train_batch_size: 8
49
+ - eval_batch_size: 8
50
+ - seed: 42
51
+ - optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
52
+ - lr_scheduler_type: linear
53
+ - num_epochs: 5
54
+
55
+ ### Training results
56
+
57
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | F1 | Precision | Recall |
58
+ |:-------------:|:-----:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
59
+ | No log | 1.0 | 305 | 0.2230 | 0.9579 | 0.9579 | 0.9600 | 0.9579 |
60
+ | 0.1385 | 2.0 | 610 | 0.1555 | 0.9789 | 0.9790 | 0.9792 | 0.9789 |
61
+ | 0.1385 | 3.0 | 915 | 0.1744 | 0.9693 | 0.9694 | 0.9701 | 0.9693 |
62
+ | 0.0189 | 4.0 | 1220 | 0.2378 | 0.9674 | 0.9675 | 0.9684 | 0.9674 |
63
+ | 0.0022 | 5.0 | 1525 | 0.2181 | 0.9732 | 0.9733 | 0.9737 | 0.9732 |
64
 
 
 
 
65
 
66
+ ### Framework versions
67
 
68
+ - Transformers 4.50.3
69
+ - Pytorch 2.6.0+cu124
70
+ - Datasets 3.5.0
71
+ - Tokenizers 0.21.1
tokenizer.json CHANGED
@@ -1,21 +1,7 @@
1
  {
2
  "version": "1.0",
3
- "truncation": {
4
- "direction": "Right",
5
- "max_length": 128,
6
- "strategy": "LongestFirst",
7
- "stride": 0
8
- },
9
- "padding": {
10
- "strategy": {
11
- "Fixed": 128
12
- },
13
- "direction": "Right",
14
- "pad_to_multiple_of": null,
15
- "pad_id": 50283,
16
- "pad_type_id": 0,
17
- "pad_token": "[PAD]"
18
- },
19
  "added_tokens": [
20
  {
21
  "id": 0,
 
1
  {
2
  "version": "1.0",
3
+ "truncation": null,
4
+ "padding": null,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
5
  "added_tokens": [
6
  {
7
  "id": 0,