Hugging Face's logo

lekhnathrijal
/
bert-question-classifier

Text Classification
Transformers
Safetensors
bert
Generated from Trainer
Model card Files Community
lekhnathrijal commited on
Commit
fc939d3
·
verified ·
1 Parent(s): bc96b36

ai-research-lab/bert-question-classifier

Browse files
Files changed (4) hide show
  1. README.md +35 -26
  2. config.json +18 -0
  3. model.safetensors +1 -1
  4. tokenizer.json +10 -1
README.md CHANGED
@@ -1,7 +1,7 @@
1
  ---
2
  library_name: transformers
3
  license: apache-2.0
4
- base_model: google-bert/bert-base-uncased
5
  tags:
6
  - generated_from_trainer
7
  metrics:
@@ -19,13 +19,13 @@ should probably proofread and complete it, then remove this comment. -->
19
 
20
  # bert-question-classifier
21
 
22
- This model is a fine-tuned version of [google-bert/bert-base-uncased](https://huggingface.co/google-bert/bert-base-uncased) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
- - Loss: 1.7626
25
- - Accuracy: 0.9711
26
- - Recall: 0.8457
27
- - Precision: 0.8328
28
- - F1: 0.8392
29
 
30
  ## Model description
31
 
@@ -57,25 +57,34 @@ The following hyperparameters were used during training:
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Recall | Precision | F1 |
59
  |:-------------:|:------:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
60
- | No log | 0.1770 | 100 | 4.9936 | 0.9059 | 0.4617 | 0.4711 | 0.4664 |
61
- | No log | 0.3540 | 200 | 4.3759 | 0.9286 | 0.5827 | 0.6022 | 0.5923 |
62
- | No log | 0.5310 | 300 | 3.9061 | 0.9389 | 0.6590 | 0.6561 | 0.6575 |
63
- | No log | 0.7080 | 400 | 3.5239 | 0.9414 | 0.6964 | 0.6625 | 0.6790 |
64
- | 4.2985 | 0.8850 | 500 | 3.2182 | 0.9452 | 0.7154 | 0.6836 | 0.6991 |
65
- | 4.2985 | 1.0619 | 600 | 2.9700 | 0.9486 | 0.7274 | 0.7053 | 0.7162 |
66
- | 4.2985 | 1.2389 | 700 | 2.7592 | 0.9535 | 0.7545 | 0.7317 | 0.7429 |
67
- | 4.2985 | 1.4159 | 800 | 2.5722 | 0.9568 | 0.7802 | 0.7466 | 0.7631 |
68
- | 4.2985 | 1.5929 | 900 | 2.3973 | 0.9609 | 0.8001 | 0.7695 | 0.7845 |
69
- | 2.7724 | 1.7699 | 1000 | 2.2682 | 0.9642 | 0.8089 | 0.7934 | 0.8010 |
70
- | 2.7724 | 1.9469 | 1100 | 2.1763 | 0.9657 | 0.8156 | 0.8025 | 0.8090 |
71
- | 2.7724 | 2.1239 | 1200 | 2.0628 | 0.9665 | 0.8147 | 0.8102 | 0.8125 |
72
- | 2.7724 | 2.3009 | 1300 | 1.9961 | 0.9675 | 0.8197 | 0.8166 | 0.8181 |
73
- | 2.7724 | 2.4779 | 1400 | 1.9156 | 0.9696 | 0.8361 | 0.8247 | 0.8304 |
74
- | 2.0623 | 2.6549 | 1500 | 1.8615 | 0.9693 | 0.8337 | 0.8239 | 0.8288 |
75
- | 2.0623 | 2.8319 | 1600 | 1.8050 | 0.9700 | 0.8422 | 0.8251 | 0.8336 |
76
- | 2.0623 | 3.0088 | 1700 | 1.7626 | 0.9711 | 0.8457 | 0.8328 | 0.8392 |
77
- | 2.0623 | 3.1858 | 1800 | 1.7303 | 0.9704 | 0.8404 | 0.8293 | 0.8348 |
78
- | 2.0623 | 3.3628 | 1900 | 1.6939 | 0.9712 | 0.8431 | 0.8353 | 0.8392 |
 
 
 
 
 
 
 
 
 
79
 
80
 
81
  ### Framework versions
 
1
  ---
2
  library_name: transformers
3
  license: apache-2.0
4
+ base_model: google-bert/bert-large-uncased
5
  tags:
6
  - generated_from_trainer
7
  metrics:
 
19
 
20
  # bert-question-classifier
21
 
22
+ This model is a fine-tuned version of [google-bert/bert-large-uncased](https://huggingface.co/google-bert/bert-large-uncased) on the None dataset.
23
  It achieves the following results on the evaluation set:
24
+ - Loss: 1.0746
25
+ - Accuracy: 0.9807
26
+ - Recall: 0.8925
27
+ - Precision: 0.8909
28
+ - F1: 0.8917
29
 
30
  ## Model description
31
 
 
57
 
58
  | Training Loss | Epoch | Step | Validation Loss | Accuracy | Recall | Precision | F1 |
59
  |:-------------:|:------:|:----:|:---------------:|:--------:|:------:|:---------:|:------:|
60
+ | No log | 0.1770 | 100 | 5.0786 | 0.8950 | 0.5327 | 0.4279 | 0.4746 |
61
+ | No log | 0.3540 | 200 | 4.3278 | 0.9257 | 0.5783 | 0.5838 | 0.5810 |
62
+ | No log | 0.5310 | 300 | 3.6620 | 0.9411 | 0.6940 | 0.6612 | 0.6772 |
63
+ | No log | 0.7080 | 400 | 3.1590 | 0.9515 | 0.7420 | 0.7211 | 0.7314 |
64
+ | 4.1504 | 0.8850 | 500 | 2.5666 | 0.9580 | 0.7770 | 0.7580 | 0.7674 |
65
+ | 4.1504 | 1.0619 | 600 | 2.1826 | 0.9638 | 0.7987 | 0.7954 | 0.7970 |
66
+ | 4.1504 | 1.2389 | 700 | 1.9754 | 0.9666 | 0.8168 | 0.8094 | 0.8131 |
67
+ | 4.1504 | 1.4159 | 800 | 1.8447 | 0.9686 | 0.8372 | 0.8151 | 0.8260 |
68
+ | 4.1504 | 1.5929 | 900 | 1.6676 | 0.9706 | 0.8457 | 0.8283 | 0.8369 |
69
+ | 2.012 | 1.7699 | 1000 | 1.5743 | 0.9728 | 0.8510 | 0.8450 | 0.8480 |
70
+ | 2.012 | 1.9469 | 1100 | 1.4473 | 0.9749 | 0.8641 | 0.8556 | 0.8598 |
71
+ | 2.012 | 2.1239 | 1200 | 1.4000 | 0.9749 | 0.8641 | 0.8551 | 0.8596 |
72
+ | 2.012 | 2.3009 | 1300 | 1.3287 | 0.9772 | 0.8764 | 0.8688 | 0.8726 |
73
+ | 2.012 | 2.4779 | 1400 | 1.2995 | 0.9770 | 0.8773 | 0.8659 | 0.8715 |
74
+ | 1.3018 | 2.6549 | 1500 | 1.2397 | 0.9778 | 0.8793 | 0.8724 | 0.8759 |
75
+ | 1.3018 | 2.8319 | 1600 | 1.2059 | 0.9786 | 0.8857 | 0.8753 | 0.8805 |
76
+ | 1.3018 | 3.0088 | 1700 | 1.1763 | 0.9790 | 0.8857 | 0.8798 | 0.8828 |
77
+ | 1.3018 | 3.1858 | 1800 | 1.1744 | 0.9786 | 0.8816 | 0.8788 | 0.8802 |
78
+ | 1.3018 | 3.3628 | 1900 | 1.1356 | 0.9793 | 0.8869 | 0.8818 | 0.8843 |
79
+ | 0.9668 | 3.5398 | 2000 | 1.1365 | 0.9791 | 0.8857 | 0.8806 | 0.8832 |
80
+ | 0.9668 | 3.7168 | 2100 | 1.1084 | 0.9796 | 0.8872 | 0.8838 | 0.8855 |
81
+ | 0.9668 | 3.8938 | 2200 | 1.0939 | 0.9800 | 0.8892 | 0.8864 | 0.8878 |
82
+ | 0.9668 | 4.0708 | 2300 | 1.0974 | 0.9796 | 0.8881 | 0.8834 | 0.8857 |
83
+ | 0.9668 | 4.2478 | 2400 | 1.0786 | 0.9802 | 0.8916 | 0.8864 | 0.8890 |
84
+ | 0.7915 | 4.4248 | 2500 | 1.0766 | 0.9803 | 0.8910 | 0.8881 | 0.8896 |
85
+ | 0.7915 | 4.6018 | 2600 | 1.0746 | 0.9807 | 0.8925 | 0.8909 | 0.8917 |
86
+ | 0.7915 | 4.7788 | 2700 | 1.0686 | 0.9803 | 0.8910 | 0.8887 | 0.8898 |
87
+ | 0.7915 | 4.9558 | 2800 | 1.0637 | 0.9802 | 0.8907 | 0.8873 | 0.8890 |
88
 
89
 
90
  ### Framework versions
config.json CHANGED
@@ -5,6 +5,24 @@
5
  ],
6
  "attention_probs_dropout_prob": 0.1,
7
  "classifier_dropout": null,
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
8
  "gradient_checkpointing": false,
9
  "hidden_act": "gelu",
10
  "hidden_dropout_prob": 0.1,
 
5
  ],
6
  "attention_probs_dropout_prob": 0.1,
7
  "classifier_dropout": null,
8
+ "custom_pipelines": {
9
+ "question-classifier": {
10
+ "default": {
11
+ "model": {
12
+ "pt": [
13
+ "ai-research-lab/bert-question-classifier",
14
+ "main"
15
+ ]
16
+ }
17
+ },
18
+ "impl": "classifier_pipeline.MultiTaskClassifierPipeline",
19
+ "pt": [
20
+ "AutoModelForSequenceClassification"
21
+ ],
22
+ "tf": [],
23
+ "type": "text"
24
+ }
25
+ },
26
  "gradient_checkpointing": false,
27
  "hidden_act": "gelu",
28
  "hidden_dropout_prob": 0.1,
model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:851054f2e58532c3f5a2a77013d5771fcddb79da2a8b2ef1781d570c1c9b96fa
3
  size 1340753968
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:38841421c2a4c9d481c6a1c0af0e8323026294db894c62d366e5832b2bc8b19e
3
  size 1340753968
tokenizer.json CHANGED
@@ -6,7 +6,16 @@
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
9
- "padding": null,
 
 
 
 
 
 
 
 
 
10
  "added_tokens": [
11
  {
12
  "id": 0,
 
6
  "strategy": "LongestFirst",
7
  "stride": 0
8
  },
9
+ "padding": {
10
+ "strategy": {
11
+ "Fixed": 512
12
+ },
13
+ "direction": "Right",
14
+ "pad_to_multiple_of": null,
15
+ "pad_id": 0,
16
+ "pad_type_id": 0,
17
+ "pad_token": "[PAD]"
18
+ },
19
  "added_tokens": [
20
  {
21
  "id": 0,