Hugging Face's logo

nzm97
/
math_question_topic_detection_T5_12-17-24_v1

Text Classification
Transformers
TensorBoard
Safetensors
t5
Generated from Trainer
text-generation-inference
Model card Files Metrics Community
nzm97 commited on
Commit
8330c7f
·
verified ·
1 Parent(s): d927a50

Initial model push after training

Browse files
Files changed (6) hide show
  1. README.md +113 -0
  2. config.json +89 -0
  3. model.safetensors +3 -0
  4. runs/Dec17_06-07-27_4eb83a431d98/events.out.tfevents.1734415669.4eb83a431d98.23.0 +3 -0
  5. runs/Dec17_08-31-29_4eb83a431d98/events.out.tfevents.1734424293.4eb83a431d98.135.0 +3 -0
  6. training_args.bin +3 -0
README.md ADDED
@@ -0,0 +1,113 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ library_name: transformers
3
+ license: apache-2.0
4
+ base_model: google/flan-t5-base
5
+ tags:
6
+ - generated_from_trainer
7
+ metrics:
8
+ - accuracy
9
+ - precision
10
+ - recall
11
+ - f1
12
+ model-index:
13
+ - name: math_question_topic_detection_T5_12-17-24_v1
14
+ results: []
15
+ ---
16
+
17
+ <!-- This model card has been generated automatically according to the information the Trainer had access to. You
18
+ should probably proofread and complete it, then remove this comment. -->
19
+
20
+ # math_question_topic_detection_T5_12-17-24_v1
21
+
22
+ This model is a fine-tuned version of [google/flan-t5-base](https://huggingface.co/google/flan-t5-base) on an unknown dataset.
23
+ It achieves the following results on the evaluation set:
24
+ - Loss: 0.4043
25
+ - Accuracy: 0.8670
26
+ - Precision: 0.8678
27
+ - Recall: 0.8670
28
+ - F1: 0.8670
29
+
30
+ ## Model description
31
+
32
+ More information needed
33
+
34
+ ## Intended uses & limitations
35
+
36
+ More information needed
37
+
38
+ ## Training and evaluation data
39
+
40
+ More information needed
41
+
42
+ ## Training procedure
43
+
44
+ ### Training hyperparameters
45
+
46
+ The following hyperparameters were used during training:
47
+ - learning_rate: 0.0001
48
+ - train_batch_size: 4
49
+ - eval_batch_size: 8
50
+ - seed: 42
51
+ - gradient_accumulation_steps: 3
52
+ - total_train_batch_size: 12
53
+ - optimizer: Use adamw_torch with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
54
+ - lr_scheduler_type: linear
55
+ - lr_scheduler_warmup_steps: 100
56
+ - training_steps: 2200
57
+
58
+ ### Training results
59
+
60
+ | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1 |
61
+ |:-------------:|:------:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|
62
+ | No log | 0.0513 | 50 | 2.0102 | 0.1929 | 0.1121 | 0.1929 | 0.1006 |
63
+ | No log | 0.1025 | 100 | 1.6675 | 0.4243 | 0.3751 | 0.4243 | 0.3741 |
64
+ | No log | 0.1538 | 150 | 1.3705 | 0.4827 | 0.4186 | 0.4827 | 0.4263 |
65
+ | No log | 0.2051 | 200 | 1.1202 | 0.5942 | 0.5856 | 0.5942 | 0.5685 |
66
+ | No log | 0.2563 | 250 | 1.0150 | 0.6487 | 0.6613 | 0.6487 | 0.6429 |
67
+ | No log | 0.3076 | 300 | 1.0172 | 0.6380 | 0.6743 | 0.6380 | 0.6238 |
68
+ | No log | 0.3589 | 350 | 0.8297 | 0.7095 | 0.6994 | 0.7095 | 0.6993 |
69
+ | No log | 0.4101 | 400 | 0.7494 | 0.7333 | 0.7309 | 0.7333 | 0.7194 |
70
+ | No log | 0.4614 | 450 | 0.6765 | 0.7433 | 0.7573 | 0.7433 | 0.7351 |
71
+ | 1.2821 | 0.5126 | 500 | 0.6862 | 0.7510 | 0.7607 | 0.7510 | 0.7454 |
72
+ | 1.2821 | 0.5639 | 550 | 0.6518 | 0.7656 | 0.7788 | 0.7656 | 0.7612 |
73
+ | 1.2821 | 0.6152 | 600 | 0.6115 | 0.7786 | 0.7795 | 0.7786 | 0.7754 |
74
+ | 1.2821 | 0.6664 | 650 | 0.5832 | 0.7925 | 0.7971 | 0.7925 | 0.7895 |
75
+ | 1.2821 | 0.7177 | 700 | 0.5504 | 0.7971 | 0.8078 | 0.7971 | 0.7963 |
76
+ | 1.2821 | 0.7690 | 750 | 0.5197 | 0.8163 | 0.8198 | 0.8163 | 0.8156 |
77
+ | 1.2821 | 0.8202 | 800 | 0.5729 | 0.7932 | 0.8140 | 0.7932 | 0.7924 |
78
+ | 1.2821 | 0.8715 | 850 | 0.5184 | 0.8163 | 0.8268 | 0.8163 | 0.8158 |
79
+ | 1.2821 | 0.9228 | 900 | 0.5167 | 0.8186 | 0.8243 | 0.8186 | 0.8180 |
80
+ | 1.2821 | 0.9740 | 950 | 0.4947 | 0.8309 | 0.8388 | 0.8309 | 0.8303 |
81
+ | 0.6382 | 1.0253 | 1000 | 0.5191 | 0.8309 | 0.8392 | 0.8309 | 0.8313 |
82
+ | 0.6382 | 1.0766 | 1050 | 0.5115 | 0.8194 | 0.8318 | 0.8194 | 0.8186 |
83
+ | 0.6382 | 1.1278 | 1100 | 0.4724 | 0.8309 | 0.8320 | 0.8309 | 0.8304 |
84
+ | 0.6382 | 1.1791 | 1150 | 0.4883 | 0.8324 | 0.8350 | 0.8324 | 0.8321 |
85
+ | 0.6382 | 1.2303 | 1200 | 0.4628 | 0.8386 | 0.8410 | 0.8386 | 0.8378 |
86
+ | 0.6382 | 1.2816 | 1250 | 0.4567 | 0.8324 | 0.8353 | 0.8324 | 0.8326 |
87
+ | 0.6382 | 1.3329 | 1300 | 0.4908 | 0.8378 | 0.8429 | 0.8378 | 0.8377 |
88
+ | 0.6382 | 1.3841 | 1350 | 0.4606 | 0.8470 | 0.8504 | 0.8470 | 0.8472 |
89
+ | 0.6382 | 1.4354 | 1400 | 0.4714 | 0.8455 | 0.8505 | 0.8455 | 0.8460 |
90
+ | 0.6382 | 1.4867 | 1450 | 0.4576 | 0.8417 | 0.8436 | 0.8417 | 0.8412 |
91
+ | 0.4651 | 1.5379 | 1500 | 0.4409 | 0.8478 | 0.8493 | 0.8478 | 0.8480 |
92
+ | 0.4651 | 1.5892 | 1550 | 0.4189 | 0.8570 | 0.8589 | 0.8570 | 0.8573 |
93
+ | 0.4651 | 1.6405 | 1600 | 0.4159 | 0.8601 | 0.8623 | 0.8601 | 0.8603 |
94
+ | 0.4651 | 1.6917 | 1650 | 0.4295 | 0.8563 | 0.8602 | 0.8563 | 0.8566 |
95
+ | 0.4651 | 1.7430 | 1700 | 0.4235 | 0.8601 | 0.8634 | 0.8601 | 0.8601 |
96
+ | 0.4651 | 1.7943 | 1750 | 0.4214 | 0.8563 | 0.8593 | 0.8563 | 0.8565 |
97
+ | 0.4651 | 1.8455 | 1800 | 0.4169 | 0.8578 | 0.8601 | 0.8578 | 0.8578 |
98
+ | 0.4651 | 1.8968 | 1850 | 0.4181 | 0.8624 | 0.8654 | 0.8624 | 0.8626 |
99
+ | 0.4651 | 1.9481 | 1900 | 0.4126 | 0.8609 | 0.8619 | 0.8609 | 0.8607 |
100
+ | 0.4651 | 1.9993 | 1950 | 0.4077 | 0.8670 | 0.8688 | 0.8670 | 0.8667 |
101
+ | 0.4227 | 2.0506 | 2000 | 0.4095 | 0.8632 | 0.8644 | 0.8632 | 0.8634 |
102
+ | 0.4227 | 2.1018 | 2050 | 0.4051 | 0.8624 | 0.8637 | 0.8624 | 0.8626 |
103
+ | 0.4227 | 2.1531 | 2100 | 0.4049 | 0.8655 | 0.8662 | 0.8655 | 0.8656 |
104
+ | 0.4227 | 2.2044 | 2150 | 0.4050 | 0.8686 | 0.8695 | 0.8686 | 0.8687 |
105
+ | 0.4227 | 2.2556 | 2200 | 0.4043 | 0.8670 | 0.8678 | 0.8670 | 0.8670 |
106
+
107
+
108
+ ### Framework versions
109
+
110
+ - Transformers 4.46.3
111
+ - Pytorch 2.4.0
112
+ - Datasets 3.1.0
113
+ - Tokenizers 0.20.3
config.json ADDED
@@ -0,0 +1,89 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ {
2
+ "_name_or_path": "google/flan-t5-base",
3
+ "architectures": [
4
+ "T5ForSequenceClassification"
5
+ ],
6
+ "classifier_dropout": 0.0,
7
+ "d_ff": 2048,
8
+ "d_kv": 64,
9
+ "d_model": 768,
10
+ "decoder_start_token_id": 0,
11
+ "dense_act_fn": "gelu_new",
12
+ "dropout_rate": 0.1,
13
+ "eos_token_id": 1,
14
+ "feed_forward_proj": "gated-gelu",
15
+ "id2label": {
16
+ "0": "LABEL_0",
17
+ "1": "LABEL_1",
18
+ "2": "LABEL_2",
19
+ "3": "LABEL_3",
20
+ "4": "LABEL_4",
21
+ "5": "LABEL_5",
22
+ "6": "LABEL_6",
23
+ "7": "LABEL_7",
24
+ "8": "LABEL_8",
25
+ "9": "LABEL_9",
26
+ "10": "LABEL_10"
27
+ },
28
+ "initializer_factor": 1.0,
29
+ "is_encoder_decoder": true,
30
+ "is_gated_act": true,
31
+ "label2id": {
32
+ "LABEL_0": 0,
33
+ "LABEL_1": 1,
34
+ "LABEL_10": 10,
35
+ "LABEL_2": 2,
36
+ "LABEL_3": 3,
37
+ "LABEL_4": 4,
38
+ "LABEL_5": 5,
39
+ "LABEL_6": 6,
40
+ "LABEL_7": 7,
41
+ "LABEL_8": 8,
42
+ "LABEL_9": 9
43
+ },
44
+ "layer_norm_epsilon": 1e-06,
45
+ "model_type": "t5",
46
+ "n_positions": 512,
47
+ "num_decoder_layers": 12,
48
+ "num_heads": 12,
49
+ "num_layers": 12,
50
+ "output_past": true,
51
+ "pad_token_id": 0,
52
+ "problem_type": "single_label_classification",
53
+ "relative_attention_max_distance": 128,
54
+ "relative_attention_num_buckets": 32,
55
+ "task_specific_params": {
56
+ "summarization": {
57
+ "early_stopping": true,
58
+ "length_penalty": 2.0,
59
+ "max_length": 200,
60
+ "min_length": 30,
61
+ "no_repeat_ngram_size": 3,
62
+ "num_beams": 4,
63
+ "prefix": "summarize: "
64
+ },
65
+ "translation_en_to_de": {
66
+ "early_stopping": true,
67
+ "max_length": 300,
68
+ "num_beams": 4,
69
+ "prefix": "translate English to German: "
70
+ },
71
+ "translation_en_to_fr": {
72
+ "early_stopping": true,
73
+ "max_length": 300,
74
+ "num_beams": 4,
75
+ "prefix": "translate English to French: "
76
+ },
77
+ "translation_en_to_ro": {
78
+ "early_stopping": true,
79
+ "max_length": 300,
80
+ "num_beams": 4,
81
+ "prefix": "translate English to Romanian: "
82
+ }
83
+ },
84
+ "tie_word_embeddings": false,
85
+ "torch_dtype": "float32",
86
+ "transformers_version": "4.46.3",
87
+ "use_cache": true,
88
+ "vocab_size": 32128
89
+ }
model.safetensors ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:887943ac33677c47963152ca4581df79601b5152d812b5e0585f281e25024b8f
3
+ size 894047732
runs/Dec17_06-07-27_4eb83a431d98/events.out.tfevents.1734415669.4eb83a431d98.23.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:09e7d2fb688863472b0ce97a87cfeab4d2d807872d4f2ac632b3b1b5c02a3187
3
+ size 32069
runs/Dec17_08-31-29_4eb83a431d98/events.out.tfevents.1734424293.4eb83a431d98.135.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:2b037734c9934c7dac477d907b3557ebacf5ea7dc12113148dc6f06d18a84ddd
3
+ size 28436
training_args.bin ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b79b92f63cbc987395441460c604160ab91b3439c23ce4f3442519ac6e84e993
3
+ size 5304