dandankim/token_classifier

README.md

@@ -19,13 +19,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 # distilbert-token-classifier
 
-This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
+This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.0711
-- Precision: 0.9576
-- Recall: 0.9721
-- F1: 0.9648
-- Accuracy: 0.9829
+- Loss: 0.0999
+- Precision: 0.9466
+- Recall: 0.9185
+- F1: 0.9323
+- Accuracy: 0.9733
 
 ## Model description
 
@@ -56,16 +56,15 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Precision | Recall | F1     | Accuracy |
 |:-------------:|:-----:|:----:|:---------------:|:---------:|:------:|:------:|:--------:|
-| 0.0711        | 1.0   | 202  | 0.0846          | 0.9576    | 0.9721 | 0.9648 | 0.9824   |
-| 0.0764        | 2.0   | 404  | 0.0777          | 0.9609    | 0.9732 | 0.9670 | 0.9829   |
-| 0.0821        | 3.0   | 606  | 0.0742          | 0.9567    | 0.9767 | 0.9666 | 0.9829   |
-| 0.0207        | 4.0   | 808  | 0.0745          | 0.9549    | 0.9616 | 0.9582 | 0.9808   |
-| 0.0236        | 5.0   | 1010 | 0.0711          | 0.9576    | 0.9721 | 0.9648 | 0.9829   |
+| 0.6612        | 1.0   | 28   | 0.2069          | 0.9478    | 0.9407 | 0.9442 | 0.9763   |
+| 0.1012        | 2.0   | 56   | 0.1051          | 0.9692    | 0.9333 | 0.9509 | 0.9792   |
+| 0.0482        | 3.0   | 84   | 0.0985          | 0.9627    | 0.9556 | 0.9591 | 0.9822   |
+| 0.0213        | 4.0   | 112  | 0.0992          | 0.9624    | 0.9481 | 0.9552 | 0.9792   |
+| 0.0172        | 5.0   | 140  | 0.0999          | 0.9466    | 0.9185 | 0.9323 | 0.9733   |
 
 
 ### Framework versions
 
 - Transformers 4.48.2
 - Pytorch 2.5.1+cu124
-- Datasets 3.2.0
 - Tokenizers 0.21.0

config.json

@@ -14,16 +14,11 @@
     "2": "B-CONTRACT_ADDRESS",
     "3": "B-ENTRY_PRICE",
     "4": "B-LEVERAGE",
-    "5": "B-O",
-    "6": "B-QUOTE_TOKEN",
-    "7": "B-STOPLOSS",
-    "8": "B-TARGET_SELL_PRICE",
-    "9": "I-ACTION",
-    "10": "I-BASE_TOKEN",
-    "11": "I-ENTRY_PRICE",
-    "12": "I-LEVERAGE",
-    "13": "I-TARGET_SELL_PRICE",
-    "14": "O"
+    "5": "B-QUOTE_TOKEN",
+    "6": "B-STOPLOSS",
+    "7": "B-TARGET_SELL_PRICE",
+    "8": "I-ENTRY_PRICE",
+    "9": "O"
   },
   "initializer_range": 0.02,
   "label2id": {
@@ -32,16 +27,11 @@
     "B-CONTRACT_ADDRESS": 2,
     "B-ENTRY_PRICE": 3,
     "B-LEVERAGE": 4,
-    "B-O": 5,
-    "B-QUOTE_TOKEN": 6,
-    "B-STOPLOSS": 7,
-    "B-TARGET_SELL_PRICE": 8,
-    "I-ACTION": 9,
-    "I-BASE_TOKEN": 10,
-    "I-ENTRY_PRICE": 11,
-    "I-LEVERAGE": 12,
-    "I-TARGET_SELL_PRICE": 13,
-    "O": 14
+    "B-QUOTE_TOKEN": 5,
+    "B-STOPLOSS": 6,
+    "B-TARGET_SELL_PRICE": 7,
+    "I-ENTRY_PRICE": 8,
+    "O": 9
   },
   "max_position_embeddings": 512,
   "model_type": "distilbert",

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:bfbf12b508aba096c08b841a4b879f82ed96fcf989a663f8a4df34c30919b14a
-size 265510004
+oid sha256:2ccd1c29144eefd3e65158d0bf3752311ac298b9aaee6c63cf50ae9947a65ed1
+size 265494624

runs/Feb12_06-12-00_5754239aeac9/events.out.tfevents.1739340726.5754239aeac9.303.0

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0009c87bf6133b52532d0dee9749f55e28be9c7f41bc5def4e421c71b8992cbc
+size 8566

runs/Feb12_06-12-00_5754239aeac9/events.out.tfevents.1739340851.5754239aeac9.303.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:282a7d6d37f1227a6f85f174ba888f9f047e09a80f182d04cef6b347edc8603d
+size 551

runs/Feb12_06-16-04_5754239aeac9/events.out.tfevents.1739340966.5754239aeac9.303.2

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:fa192154e1377e045104ce4a09932051d846d45339acd501e9d0aea5b7046b2d
+size 8612

runs/Feb12_06-28-36_5754239aeac9/events.out.tfevents.1739341717.5754239aeac9.303.3

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:b502033961810228bea02e7c2183b8f4c28f3965cb7c655318a40990d72c9e35
+size 11073

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:4468f318af33cda18dca659db9010d26b4c91230f7742e93db1fd61c9bf03d13
+oid sha256:6170693d4b72291ae4d45cb225c2220d3eaa39600414c0bf1c69a316d4e23bd2
 size 5368