Salm00n/bert-base-uncased-Federal-Regulations

README.md

@@ -21,13 +21,13 @@ should probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [distilbert-base-uncased](https://huggingface.co/distilbert-base-uncased) on the None dataset.
 It achieves the following results on the evaluation set:
-- Loss: 0.6346
-- Accuracy: 0.7346
-- Precision: 0.7551
-- Recall: 0.7346
-- F1: 0.7414
-- Roc Auc: 0.7858
-- Confusion Matrix: [[2574, 811], [475, 986]]
+- Loss: 0.6193
+- Accuracy: 0.7332
+- Precision: 0.7510
+- Recall: 0.7332
+- F1: 0.7394
+- Roc Auc: 0.7821
+- Confusion Matrix: [[2590, 795], [498, 963]]
 
 ## Model description
 
@@ -58,9 +58,9 @@ The following hyperparameters were used during training:
 
 | Training Loss | Epoch | Step | Validation Loss | Accuracy | Precision | Recall | F1     | Roc Auc | Confusion Matrix            |
 |:-------------:|:-----:|:----:|:---------------:|:--------:|:---------:|:------:|:------:|:-------:|:---------------------------:|
-| 0.5832        | 1.0   | 600  | 0.5900          | 0.6925   | 0.7366    | 0.6925 | 0.7039 | 0.7612  | [[2334, 1051], [439, 1022]] |
-| 0.4995        | 2.0   | 1200 | 0.5856          | 0.7274   | 0.7513    | 0.7274 | 0.7350 | 0.7833  | [[2535, 850], [471, 990]]   |
-| 0.4372        | 3.0   | 1800 | 0.6346          | 0.7346   | 0.7551    | 0.7346 | 0.7414 | 0.7858  | [[2574, 811], [475, 986]]   |
+| 0.5846        | 1.0   | 600  | 0.6114          | 0.6620   | 0.7393    | 0.6620 | 0.6759 | 0.7668  | [[2092, 1293], [345, 1116]] |
+| 0.5123        | 2.0   | 1200 | 0.5976          | 0.7210   | 0.7535    | 0.7210 | 0.7301 | 0.7848  | [[2465, 920], [432, 1029]]  |
+| 0.4449        | 3.0   | 1800 | 0.6193          | 0.7332   | 0.7510    | 0.7332 | 0.7394 | 0.7821  | [[2590, 795], [498, 963]]   |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:e1c18644861b9b926a87d2feb388d192957e5369f8ac6a4c88f1231e10a38ce8
+oid sha256:f3855772c6079167ac79a560da963f7516e6a7666be88326772a882d74955499
 size 267832560

runs/Dec10_00-05-23_e9a3f608e349/events.out.tfevents.1733789136.e9a3f608e349.20598.1

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:35b7270101da1f30657453897fdac4b39c10a4efa5d7ce5a168d187c853bca60
+size 7666

training_args.bin

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8ca606626b7b95c31482956595a46f6b7652500c1f49ce674e44904c0869eb76
+oid sha256:53432ee065a62bb2cbc684e7b390701360e01630cbbbda09ee093c06135be522
 size 5304