research-dump
/

bge-small-en-v1.5_wikinews_outcome_prediction_v1

Text Classification

sentence-transformers

generated_from_setfit_trainer

Model card Files Files and versions Community

hsuvaskakoty commited on Dec 3, 2024

Commit

98b5bb9

·

verified ·

1 Parent(s): a681d2e

Push model using huggingface_hub.

Files changed (3) hide show

README.md +13 -8
model.safetensors +1 -1
model_head.pkl +1 -1

README.md CHANGED Viewed

@@ -198,12 +198,12 @@ preds = model("  Interviews: Interviews WN:Story preparation/Office hours:Frank
 | 3     | 7                     |
 ### Training Hyperparameters
-- batch_size: (8, 2)
-- num_epochs: (5, 5)
 - max_steps: -1
 - sampling_strategy: oversampling
-- body_learning_rate: (1e-05, 1e-05)
-- head_learning_rate: 0.0001
 - loss: CosineSimilarityLoss
 - distance_metric: cosine_distance
 - margin: 0.25
@@ -219,10 +219,15 @@ preds = model("  Interviews: Interviews WN:Story preparation/Office hours:Frank
 | Epoch  | Step | Training Loss | Validation Loss |
 |:------:|:----:|:-------------:|:---------------:|
 | 0.0035 | 1    | 0.1819        | -               |
-| 1.0381 | 300  | 0.1851        | 0.3881          |
-| 2.0761 | 600  | 0.0269        | 0.4134          |
-| 3.1142 | 900  | 0.0077        | 0.4345          |
-| 4.1522 | 1200 | 0.005         | 0.4377          |
 ### Framework Versions
 - Python: 3.10.12

 | 3     | 7                     |
 ### Training Hyperparameters
+- batch_size: (8, 4)
+- num_epochs: (10, 10)
 - max_steps: -1
 - sampling_strategy: oversampling
+- body_learning_rate: (0.0005, 0.0005)
+- head_learning_rate: 1e-05
 - loss: CosineSimilarityLoss
 - distance_metric: cosine_distance
 - margin: 0.25
 | Epoch  | Step | Training Loss | Validation Loss |
 |:------:|:----:|:-------------:|:---------------:|
 | 0.0035 | 1    | 0.1819        | -               |
+| 1.0381 | 300  | 0.1617        | 0.5             |
+| 2.0761 | 600  | 0.2718        | 0.5000          |
+| 3.1142 | 900  | 0.2721        | 0.5             |
+| 4.1522 | 1200 | 0.2615        | 0.5             |
+| 5.1903 | 1500 | 0.2572        | 0.5000          |
+| 6.2284 | 1800 | 0.2571        | 0.5             |
+| 7.2664 | 2100 | 0.254         | 0.5             |
+| 8.3045 | 2400 | 0.2562        | 0.5000          |
+| 9.3426 | 2700 | 0.2542        | 0.5000          |
 ### Framework Versions
 - Python: 3.10.12

model.safetensors CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:c1ba0439903121f04449626c2397e2df8dc9b86f4b5eae753fb3f655e7d072de
 size 133462128

 version https://git-lfs.github.com/spec/v1
+oid sha256:6295a27359e599257963ff195f1e8084b4524b368b110a5805a869ba8697c255
 size 133462128

model_head.pkl CHANGED Viewed

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:3b46e751a2a25bb591cb2e4f12ac61261bd2fe605cdb416ff41dc7796ae44c08
 size 13175

 version https://git-lfs.github.com/spec/v1
+oid sha256:513671b63f320ca50a3b61233abf3ca31c9e4d23d830fd988fcc4b7924f289c9
 size 13175