deepakshirkem/Smollm-finetune-emotion-epoch-01-1145

README.md

@@ -1,11 +1,11 @@
 ---
-base_model: HuggingFaceTB/SmolLM-360M-Instruct
-datasets:
-- arrow
 library_name: transformers
 license: apache-2.0
+base_model: HuggingFaceTB/SmolLM-360M-Instruct
 tags:
 - generated_from_trainer
+datasets:
+- arrow
 model-index:
 - name: Smollm-finetune-emotion-epoch-01-1145
   results: []
@@ -43,17 +43,17 @@ The following hyperparameters were used during training:
 - seed: 42
 - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
 - lr_scheduler_type: linear
-- lr_scheduler_warmup_steps: 200
+- lr_scheduler_warmup_steps: 100
 - training_steps: 1145
 
 ### Training results
 
 | Training Loss | Epoch  | Step | Validation Loss |
 |:-------------:|:------:|:----:|:---------------:|
-| 6.8179        | 0.0840 | 100  | nan             |
-| 3.1491        | 0.1681 | 200  | nan             |
-| 1.6765        | 0.2521 | 300  | nan             |
-| 1.4599        | 0.3361 | 400  | nan             |
+| 6.5391        | 0.0840 | 100  | nan             |
+| 2.8649        | 0.1681 | 200  | nan             |
+| 2.7739        | 0.2521 | 300  | nan             |
+| 1.7863        | 0.3361 | 400  | nan             |
 
 
 ### Framework versions

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5a63967a2457d29cc7485af81e84f17f7cae85546a80ddd36015be0ea2e3b311
+oid sha256:07de63bd4234fb07b6bc9b96062f9a7bd182c44eb0aa192de568dc7453f5b456
 size 1447317080