Training in progress epoch 0

README.md

@@ -13,9 +13,9 @@ probably proofread and complete it, then remove this comment. -->
 
 This model is a fine-tuned version of [vinai/phobert-base](https://huggingface.co/vinai/phobert-base) on an unknown dataset.
 It achieves the following results on the evaluation set:
-- Train Loss: nan
-- Validation Loss: nan
-- Epoch: 19
+- Train Loss: 4.6440
+- Validation Loss: 4.2231
+- Epoch: 0
 
 ## Model description
 
@@ -34,33 +34,14 @@ More information needed
 ### Training hyperparameters
 
 The following hyperparameters were used during training:
-- optimizer: {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}
+- optimizer: {'inner_optimizer': {'class_name': 'AdamWeightDecay', 'config': {'name': 'AdamWeightDecay', 'learning_rate': 2e-05, 'decay': 0.0, 'beta_1': 0.9, 'beta_2': 0.999, 'epsilon': 1e-07, 'amsgrad': False, 'weight_decay_rate': 0.01}}, 'dynamic': True, 'initial_scale': 32768.0, 'dynamic_growth_steps': 2000}
 - training_precision: mixed_float16
 
 ### Training results
 
 | Train Loss | Validation Loss | Epoch |
 |:----------:|:---------------:|:-----:|
-| 4.6923     | 4.2814          | 0     |
-| 4.2310     | 4.0653          | 1     |
-| 4.0064     | 3.9325          | 2     |
-| 3.8931     | 3.8914          | 3     |
-| 3.7736     | 3.7306          | 4     |
-| 3.5888     | 3.7033          | 5     |
-| 3.5368     | 3.6587          | 6     |
-| 3.4945     | 3.5798          | 7     |
-| 3.4245     | 3.5234          | 8     |
-| 3.3508     | 3.4322          | 9     |
-| 3.2790     | 3.4335          | 10    |
-| 3.1635     | 3.3848          | 11    |
-| 3.1446     | 3.3465          | 12    |
-| 3.0585     | 3.3234          | 13    |
-| nan        | nan             | 14    |
-| nan        | nan             | 15    |
-| nan        | nan             | 16    |
-| nan        | nan             | 17    |
-| nan        | nan             | 18    |
-| nan        | nan             | 19    |
+| 4.6440     | 4.2231          | 0     |
 
 
 ### Framework versions

checkpoint/extra_data.pickle

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:962468d06d6a93b7cf28d1a7f1353f8898d951a9c82dee9b2f93a436c30af909
+size 1080533909

checkpoint/weights.h5

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:72950c0f718a9ecbe2ac165e6ad2d9f7c715920adb4c99c04ddce7d2ea4a6500
+size 737947308

tf_model.h5

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:5436c671423fe769d4ccab49d39427db1a356a6fb554d708b1de4eae249eba26
+oid sha256:2bd46ac4d35396d965abc72789cbfe4cac153106545f663e81b6a8b11376c5a8
 size 737947308