Model save

README.md

@@ -0,0 +1,73 @@
+---
+license: mit
+base_model: jarod0411/zinc10M_gpt2_SMILES_bpe_combined_step1
+tags:
+- generated_from_trainer
+metrics:
+- accuracy
+model-index:
+- name: stage1
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# stage1
+
+This model is a fine-tuned version of [jarod0411/zinc10M_gpt2_SMILES_bpe_combined_step1](https://huggingface.co/jarod0411/zinc10M_gpt2_SMILES_bpe_combined_step1) on the None dataset.
+It achieves the following results on the evaluation set:
+- Loss: 0.2469
+- Accuracy: 0.9158
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 5e-05
+- train_batch_size: 16
+- eval_batch_size: 16
+- seed: 1
+- distributed_type: multi-GPU
+- num_devices: 8
+- total_train_batch_size: 128
+- total_eval_batch_size: 128
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- num_epochs: 10.0
+
+### Training results
+
+| Training Loss | Epoch | Step   | Validation Loss | Accuracy |
+|:-------------:|:-----:|:------:|:---------------:|:--------:|
+| 0.3374        | 1.0   | 16956  | 0.2982          | 0.9016   |
+| 0.2955        | 2.0   | 33912  | 0.2682          | 0.9104   |
+| 0.2795        | 3.0   | 50868  | 0.2593          | 0.9126   |
+| 0.2713        | 4.0   | 67824  | 0.2549          | 0.9137   |
+| 0.2661        | 5.0   | 84780  | 0.2522          | 0.9144   |
+| 0.2626        | 6.0   | 101736 | 0.2501          | 0.9150   |
+| 0.2602        | 7.0   | 118692 | 0.2488          | 0.9153   |
+| 0.2585        | 8.0   | 135648 | 0.2478          | 0.9156   |
+| 0.2574        | 9.0   | 152604 | 0.2471          | 0.9158   |
+| 0.2569        | 10.0  | 169560 | 0.2469          | 0.9158   |
+
+
+### Framework versions
+
+- Transformers 4.36.0.dev0
+- Pytorch 2.1.1+cu121
+- Datasets 2.15.0
+- Tokenizers 0.15.0

generation_config.json

@@ -0,0 +1,6 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 50256,
+  "eos_token_id": 50256,
+  "transformers_version": "4.36.0.dev0"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fc10ca0841efae65aa7440defe1aa2329ab6f15f8c66e304ba21f0e2748982af
+oid sha256:1f133a68fda050e1f482dbdb616af7026a9428b9045935d6fad6c0273b10f636
 size 497774208

runs/May01_12-52-55_lambda1/events.out.tfevents.1714593249.lambda1.2643430.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:a08cafdb83a3c91146b3ffde5b60973cf6ade58bc3839162e4f7e823e4a97a66
-size 61706
+oid sha256:4378c1c0e5ed4022b885f916acafd4c4dec4fda71b87c76441d1387b1b3eb316
+size 62395