Model save

README.md

@@ -0,0 +1,59 @@
+---
+license: mit
+base_model: openai-community/gpt2
+tags:
+- trl
+- sft
+- generated_from_trainer
+datasets:
+- generator
+model-index:
+- name: model
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# model
+
+This model is a fine-tuned version of [openai-community/gpt2](https://huggingface.co/openai-community/gpt2) on the generator dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0002
+- train_batch_size: 3
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 2
+- total_train_batch_size: 6
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: constant
+- lr_scheduler_warmup_ratio: 0.03
+- num_epochs: 2
+
+### Training results
+
+
+
+### Framework versions
+
+- Transformers 4.42.4
+- Pytorch 2.4.0+cu121
+- Datasets 2.21.0
+- Tokenizers 0.19.1

generation_config.json

@@ -0,0 +1,7 @@
+{
+  "_from_model_config": true,
+  "bos_token_id": 50257,
+  "eos_token_id": 50258,
+  "pad_token_id": 50258,
+  "transformers_version": "4.42.4"
+}

model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:b8b063901cdfc46a4689db241bc6d3e7e1079c7ad9ca96ce1e3d6700dd276d20
+oid sha256:8671e1b51dbeaff992b20ed7da3a0a2e0a2d8df7571f6bed28641dbe64ffd70e
 size 497780352

runs/Sep02_04-13-13_057cf5e5754d/events.out.tfevents.1725250416.057cf5e5754d.46154.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:10d09e05f16b5d6bfc7510340c5ded4d1912e3830c188a88902d5cfa0a66af07
-size 8637
+oid sha256:cfcaf070672b81f63c4ea481d498d9cff2a413828f5ea23b8ba8383d2a4a1e4f
+size 9413