End of training

README.md

@@ -0,0 +1,66 @@
+---
+tags:
+- generated_from_trainer
+model-index:
+- name: llama-2-7b-hf-ft-compact
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# llama-2-7b-hf-ft-compact
+
+This model was trained from scratch on an unknown dataset.
+It achieves the following results on the evaluation set:
+- Loss: 4.4389
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0001
+- train_batch_size: 8
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 8
+- total_train_batch_size: 64
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_ratio: 0.1
+- num_epochs: 3
+- mixed_precision_training: Native AMP
+
+### Training results
+
+| Training Loss | Epoch | Step | Validation Loss |
+|:-------------:|:-----:|:----:|:---------------:|
+| 4.3974        | 0.36  | 25   | 4.4386          |
+| 4.4015        | 0.73  | 50   | 4.4383          |
+| 4.3944        | 1.09  | 75   | 4.4386          |
+| 4.4058        | 1.45  | 100  | 4.4386          |
+| 4.4428        | 1.82  | 125  | 4.4383          |
+| 4.4266        | 2.18  | 150  | 4.4385          |
+| 4.4104        | 2.55  | 175  | 4.4386          |
+| 4.4026        | 2.91  | 200  | 4.4389          |
+
+
+### Framework versions
+
+- Transformers 4.35.2
+- Pytorch 2.0.0+cu118
+- Datasets 2.15.0
+- Tokenizers 0.15.0

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:8c2db0b6ba25f984ee412a11e41e07bf3d2247e6e7060c363c80da5a6ee7f8b0
+oid sha256:29a915c88fadec45488ce706d85a66b4a3f7da11803b6efd35ec0a5be41fa747
 size 16794200

runs/Nov17_12-45-31_ai12.kuacc.ku.edu.tr/events.out.tfevents.1700214332.ai12.kuacc.ku.edu.tr.119537.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:73eae2aeef1b52bb85379854a8832bae5947e6cb9655b812c1c71d4a035adead
-size 9892
+oid sha256:8d738448012983cf3258f64cf166d8cde8bb097e49b170f5c0f8d8964a26a532
+size 10246