FatCat87 commited on
Commit
f5018b3
·
verified ·
1 Parent(s): ee188cd

End of training

Browse files
Files changed (2) hide show
  1. README.md +8 -8
  2. adapter_model.bin +1 -1
README.md CHANGED
@@ -6,7 +6,7 @@ tags:
6
  - generated_from_trainer
7
  base_model: unsloth/Qwen2-0.5B
8
  model-index:
9
- - name: taopanda-1_expected_repo_name
10
  results: []
11
  ---
12
 
@@ -51,7 +51,7 @@ fsdp_config: null
51
  gradient_accumulation_steps: 4
52
  gradient_checkpointing: true
53
  group_by_length: false
54
- hub_model_id: FatCat87/taopanda-1_expected_repo_name
55
  learning_rate: 0.0002
56
  load_in_4bit: false
57
  load_in_8bit: true
@@ -71,7 +71,7 @@ pad_to_sequence_len: true
71
  resume_from_checkpoint: null
72
  sample_packing: true
73
  saves_per_epoch: 1
74
- seed: 12220
75
  sequence_len: 4096
76
  special_tokens: null
77
  strict: false
@@ -95,12 +95,12 @@ xformers_attention: null
95
 
96
  </details><br>
97
 
98
- [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/fatcat87-taopanda/subnet56/runs/8gcofu8s)
99
- # taopanda-1_expected_repo_name
100
 
101
  This model is a fine-tuned version of [unsloth/Qwen2-0.5B](https://huggingface.co/unsloth/Qwen2-0.5B) on the None dataset.
102
  It achieves the following results on the evaluation set:
103
- - Loss: 1.9101
104
 
105
  ## Model description
106
 
@@ -122,7 +122,7 @@ The following hyperparameters were used during training:
122
  - learning_rate: 0.0002
123
  - train_batch_size: 2
124
  - eval_batch_size: 2
125
- - seed: 12220
126
  - distributed_type: multi-GPU
127
  - num_devices: 4
128
  - gradient_accumulation_steps: 4
@@ -136,7 +136,7 @@ The following hyperparameters were used during training:
136
 
137
  | Training Loss | Epoch | Step | Validation Loss |
138
  |:-------------:|:-----:|:----:|:---------------:|
139
- | 1.4391 | 1.0 | 1 | 1.9101 |
140
 
141
 
142
  ### Framework versions
 
6
  - generated_from_trainer
7
  base_model: unsloth/Qwen2-0.5B
8
  model-index:
9
+ - name: expected_repo_name
10
  results: []
11
  ---
12
 
 
51
  gradient_accumulation_steps: 4
52
  gradient_checkpointing: true
53
  group_by_length: false
54
+ hub_model_id: taopanda-1/expected_repo_name
55
  learning_rate: 0.0002
56
  load_in_4bit: false
57
  load_in_8bit: true
 
71
  resume_from_checkpoint: null
72
  sample_packing: true
73
  saves_per_epoch: 1
74
+ seed: 1439
75
  sequence_len: 4096
76
  special_tokens: null
77
  strict: false
 
95
 
96
  </details><br>
97
 
98
+ [<img src="https://raw.githubusercontent.com/wandb/assets/main/wandb-github-badge-28.svg" alt="Visualize in Weights & Biases" width="200" height="32"/>](https://wandb.ai/fatcat87-taopanda/subnet56/runs/h6pimr9h)
99
+ # expected_repo_name
100
 
101
  This model is a fine-tuned version of [unsloth/Qwen2-0.5B](https://huggingface.co/unsloth/Qwen2-0.5B) on the None dataset.
102
  It achieves the following results on the evaluation set:
103
+ - Loss: 1.9074
104
 
105
  ## Model description
106
 
 
122
  - learning_rate: 0.0002
123
  - train_batch_size: 2
124
  - eval_batch_size: 2
125
+ - seed: 1439
126
  - distributed_type: multi-GPU
127
  - num_devices: 4
128
  - gradient_accumulation_steps: 4
 
136
 
137
  | Training Loss | Epoch | Step | Validation Loss |
138
  |:-------------:|:-----:|:----:|:---------------:|
139
+ | 1.4388 | 1.0 | 1 | 1.9074 |
140
 
141
 
142
  ### Framework versions
adapter_model.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:857784790288df0129c7674cb4aab7f1adb9fcb965e0b7687b1b834c940d3603
3
  size 70506570
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:31c20c5bbb272cbcfce24b78358ba591545ff3d32e0b2c04ffed36f870489801
3
  size 70506570