Hugging Face's logo

AlyGreo
/
Arabic-QA-Mistral-7B-Instruct

PEFT
TensorBoard
Safetensors
trl
sft
Generated from Trainer
Model card Files Metrics Community
AlyGreo commited on
Commit
9183c9c
·
verified ·
1 Parent(s): 629c8f0

Model save

Browse files
Files changed (6) hide show
  1. README.md +4 -3
  2. adapter_config.json +2 -2
  3. adapter_model.safetensors +1 -1
  4. runs/Apr19_15-37-15_4cdfa69e0159/events.out.tfevents.1713541040.4cdfa69e0159.84.0 +3 -0
  5. runs/Apr19_15-38-40_4cdfa69e0159/events.out.tfevents.1713541124.4cdfa69e0159.84.1 +3 -0
  6. training_args.bin +2 -2
README.md CHANGED
@@ -18,7 +18,7 @@ should probably proofread and complete it, then remove this comment. -->
18
 
19
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
- - Loss: 0.8819
22
 
23
  ## Model description
24
 
@@ -46,13 +46,14 @@ The following hyperparameters were used during training:
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: constant
48
  - lr_scheduler_warmup_ratio: 0.03
49
- - training_steps: 105
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:-----:|:----:|:---------------:|
55
- | 1.683 | 1.06 | 100 | 0.8819 |
 
56
 
57
 
58
  ### Framework versions
 
18
 
19
  This model is a fine-tuned version of [mistralai/Mistral-7B-Instruct-v0.2](https://huggingface.co/mistralai/Mistral-7B-Instruct-v0.2) on an unknown dataset.
20
  It achieves the following results on the evaluation set:
21
+ - Loss: 0.7929
22
 
23
  ## Model description
24
 
 
46
  - optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
47
  - lr_scheduler_type: constant
48
  - lr_scheduler_warmup_ratio: 0.03
49
+ - num_epochs: 2
50
 
51
  ### Training results
52
 
53
  | Training Loss | Epoch | Step | Validation Loss |
54
  |:-------------:|:-----:|:----:|:---------------:|
55
+ | 2.2857 | 0.99 | 94 | 0.8537 |
56
+ | 0.8178 | 1.99 | 188 | 0.7929 |
57
 
58
 
59
  ### Framework versions
adapter_config.json CHANGED
@@ -20,8 +20,8 @@
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
- "v_proj",
24
- "q_proj"
25
  ],
26
  "task_type": "CAUSAL_LM",
27
  "use_dora": false,
 
20
  "rank_pattern": {},
21
  "revision": null,
22
  "target_modules": [
23
+ "q_proj",
24
+ "v_proj"
25
  ],
26
  "task_type": "CAUSAL_LM",
27
  "use_dora": false,
adapter_model.safetensors CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:03888f5d47e453f4d8107c56e38cc296f2da35f414aab13865c717a76cd4dc66
3
  size 13648432
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:aae052ebbd992a36adacbc304658d88b8007274dd0b41910b690e61e342202e2
3
  size 13648432
runs/Apr19_15-37-15_4cdfa69e0159/events.out.tfevents.1713541040.4cdfa69e0159.84.0 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:9782d846423ba5ad9bee5963e71b122d28e4fae8870b3745a48ac7c190a31036
3
+ size 5143
runs/Apr19_15-38-40_4cdfa69e0159/events.out.tfevents.1713541124.4cdfa69e0159.84.1 ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:b45ede0dbbcd486cc03ae7e5b661bbafb9debb3edf23132abd5bb31dca3137b1
3
+ size 6658
training_args.bin CHANGED
@@ -1,3 +1,3 @@
1
  version https://git-lfs.github.com/spec/v1
2
- oid sha256:5774b7c076211dda10fa0b5e4353632f9234a77ad7f73e330a90289d9a1a5048
3
- size 4920
 
1
  version https://git-lfs.github.com/spec/v1
2
+ oid sha256:ca1df492b2e4b478eb0d8da2ec1c95333a465d0d2d7fe1a439422b32780dd825
3
+ size 4984