Adzka/fine-tune-sealion

README.md

@@ -14,7 +14,7 @@ should probably proofread and complete it, then remove this comment. -->
 
 # test-fine-tune
 
-This model is a fine-tuned version of [aisingapore/sea-lion-7b-instruct](https://huggingface.co/aisingapore/sea-lion-7b-instruct) on the None dataset.
+This model is a fine-tuned version of [aisingapore/sea-lion-7b-instruct](https://huggingface.co/aisingapore/sea-lion-7b-instruct) on an unknown dataset.
 
 ## Model description
 
@@ -42,7 +42,6 @@ The following `bitsandbytes` quantization config was used during training:
 - bnb_4bit_quant_type: fp4
 - bnb_4bit_use_double_quant: False
 - bnb_4bit_compute_dtype: float32
-- bnb_4bit_quant_storage: uint8
 - load_in_4bit: True
 - load_in_8bit: False
 ### Training hyperparameters
@@ -64,7 +63,7 @@ The following hyperparameters were used during training:
 ### Framework versions
 
 - PEFT 0.5.0
-- Transformers 4.39.1
+- Transformers 4.38.2
 - Pytorch 2.1.0+cu121
 - Datasets 2.14.5
 - Tokenizers 0.15.2

adapter_model.safetensors

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:fdc912eb0fbebed4a4f7e2cf9a9e07eda7877702ae054293ed532d5278f784d5
+oid sha256:c7c996e62be0b5c2920e50dd5c9e10ac5e72cc368d2b1011dad746ed41e2d234
 size 134252808

emissions.csv

@@ -34,4 +34,5 @@ timestamp,project_name,run_id,duration,emissions,emissions_rate,cpu_power,gpu_po
 2024-05-14T21:22:40,codecarbon,fd50fc76-52cb-41c6-8d83-f7e10a1209be,2084.6391439437866,0.0622577619853447,2.9865006692507737e-05,42.5,142.559,11.946327209472656,0.0246081587394078,0.0683691269525503,0.006909863098627,0.0998871487905852,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
 2024-06-19T21:29:51,codecarbon,0bca56b6-2659-4a1c-92a0-c6e90da3e5df,1301.6202783584597,0.0364717253540979,2.80202498074894e-05,42.5,135.935,11.946327209472656,0.015364900196592,0.0388382016080612,0.0043126003491071,0.0585157021537603,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
 2024-06-19T22:16:45,codecarbon,884a97dd-18e0-40d3-8f73-2737926ff23c,1443.5307438373566,0.0001452924697166,1.0065076226253145e-07,42.5,142.889,11.946327209472656,0.0170395213668545,0.0392964775070877,0.0047826828556989,0.0611186817296411,Canada,CAN,quebec,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,-71.2,46.8,31.85687255859375,machine,N,1.0
-2024-06-27T16:55:23,codecarbon,38add0ef-b79b-4797-a627-76ee7d273b92,2053.5158874988556,0.06316948734432674,3.076162581886133e-05,42.5,132.51,11.946327209472656,0.024240978744957186,0.07030325921201279,0.006805694648591187,0.10134993260556113,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
+2024-06-27T16:55:23,codecarbon,38add0ef-b79b-4797-a627-76ee7d273b92,2053.515887498856,0.0631694873443267,3.076162581886133e-05,42.5,132.51,11.946327209472656,0.0242409787449571,0.0703032592120127,0.0068056946485911,0.1013499326055611,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0
+2024-06-30T23:57:30,codecarbon,991eda8c-9f81-4920-bc52-18834f912503,1861.8210380077362,0.057915346979391755,3.1106828098453955e-05,42.5,146.591,11.946327209472656,0.021978196249571116,0.06477115777150472,0.006170768651349269,0.09292012267242505,Indonesia,IDN,west java,,,Windows-10-10.0.19045-SP0,3.11.5,2.2.3,8,12th Gen Intel(R) Core(TM) i3-12100F,1,1 x NVIDIA GeForce RTX 3060,107.6071,-6.9217,31.85687255859375,machine,N,1.0

runs/Jun30_23-26-22_DESKTOP-HH0RPGN/events.out.tfevents.1719764788.DESKTOP-HH0RPGN.13468.0

@@ -1,3 +1,3 @@
 version https://git-lfs.github.com/spec/v1
-oid sha256:75152a88a27ded6a6b40b28430b91baec1f7812378ffb70f06e7e6492d299834
-size 6391
+oid sha256:d38b3d601ec70febab0b8aa17478dfd1b69cddbf7e0215b93af68df0fb82cde3
+size 6745