End of training

README.md

@@ -0,0 +1,55 @@
+---
+license: cc-by-sa-4.0
+base_model: replit/replit-code-v1-3b
+tags:
+- generated_from_trainer
+model-index:
+- name: replit-code-v1-3b-fine-tuned-plc_V1
+  results: []
+---
+
+<!-- This model card has been generated automatically according to the information the Trainer had access to. You
+should probably proofread and complete it, then remove this comment. -->
+
+# replit-code-v1-3b-fine-tuned-plc_V1
+
+This model is a fine-tuned version of [replit/replit-code-v1-3b](https://huggingface.co/replit/replit-code-v1-3b) on an unknown dataset.
+
+## Model description
+
+More information needed
+
+## Intended uses & limitations
+
+More information needed
+
+## Training and evaluation data
+
+More information needed
+
+## Training procedure
+
+### Training hyperparameters
+
+The following hyperparameters were used during training:
+- learning_rate: 0.0002
+- train_batch_size: 1
+- eval_batch_size: 8
+- seed: 42
+- gradient_accumulation_steps: 4
+- total_train_batch_size: 4
+- optimizer: Adam with betas=(0.9,0.999) and epsilon=1e-08
+- lr_scheduler_type: linear
+- lr_scheduler_warmup_steps: 2
+- training_steps: 50
+
+### Training results
+
+
+
+### Framework versions
+
+- Transformers 4.34.0.dev0
+- Pytorch 2.1.0.dev20230823
+- Datasets 2.14.4
+- Tokenizers 0.13.3

adapter_config.json

@@ -0,0 +1,20 @@
+{
+  "auto_mapping": null,
+  "base_model_name_or_path": "replit/replit-code-v1-3b",
+  "bias": "none",
+  "fan_in_fan_out": false,
+  "inference_mode": true,
+  "init_lora_weights": true,
+  "layers_pattern": null,
+  "layers_to_transform": null,
+  "lora_alpha": 32,
+  "lora_dropout": 0.05,
+  "modules_to_save": null,
+  "peft_type": "LORA",
+  "r": 8,
+  "revision": null,
+  "target_modules": [
+    "Wqkv"
+  ],
+  "task_type": "CAUSAL_LM"
+}

adapter_model.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:1b09c5f7e131e8aabfa6f04065983ff567e171d5797365bd4b2eb902d9399885
+size 10508846

emissions.csv

@@ -0,0 +1,2 @@
+timestamp,project_name,run_id,duration,emissions,emissions_rate,cpu_power,gpu_power,ram_power,cpu_energy,gpu_energy,ram_energy,energy_consumed,country_name,country_iso_code,region,cloud_provider,cloud_region,os,python_version,codecarbon_version,cpu_count,cpu_model,gpu_count,gpu_model,longitude,latitude,ram_total_size,tracking_mode,on_cloud,pue
+2023-09-21T10:45:45,codecarbon,cdedfc7c-1e8a-461b-9f01-e790291e86d9,244.1422085762024,0.021056992750083187,8.624888286578604e-05,140.0,381.922,191.85521936416626,0.00949395245048735,0.036961464822243655,0.012974394873124784,0.05942981214585579,Germany,DEU,north rhine-westphalia,,,Windows-10-10.0.20348-SP0,3.10.9,2.2.3,128,AMD EPYC 75F3 32-Core Processor,4,4 x NVIDIA A100-SXM4-80GB,7.9092,51.5554,511.61391830444336,machine,N,1.0

special_tokens_map.json

@@ -0,0 +1,5 @@
+{
+  "eos_token": "<|endoftext|>",
+  "pad_token": "<|endoftext|>",
+  "unk_token": "<|unk|>"
+}

spiece.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7e1ba8b7df0701723d2d901c7a42182fe77bf0045173f2cdb474ca6ea3eb1c02
+size 707660

tokenizer_config.json

@@ -0,0 +1,18 @@
+{
+  "auto_map": {
+    "AutoTokenizer": [
+      "replit/replit-code-v1-3b--replit_lm_tokenizer.ReplitLMTokenizer",
+      null
+    ]
+  },
+  "bos_token": null,
+  "clean_up_tokenization_spaces": false,
+  "eos_token": "<|endoftext|>",
+  "model_max_length": 2048,
+  "pad_token": "<|pad|>",
+  "padding_side": "right",
+  "sep_token": null,
+  "sp_model_kwargs": {},
+  "tokenizer_class": "ReplitLMTokenizer",
+  "unk_token": "<|unk|>"
+}

training_args.bin

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a5a29f66de3d093a945ccce39332a473b06d5def53e0a3a770f640970a1eb961
+size 4536