Ramikan-BR commited on
Commit
718aa9b
·
verified ·
1 Parent(s): 2660242

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +17 -1
README.md CHANGED
@@ -20,9 +20,25 @@ datasets: Ramikan-BR/data-oss_instruct-decontaminated_python.jsonl
20
  # Uploaded model
21
 
22
  - **Developed by:** Ramikan-BR
 
 
23
  - **License:** apache-2.0
24
  - **Finetuned from model :** unsloth/tinyllama-chat-bnb-4bit
25
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
26
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
27
 
28
- [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)
 
20
  # Uploaded model
21
 
22
  - **Developed by:** Ramikan-BR
23
+ - **Model type:** [text-generation/Python Coder]
24
+ - **Language(s) (NLP):** [en]
25
  - **License:** apache-2.0
26
  - **Finetuned from model :** unsloth/tinyllama-chat-bnb-4bit
27
 
28
+ ### Model Description
29
+
30
+ <!-- Provide a longer summary of what this model is. -->
31
+
32
+ ### Training Data
33
+
34
+ datasets: [Ramikan-BR/data-oss_instruct-decontaminated_python.jsonl](https://huggingface.co/datasets/Ramikan-BR/data-oss_instruct-decontaminated_python.jsonl)
35
+
36
+ ### Training Procedure
37
+
38
+ The model was refined using [Unsloath](https://github.com/unslothai/unsloth). The dataset [ise-uiuc/Magicoder-OSS-Instruct-75K](https://huggingface.co/datasets/ise-uiuc/Magicoder-OSS-Instruct-75K/blob/main/data-oss_instruct-decontaminated.jsonl) was adjusted, leaving only data on python and divided into 10 parts, each refinement occurred for 2 epochs, using adafactor optimizer or adamw_8bit (adafactor seems to deliver less loss).
39
+
40
+ This is the model card of a 🤗 transformers model that has been pushed on the Hub. This model card has been automatically generated.
41
+
42
  This llama model was trained 2x faster with [Unsloth](https://github.com/unslothai/unsloth) and Huggingface's TRL library.
43
 
44
+ [<img src="https://raw.githubusercontent.com/unslothai/unsloth/main/images/unsloth%20made%20with%20love.png" width="200"/>](https://github.com/unslothai/unsloth)