trollek commited on
Commit
2e353cc
1 Parent(s): 39447a1

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +10 -1
README.md CHANGED
@@ -13,7 +13,16 @@ tags:
13
 
14
  This is a [BAdam](https://arxiv.org/abs/2404.02827 "BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models") and [LoRA+](https://arxiv.org/abs/2402.12354 "LoRA+: Efficient Low Rank Adaptation of Large Models") fine-tuned danube2 base model. It uses the ChatML template and was trained on the [SystemChat-1.1](https://huggingface.co/datasets/abacusai/SystemChat-1.1) from [Abacus.AI](https://huggingface.co/abacusai).
15
 
16
-
 
 
 
 
 
 
 
 
 
17
 
18
  ## BAdam
19
 
 
13
 
14
  This is a [BAdam](https://arxiv.org/abs/2404.02827 "BAdam: A Memory Efficient Full Parameter Optimization Method for Large Language Models") and [LoRA+](https://arxiv.org/abs/2402.12354 "LoRA+: Efficient Low Rank Adaptation of Large Models") fine-tuned danube2 base model. It uses the ChatML template and was trained on the [SystemChat-1.1](https://huggingface.co/datasets/abacusai/SystemChat-1.1) from [Abacus.AI](https://huggingface.co/abacusai).
15
 
16
+ ## Template
17
+
18
+ ```jinja
19
+ <|im_start>system
20
+ {{system}}<|im_end|>
21
+ <|im_start>user
22
+ {{instruction}}<|im_end|>
23
+ <|im_start>assistant
24
+ {{response}}<|im_end>
25
+ ```
26
 
27
  ## BAdam
28