ryan0712 commited on
Commit
748ff94
1 Parent(s): dacbafa

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +35 -0
README.md CHANGED
@@ -1,3 +1,38 @@
1
  ---
2
  license: other
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: other
3
+ language:
4
+ - en
5
  ---
6
+ ## Model Details
7
+ This is an unofficial implementation of "[AlpaGasus: Training a better Alpaca with Fewer Data.](https://github.com/Lichang-Chen/AlpaGasus)" with [LLaMA2](https://huggingface.co/meta-llama/Llama-2-13b-hf) & QLoRA! Training code is available at our [repo](https://github.com/gauss5930/AlpaGasus2-QLoRA).
8
+
9
+ - **Developed by:** [Yunsang Yoo](https://huggingface.co/ryan0712) and [Hyunwoo Ko](https://huggingface.co/Cartinoe5930)
10
+ - **Model type:** Auto-regressive model
11
+ - **Language(s):** English
12
+ - **Base Model:** [meta-llama/Llama-2-13b-hf](https://huggingface.co/meta-llama/Llama-2-13b-hf)
13
+ - **License**: Non-Commercial Creative Commons license ([CC BY-NC-4.0](https://creativecommons.org/licenses/by-nc/4.0/))
14
+
15
+
16
+
17
+ ### Benchmark Metrics
18
+ | Metric | Value |
19
+ |-----------------------|-------|
20
+ | MMLU | 55.27 |
21
+ | ARC | 61.09 |
22
+ | HellaSwag | 82.46 |
23
+ | TruthfulQA | 38.53 |
24
+ | Avg. | 59.34 |
25
+
26
+ ### Training Dataset
27
+
28
+ "StudentLLM/Alpagasus-2-13b-QLoRA-merged" used [gpt4life](https://github.com/gpt4life/alpagasus)'s gpt-3.5-turbo filtered dataset, 'alpaca_t45.json'.
29
+ Configuration of the dataset is as follows:
30
+
31
+ ### Prompt Template
32
+ ```
33
+ ### Instruction:
34
+
35
+ <prompt> (without the <>)
36
+
37
+ ### Response:
38
+ ```