a2ran commited on
Commit
c4ff8b6
ยท
1 Parent(s): 515fa5b

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +2 -0
README.md CHANGED
@@ -81,6 +81,8 @@ GPTeacher ํ”„๋กœ์ ํŠธ๋ฅผ ํ†ตํ•ด ์ถ”๊ตฌํ•˜๊ณ ์ž ํ•˜๋Š” ๋ชฉํ‘œ๋Š” ๋‹ค์Œ๊ณผ ๊ฐ™
81
 
82
  1. ์˜คํ”ˆ ๋ฐ์ดํ„ฐ์…‹ ์ œ๊ณต : [kullm-v2](https://huggingface.co/datasets/nlpai-lab/kullm-v2), [ko-alpaca](https://huggingface.co/datasets/beomi/KoAlpaca-v1.1a) ๋ฐ์ดํ„ฐ์…‹์˜ output์„ ๊ฐ•์˜ ํ˜•ํƒœ๋กœ ๋ณ€ํ™˜ํ•˜์—ฌ, ๊ธฐ์กด ๋ฐ์ดํ„ฐ์…‹์˜ output๊ณผ ๋”๋ถˆ์–ด extended_output ์นผ๋Ÿผ์„ ์ถ”๊ฐ€ํ•ด ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.
83
  2. PEFTmodel ํ˜น์€ ko-llama2 ๋ชจ๋ธ ์ œ๊ณต : ํ˜„์žฌ ๋ฒ„์ „์€ academic research purpose๋กœ ๋ณ€ํ˜• ๊ฐ€๋Šฅํ•œ [wizardLM](https://github.com/nlpxucan/WizardLM/tree/main)์˜ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ์ปค์Šคํ…€ ๋ฐ์ดํ„ฐ์…‹์„ ์ ์šฉํ•œ PEFTmodel ํ•™์Šต๋ฐฉ์‹์„ ํ†ตํ•ด ํŒŒ์ธํŠœ๋‹ํ•œ ๋ฒ„์ „์ž…๋‹ˆ๋‹ค. ์—ฌ๋Ÿฌ ๋ฒ„์ „ ์—…๋ฐ์ดํŠธ๋ฅผ ํ†ตํ•ด, ๋‹ค๋ฅธ ๋ชจ๋ธ๋กœ๋ถ€ํ„ฐ ํŒŒ์ธํŠœ๋‹์„ ํ•  ์ˆ˜ ์žˆ๋Š” ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ์ œ๊ณตํ•˜๊ฑฐ๋‚˜, GPTeacher-ko-llama2 ๋ชจ๋ธ์„ ์ œ์ž‘ํ•ด ์ œ๊ณตํ•˜๊ณ ์ž ํ•ฉ๋‹ˆ๋‹ค.
 
 
84
 
85
  **ํ˜„์žฌ ์‚ฌ์šฉ๋ชจ๋ธ : WizardLM-13B-v1.2**
86
 
 
81
 
82
  1. ์˜คํ”ˆ ๋ฐ์ดํ„ฐ์…‹ ์ œ๊ณต : [kullm-v2](https://huggingface.co/datasets/nlpai-lab/kullm-v2), [ko-alpaca](https://huggingface.co/datasets/beomi/KoAlpaca-v1.1a) ๋ฐ์ดํ„ฐ์…‹์˜ output์„ ๊ฐ•์˜ ํ˜•ํƒœ๋กœ ๋ณ€ํ™˜ํ•˜์—ฌ, ๊ธฐ์กด ๋ฐ์ดํ„ฐ์…‹์˜ output๊ณผ ๋”๋ถˆ์–ด extended_output ์นผ๋Ÿผ์„ ์ถ”๊ฐ€ํ•ด ์ œ๊ณตํ•ฉ๋‹ˆ๋‹ค.
83
  2. PEFTmodel ํ˜น์€ ko-llama2 ๋ชจ๋ธ ์ œ๊ณต : ํ˜„์žฌ ๋ฒ„์ „์€ academic research purpose๋กœ ๋ณ€ํ˜• ๊ฐ€๋Šฅํ•œ [wizardLM](https://github.com/nlpxucan/WizardLM/tree/main)์˜ ํŒŒ๋ผ๋ฏธํ„ฐ๋ฅผ ์ปค์Šคํ…€ ๋ฐ์ดํ„ฐ์…‹์„ ์ ์šฉํ•œ PEFTmodel ํ•™์Šต๋ฐฉ์‹์„ ํ†ตํ•ด ํŒŒ์ธํŠœ๋‹ํ•œ ๋ฒ„์ „์ž…๋‹ˆ๋‹ค. ์—ฌ๋Ÿฌ ๋ฒ„์ „ ์—…๋ฐ์ดํŠธ๋ฅผ ํ†ตํ•ด, ๋‹ค๋ฅธ ๋ชจ๋ธ๋กœ๋ถ€ํ„ฐ ํŒŒ์ธํŠœ๋‹์„ ํ•  ์ˆ˜ ์žˆ๋Š” ํ”„๋ ˆ์ž„์›Œํฌ๋ฅผ ์ œ๊ณตํ•˜๊ฑฐ๋‚˜, GPTeacher-ko-llama2 ๋ชจ๋ธ์„ ์ œ์ž‘ํ•ด ์ œ๊ณตํ•˜๊ณ ์ž ํ•ฉ๋‹ˆ๋‹ค.
84
+ 3. ํ˜„์žฌ ์ œ์ž‘์ค‘์ธ ๋ฐ์ดํ„ฐ์…‹ ์˜ˆ์‹œ : [https://huggingface.co/datasets/a2ran/ex_dataset](https://huggingface.co/datasets/a2ran/ex_dataset)
85
+
86
 
87
  **ํ˜„์žฌ ์‚ฌ์šฉ๋ชจ๋ธ : WizardLM-13B-v1.2**
88