Update README.md
Browse files
README.md
CHANGED
|
@@ -1,3 +1,7 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
|
| 2 |
- [maywell/Synatra-7B-v0.3-Translation](https://huggingface.co/maywell/Synatra-7B-v0.3-Translation) ๋ชจ๋ธ์ด ํ๋ก๊ทธ๋จ ์ฝ๋๊ฐ ํฌํจ๋ ์ฌ๋ฌ ์ค์ ๊ธด ํ
์คํธ๋ฅผ ๋ฒ์ญํ๋๋ฐ ์ ํ์ด ์์ด์ ํด๋น ๋ถ๋ถ์ LoRA๋ก ์ถ๊ฐ ํ์ตํ์ต๋๋ค.
|
| 3 |
|
|
@@ -12,7 +16,8 @@ model_id = "maywell/Synatra-7B-v0.3-Translation"
|
|
| 12 |
tokenizer = AutoTokenizer.from_pretrained(model_id, revision=model_revision)
|
| 13 |
model = AutoModelForCausalLM.from_pretrained(model_id, revision=model_revision, device_map=device, torch_dtype=torch.float16).eval()
|
| 14 |
|
| 15 |
-
|
|
|
|
| 16 |
|
| 17 |
|
| 18 |
def generate(prompt, *messages):
|
|
|
|
| 1 |
+
---
|
| 2 |
+
datasets:
|
| 3 |
+
- heegyu/glaive-function-calling-v2-ko-mt
|
| 4 |
+
---
|
| 5 |
|
| 6 |
- [maywell/Synatra-7B-v0.3-Translation](https://huggingface.co/maywell/Synatra-7B-v0.3-Translation) ๋ชจ๋ธ์ด ํ๋ก๊ทธ๋จ ์ฝ๋๊ฐ ํฌํจ๋ ์ฌ๋ฌ ์ค์ ๊ธด ํ
์คํธ๋ฅผ ๋ฒ์ญํ๋๋ฐ ์ ํ์ด ์์ด์ ํด๋น ๋ถ๋ถ์ LoRA๋ก ์ถ๊ฐ ํ์ตํ์ต๋๋ค.
|
| 7 |
|
|
|
|
| 16 |
tokenizer = AutoTokenizer.from_pretrained(model_id, revision=model_revision)
|
| 17 |
model = AutoModelForCausalLM.from_pretrained(model_id, revision=model_revision, device_map=device, torch_dtype=torch.float16).eval()
|
| 18 |
|
| 19 |
+
# LoRA ์ด๋ํฐ ๋ถ๋ฌ์ค๊ธฐ
|
| 20 |
+
model.load_adapter("heegyu/Synatra-7B-v0.3-Translation-glaive", revision="epoch-3")
|
| 21 |
|
| 22 |
|
| 23 |
def generate(prompt, *messages):
|