EEVE-10.8-BOOK-v0.1 / README.md
ryanu's picture
Update README.md
624db31 verified
|
raw
history blame
411 Bytes

Book (์‚ฌํšŒ๊ณผํ•™, ๊ธฐ์ˆ ๊ณผํ•™, ์ฒ ํ•™, ๋ฒ•ํ•™, ์˜ˆ์ˆ  ๋“ฑ) - 5000๊ฐœ qlora max_seq_length=1024 num_train_epochs=3 per_device_train_batch_size=8 gradient_accumulation_steps=32, evaluation_strategy="steps" eval_steps=2000, logging_steps=25, optim="paged_adamw_8bit", learning_rate=2e-4, lr_scheduler_type="cosine", warmup_steps=10, warmup_ratio=0.05, report_to="tensorboard", weight_decay=0.01, max_steps=-1,