abhayesian/lora-qwen3-32b-docs

LoRA Fine-tuned Qwen3-32B

This model is a LoRA fine-tuned version of Qwen2.5-32B-Instruct.

Training Details

• Training runtime: 13,587 seconds (3h 46m)
• Training samples per second: 2.208
• Final training loss: 0.664
• Epochs: 1.0
• Training steps: 1,161

Usage

from transformers import AutoModelForCausalLM, AutoTokenizer
from peft import PeftModel

base_model = AutoModelForCausalLM.from_pretrained("Qwen/Qwen2.5-32B-Instruct")
tokenizer = AutoTokenizer.from_pretrained("Qwen/Qwen2.5-32B-Instruct")
model = PeftModel.from_pretrained(base_model, "abhayesian/lora-qwen3-32b-docs")