sarthak247 's Collections

Qwen2.5-3B-GRPO

Trained with unsloth on just 250 steps (resource constraints) on GSM8K to add reasoning abilities to Qwen2.5-3B (smaller model because resources)