Upload modeling_phi.py

#2
by tmobley96 - opened

Gradient Checkpointing for HF Trainer

acon96 updated this script for phi-2 (See comment here: https://huggingface.co/microsoft/phi-2/commit/78c707edeb2428936635019e94f568c1885ecc09).
I've done the same for dolphin-2_6-phi-2 using his same logic.

ehartford changed pull request status to merged
Your need to confirm your account before you can post a new comment.

Sign up or log in to comment