flymin/MagicDriveDiT-stage3-40k-ft

MagicDriveDiT

📄 Paper | 🌐 Website | 📖 LICENSE | 🤖 GitHub

This repository contains the model checkpoint of the paper.

This model is fine-tuned for 10k steps with lr=1e-5 after 40k steps of training for stage-3.

Note:

• For inference/testing, we recommend the ema model, i.e., ema.pt.
• For fine-tuning, you can consider to use the training checkpoint, i.e., model/*

MagicDriveDiT: High-Resolution Long Video Generation for Autonomous Driving with Adaptive Control
Ruiyuan Gao¹, Kai Chen², Bo Xiao³, Lanqing Hong⁴, Zhenguo Li⁴, Qiang Xu^1
1CUHK ²HKUST ³Huawei Cloud ⁴Huawei Noah's Ark Lab

Please find more information on our GitHub: https://github.com/flymin/MagicDriveDiT