Read the Introducing PyTorch Fully Sharded Data Parallel (FSDP) API blog post.