Update README.md
Browse files
README.md
CHANGED
@@ -19,6 +19,20 @@ pipeline_tag: image-to-video
|
|
19 |
<a href="https://github.com/SkyworkAI/SkyReels-A1" target="_blank">馃寪 Github</a> 路 <a href="https://www.skyreels.ai/" target="_blank">馃憢 Playground</a>
|
20 |
</p>
|
21 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
22 |
---
|
23 |
This repo contains Diffusers style model weights for Skyreels A1 models.
|
24 |
You can find the inference code on [SkyReels-A1](https://github.com/SkyworkAI/SkyReels-A1) repository.
|
|
|
19 |
<a href="https://github.com/SkyworkAI/SkyReels-A1" target="_blank">馃寪 Github</a> 路 <a href="https://www.skyreels.ai/" target="_blank">馃憢 Playground</a>
|
20 |
</p>
|
21 |
|
22 |
+
|
23 |
+
---
|
24 |
+
|
25 |
+

|
26 |
+
Overview of SkyReels-A1 framework. Given an input video sequence and a reference portrait image, we extract facial expression-aware landmarks from the video, which serve as motion descriptors for transferring expressions onto the portrait. Utilizing a conditional video generation framework based on DiT, our approach directly integrates these facial expression-aware landmarks into the input latent space. In alignment with prior research, we employ a pose guidance mechanism constructed within a VAE architecture. This component encodes facial expression-aware landmarks as conditional input for the DiT framework, thereby enabling the model to capture essential low- dimensional visual attributes while preserving the semantic integrity of facial features.
|
27 |
+
|
28 |
+
|
29 |
+
---
|
30 |
+
Some generated results:
|
31 |
+
|
32 |
+
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/62e34a12c9bece303d146af8/yy5a0jGXyZH7yGC9bNHW0.mp4"></video>
|
33 |
+
|
34 |
+
|
35 |
+
|
36 |
---
|
37 |
This repo contains Diffusers style model weights for Skyreels A1 models.
|
38 |
You can find the inference code on [SkyReels-A1](https://github.com/SkyworkAI/SkyReels-A1) repository.
|