feizhengcong commited on
Commit
9acfbd7
verified
1 Parent(s): cd6a116

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +14 -0
README.md CHANGED
@@ -19,6 +19,20 @@ pipeline_tag: image-to-video
19
  <a href="https://github.com/SkyworkAI/SkyReels-A1" target="_blank">馃寪 Github</a> 路 <a href="https://www.skyreels.ai/" target="_blank">馃憢 Playground</a>
20
  </p>
21
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
22
  ---
23
  This repo contains Diffusers style model weights for Skyreels A1 models.
24
  You can find the inference code on [SkyReels-A1](https://github.com/SkyworkAI/SkyReels-A1) repository.
 
19
  <a href="https://github.com/SkyworkAI/SkyReels-A1" target="_blank">馃寪 Github</a> 路 <a href="https://www.skyreels.ai/" target="_blank">馃憢 Playground</a>
20
  </p>
21
 
22
+
23
+ ---
24
+
25
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/62e34a12c9bece303d146af8/Ysbe66shplYZw2fjkFUHL.png)
26
+ Overview of SkyReels-A1 framework. Given an input video sequence and a reference portrait image, we extract facial expression-aware landmarks from the video, which serve as motion descriptors for transferring expressions onto the portrait. Utilizing a conditional video generation framework based on DiT, our approach directly integrates these facial expression-aware landmarks into the input latent space. In alignment with prior research, we employ a pose guidance mechanism constructed within a VAE architecture. This component encodes facial expression-aware landmarks as conditional input for the DiT framework, thereby enabling the model to capture essential low- dimensional visual attributes while preserving the semantic integrity of facial features.
27
+
28
+
29
+ ---
30
+ Some generated results:
31
+
32
+ <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/62e34a12c9bece303d146af8/yy5a0jGXyZH7yGC9bNHW0.mp4"></video>
33
+
34
+
35
+
36
  ---
37
  This repo contains Diffusers style model weights for Skyreels A1 models.
38
  You can find the inference code on [SkyReels-A1](https://github.com/SkyworkAI/SkyReels-A1) repository.