Cseti commited on
Commit
32b2f3e
·
verified ·
1 Parent(s): dcf001f

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +52 -53
README.md CHANGED
@@ -7,58 +7,21 @@ language:
7
  - en
8
  ---
9
 
10
- - [Animatediff V3 motion LORAs](#animatediff-v3-motion-loras)
11
- - [File summary](#file-summary)
12
- - [General recommendations](#general-recommendations)
13
- - [Drone LORAs](#drone-loras)
14
- - [Ballerina spin LORAs](#ballerina-spin-loras)
15
- - [Walking back-view LORAs](#walking-back-view-loras)
16
  - [Animatediff V2 motion LORAs](#animatediff-v2-motion-loras)
17
- - [File summary](#file-summary-1)
18
  - [General recommendation](#general-recommendation)
19
  - [Examples](#examples)
20
  - [v2 Drone orbit right](#v2-drone-orbit-right)
21
  - [v2 Drone orbit left](#v2-drone-orbit-left)
22
  - [v2 Drone backing](#v2-drone-backing)
23
  - [v2 Drone forward](#v2-drone-forward)
24
-
25
-
26
- # Animatediff V3 motion LORAs
27
-
28
- ## File summary
29
-
30
-
31
- | Name | Compatible Motion Model | Resolution (w/h) | Frames | Comments |
32
- | ---------------------------------------------------- | ----------------------- | ---------------- | ------ | ----------------- |
33
- | 250_cseti_Drone-Rotating_3D_footage_fr16 | v3 | 384x384 (1:1) | 16 | Drone 3d rotation |
34
- | 400_cseti_9222750_drone-rot_w576_h384_fr32_r64 | v3 | 576x384 (3:2) | 32 | Drone 3d rotation |
35
- | 200_3723723_cseti_ballerina-spin_w512_h768_r64 | v3 | 512x768 (2:3) | 16 | Ballerina spin |
36
- | 250_3723723_cseti_ballerina-spin_w512_h768_r64 | v3 | 512x768 (2:3) | 16 | Ballerina spin |
37
- | 400_cseti_5294370_walk_backview-1_w576_h384_fr32_r56 | v3 | 576x384 (3:2) | 32 | Walking back view |
38
- | 450_cseti_5294370_walk_backview-1_w576_h384_fr32_r56 | v3 | 576x384 (3:2) | 32 | Walking back view |
39
-
40
-
41
- ## <b>General recommendations</b>
42
- - These are finetuned on v3 model. Does not work with v2 or animateLCM motion models
43
- - Animatediff v3 adapter lora is recommended
44
- - If you want more motion try incrasing the scale multival (e.g. to 1.2)
45
- - I recommend using the above resolutions and upscale the animation or keep at least the aspect ratios
46
-
47
- ## <b>Drone LORAs</b>
48
-
49
- - For more motion, try incrasing the LORA strength or try adding the below trigger words to your prompt
50
- - Try trigger words: dronearound, flying around
51
-
52
- ## <b>Ballerina spin LORAs</b>
53
-
54
- - Sometimes a white veil / skirt appears during rotation. Unfortunately, this is from the original video. In such cases, try a new generation or reduce the LORA strength.
55
- - I recommend using LORA strength of 0.8-0.9
56
-
57
- ## <b>Walking back-view LORAs</b>
58
- - I recommend using LORA strength of 0.8-0.9
59
- - Recommended prompts:
60
- - "back view"
61
- - "drone shot" - for an upper view
62
 
63
  # Animatediff V2 motion LORAs
64
 
@@ -70,6 +33,7 @@ language:
70
  | 280_cseti_6933991_drone-orbitleft-mv2_r64_w576_h384_fr16.safetensors | all v2, animateLCM | 576x384 (3:2) | 16 | Drone 3d rotation |
71
  | 280_cseti_6160305_drone-backing-mv2_r64_w576_h384_fr16.safetensors | all v2, animateLCM | 576x384 (3:2) | 16 | Drone shot |
72
  | 260_cseti_8890531_drone-forward-mv2_r64_w576_h384_fr16.safetensors | all v2, animateLCM | 576x384 (3:2) | 16 | Drone shot |
 
73
 
74
  ## General recommendation
75
 
@@ -84,24 +48,59 @@ language:
84
 
85
  ### v2 Drone orbit right
86
 
87
- This has been made with AnimateLCM.
88
-
89
  <video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/nolora-candidate_00001.mp4" title="Orbit right"></video>
90
 
91
  ### v2 Drone orbit left
92
 
93
- This has been made with AnimateLCM.
94
-
95
  <video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/orbitleft-candidate_00004.mp4" title="Orbit left"></video>
96
 
97
  ### v2 Drone backing
98
 
99
- This has been made with AnimateLCM.
100
-
101
  <video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/dronebacking-candidate_00019.mp4" title="Drone backing"></video>
102
 
103
  ### v2 Drone forward
104
 
105
- This has been made with AnimateLCM.
 
 
 
 
 
 
 
 
 
 
106
 
107
- <video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/droneforward-comparison_00002.mp4" title="Drone backing"></video>
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
7
  - en
8
  ---
9
 
 
 
 
 
 
 
10
  - [Animatediff V2 motion LORAs](#animatediff-v2-motion-loras)
11
+ - [File summary](#file-summary)
12
  - [General recommendation](#general-recommendation)
13
  - [Examples](#examples)
14
  - [v2 Drone orbit right](#v2-drone-orbit-right)
15
  - [v2 Drone orbit left](#v2-drone-orbit-left)
16
  - [v2 Drone backing](#v2-drone-backing)
17
  - [v2 Drone forward](#v2-drone-forward)
18
+ - [v2 Drone walking back-view](#v2-drone-walking-back-view)
19
+ - [Animatediff V3 motion LORAs](#animatediff-v3-motion-loras)
20
+ - [File summary](#file-summary-1)
21
+ - [General recommendations](#general-recommendations)
22
+ - [Drone LORAs](#drone-loras)
23
+ - [Ballerina spin LORAs](#ballerina-spin-loras)
24
+ - [Walking back-view LORAs](#walking-back-view-loras)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
25
 
26
  # Animatediff V2 motion LORAs
27
 
 
33
  | 280_cseti_6933991_drone-orbitleft-mv2_r64_w576_h384_fr16.safetensors | all v2, animateLCM | 576x384 (3:2) | 16 | Drone 3d rotation |
34
  | 280_cseti_6160305_drone-backing-mv2_r64_w576_h384_fr16.safetensors | all v2, animateLCM | 576x384 (3:2) | 16 | Drone shot |
35
  | 260_cseti_8890531_drone-forward-mv2_r64_w576_h384_fr16.safetensors | all v2, animateLCM | 576x384 (3:2) | 16 | Drone shot |
36
+ | 200_cseti_3413444_drone-walking-mv2_r64_w576_h384_fr16.safetensors | all v2, animateLCM | 576x384 (3:2) | 16 | Drone shot |
37
 
38
  ## General recommendation
39
 
 
48
 
49
  ### v2 Drone orbit right
50
 
 
 
51
  <video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/nolora-candidate_00001.mp4" title="Orbit right"></video>
52
 
53
  ### v2 Drone orbit left
54
 
 
 
55
  <video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/orbitleft-candidate_00004.mp4" title="Orbit left"></video>
56
 
57
  ### v2 Drone backing
58
 
 
 
59
  <video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/dronebacking-candidate_00019.mp4" title="Drone backing"></video>
60
 
61
  ### v2 Drone forward
62
 
63
+ <video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/droneforward-comparison_00002.mp4" title="Drone backing"></video>
64
+
65
+ ### v2 Drone walking back-view
66
+
67
+ - recommended to use words like "back-view", "from behind" in your prompts
68
+
69
+ <video controls src="https://huggingface.co/Cseti/AD_Motion_LORAs/resolve/main/candidate-comparison_00003.mp4" title="Drone walking back-view"></video>
70
+
71
+ # Animatediff V3 motion LORAs
72
+
73
+ ## File summary
74
 
75
+
76
+ | Name | Compatible Motion Model | Resolution (w/h) | Frames | Comments |
77
+ | ---------------------------------------------------- | ----------------------- | ---------------- | ------ | ----------------- |
78
+ | 250_cseti_Drone-Rotating_3D_footage_fr16 | v3 | 384x384 (1:1) | 16 | Drone 3d rotation |
79
+ | 400_cseti_9222750_drone-rot_w576_h384_fr32_r64 | v3 | 576x384 (3:2) | 32 | Drone 3d rotation |
80
+ | 200_3723723_cseti_ballerina-spin_w512_h768_r64 | v3 | 512x768 (2:3) | 16 | Ballerina spin |
81
+ | 250_3723723_cseti_ballerina-spin_w512_h768_r64 | v3 | 512x768 (2:3) | 16 | Ballerina spin |
82
+ | 400_cseti_5294370_walk_backview-1_w576_h384_fr32_r56 | v3 | 576x384 (3:2) | 32 | Walking back view |
83
+ | 450_cseti_5294370_walk_backview-1_w576_h384_fr32_r56 | v3 | 576x384 (3:2) | 32 | Walking back view |
84
+
85
+
86
+ ## <b>General recommendations</b>
87
+ - These are finetuned on v3 model. Does not work with v2 or animateLCM motion models
88
+ - Animatediff v3 adapter lora is recommended
89
+ - If you want more motion try incrasing the scale multival (e.g. to 1.2)
90
+ - I recommend using the above resolutions and upscale the animation or keep at least the aspect ratios
91
+
92
+ ## <b>Drone LORAs</b>
93
+
94
+ - For more motion, try incrasing the LORA strength or try adding the below trigger words to your prompt
95
+ - Try trigger words: dronearound, flying around
96
+
97
+ ## <b>Ballerina spin LORAs</b>
98
+
99
+ - Sometimes a white veil / skirt appears during rotation. Unfortunately, this is from the original video. In such cases, try a new generation or reduce the LORA strength.
100
+ - I recommend using LORA strength of 0.8-0.9
101
+
102
+ ## <b>Walking back-view LORAs</b>
103
+ - I recommend using LORA strength of 0.8-0.9
104
+ - Recommended prompts:
105
+ - "back view"
106
+ - "drone shot" - for an upper view