File size: 2,383 Bytes
ce69108
 
 
8c3b6d0
 
 
032f083
 
a724a9e
4a29385
 
e469d29
b2a49ab
4a29385
 
 
 
b2a49ab
4a29385
 
 
 
 
 
 
 
 
 
b2a49ab
4a29385
 
 
 
b2a49ab
4a29385
 
 
 
 
 
 
 
 
 
aceab73
 
 
 
 
 
 
 
 
 
 
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
---
pipeline_tag: text-to-video
---
# Locomotion - Onnx DirectML Optimized 

## Amuse 
https://www.amuse-ai.com/

## Samples 
<div align="center">
  <table width="80%">
      <tr class="image-row">
          <td style="width: 50%; height: 50px; text-align: center;">
              <video controls>
                  <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample.webm" type="video/webm">
              </video>
          </td>
          <td style="width: 50%; height: 50px; text-align: center;">
              <video controls>
                  <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample2.webm" type="video/webm">
              </video>
          </td>
      </tr>
      <tr class="text-row">
          <th>A cute happy Corgi playing in park.</th>
          <th>A cute raccoon playing guitar in the beach.</th>
      </tr>
        <tr class="image-row">
          <td style="width: 50%; height: 50px; text-align: center;">
              <video controls>
                  <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample3.webm" type="video/webm">
              </video>
          </td>
          <td style="width: 50%; height: 50px; text-align: center;">
              <video controls>
                  <source src="https://huggingface.co/TensorStack/Locomotion-amuse/resolve/main/Sample4.webm" type="video/webm">
              </video>
          </td>
      </tr>
      <tr class="text-row">
          <th>A quiet beach at dawn and the waves gently lapping.</th>
          <th>Black and white street photography of a rainy night in New York, reflections on wet pavement</th>
      </tr>
  </table>
</div>


### **Credits**  
Thanks to the developers of the following repositories, their work was instrumental in getting TextToVideo working with ONNX
- [AnimateDiff](https://huggingface.co/guoyww/animatediff)
- [AnimateLCM](https://huggingface.co/wangfuyun/AnimateLCM)
- [Tune-A-Video](https://github.com/showlab/Tune-A-Video)  
- [TemporalDiff](https://huggingface.co/CiaraRowles/TemporalDiff)  
- [GIMM-VFI](https://github.com/GSeanCDAT/GIMM-VFI)  
- [AnimateDiff-Evolved](https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved)  
- [StoryDiffusion](https://github.com/HVision-NKU/StoryDiffusion)  
- [ECCV2022-RIFE](https://github.com/hzwer/ECCV2022-RIFE)