wladradchenko commited on
Commit
55f4049
1 Parent(s): 6d3ac46

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +30 -23
README.md CHANGED
@@ -49,42 +49,42 @@ tags:
49
 
50
  Welcome to the dedicated cloud repository for Wunjo AI's neural network models. Unlock the unparalleled capabilities of neural networks with Wunjo AI. Whether you're delving into speech synthesis, crafting deepfake animations, drawing Stable Diffusion video by text prompt or video making, Wunjo AI has got you covered.
51
 
52
- **What is stored in this repository?**
53
 
54
- - **Speech Synthesis:** [Models](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/tree/main/voice) Tacotron2 and Waveglow to speech synthesis.
55
- - **Voice Cloning:** [Models](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/tree/main/rtvc) Encoder, Vocoder and Synthesizer to cloning voice.
56
- - **Video-to-Video by Text Prompt:** Ebsynth build for CUDA 11.8 on [Linux](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/ebsynth/ebsynth_linux_cu118) and [Windows](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/ebsynth/EbSynth-Beta-Win.zip).
57
- - **Deepfake Animation:**
58
- - [Model](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/faceswap.onnx) to swap faces in videos, GIFs, and photos using just a single photograph.
59
- - [Model](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/emo2lip.pth) to change the emotions of a person in the video, with the help of a text description with Wav2lip architecture.
60
- - **AI Retouch Tool:** Model to [remove object](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/retouch_object.pth) from video or image and model to [retouch face](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/retouch_face.pth).
61
- - **Text Detection:** Model to detect text as [baseline](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/vgg16_baseline.pth) and [pretrined](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/vgg16_east.pth) for weights
62
 
63
- **Applications:**
64
- From voiceovers in commercials to character voicing in games, from audiobook narrations to fun deepfake projects, Wunjo AI offers endless possibilities and all is free and local on your device.
65
 
66
- **Why Choose Wunjo AI?:**
 
 
67
 
68
  - **All-in-One:** A comprehensive tool catering to both your voice and visual AI needs.
69
  - **User-friendly:** Designed for all, from beginners to professionals.
70
  - **Privacy First:** Functions locally on your desktop, ensuring your data remains private.
71
  - **Open-source & Free:** Benefit from community-driven enhancements and enjoy the app without any cost.
72
 
73
- Step into the future of AI-powered creativity with Wunjo AI.
 
 
 
 
 
 
74
 
75
  <!-- DONAT -->
76
  ## Support the Project
77
 
78
- You can support the author of the project in the development of his creative ideas, or just treat him to [a cup of coffee](https://www.buymeacoffee.com/wladradchenko) in USD or [a slice of pizza](https://wladradchenko.ru/donat) in RUB. There are other ways to support the development of the project, more details on [page](https://github.com/wladradchenko/wunjo.wladradchenko.ru/wiki/Support-the-Project).
79
 
80
  <div align="center">
81
  <table>
82
- <tr align="center">
83
- <th>Buy a cup of coffee in USD</th>
84
- <th>Buy a slice of pizza in RUB</th>
85
  </tr>
86
  <tr align="center">
87
- <td><img src="https://github.com/wladradchenko/wunjo.wladradchenko.ru/assets/56233697/bc6eefa2-705f-4307-89fd-85d96ec29917" alt="pizza" width="250"></td>
88
  <td><img src="https://github.com/wladradchenko/wunjo.wladradchenko.ru/assets/56233697/acc80acd-0e39-4476-88db-0a10f2098e25" alt="coffee" width="250"></td>
89
  </tr>
90
  </table>
@@ -99,7 +99,7 @@ Email: [[email protected]]([email protected])
99
 
100
  Project on GitHub: [https://github.com/wladradchenko/wunjo.wladradchenko.ru](https://github.com/wladradchenko/wunjo.wladradchenko.ru)
101
 
102
- Web site: [wladradchenko.ru/wunjo](https://wladradchenko.ru/wunjo)
103
 
104
  <!-- PREMISE -->
105
  ## Premise
@@ -109,9 +109,16 @@ Wunjo comes from the ancient runic alphabet and represents joy and contentment,
109
  <!-- CREDITS -->
110
  ## Credits
111
 
112
- * [Tacatron 2](https://github.com/NVIDIA/tacotron2)
113
- * [Waveglow](https://github.com/NVIDIA/waveglow)
114
- * [Real-Time Voice Cloning](https://github.com/CorentinJ/Real-Time-Voice-Cloning)
115
- * [Ebsynth](https://github.com/SingleZombie/ebsynth/tree/02ec8c4e4d4a568057363ae8b8f8bb8f7e4898c2)
 
 
 
 
 
 
 
116
 
117
  <p align="right">(<a href="#top">to top</a>)</p>
 
49
 
50
  Welcome to the dedicated cloud repository for Wunjo AI's neural network models. Unlock the unparalleled capabilities of neural networks with Wunjo AI. Whether you're delving into speech synthesis, crafting deepfake animations, drawing Stable Diffusion video by text prompt or video making, Wunjo AI has got you covered.
51
 
52
+ In <a href="https://github.com/wladradchenko/wunjo.wladradchenko.ru/releases">version 1.6</a>, Wunjo supports multiple languages for voice cloning and speech synthesis, TTS model training, real-time speech recognition, audio enhancement, a multi-language interface, and the use of the "pass" keyword in the video-to-video feature.
53
 
54
+ The new version 2.0 introduces a completely redesigned interface, enhanced performance, improved face swap functionality, a generator for non-existent people’s faces, and a deepfake analyzer. It also includes improvements in lip sync, content enhancement, object, text, and background removal, as well as content and component restyling using text prompts. Additionally, public links enable community creation and collaboration.
 
 
 
 
 
 
 
55
 
56
+ Future updates will reintroduce and enhance the missing audio functionalities from version 1.6, making them even better.
 
57
 
58
+ Available as both a free Community Edition and a subscription-based Professional Edition on <a href="https://wunjo.online/pricing">wunjo.online</a>, Wunjo caters to a wide range of users, from beginners to professionals, ensuring privacy by operating locally on your device.
59
+
60
+ **Why Choose Wunjo Community Edition?**
61
 
62
  - **All-in-One:** A comprehensive tool catering to both your voice and visual AI needs.
63
  - **User-friendly:** Designed for all, from beginners to professionals.
64
  - **Privacy First:** Functions locally on your desktop, ensuring your data remains private.
65
  - **Open-source & Free:** Benefit from community-driven enhancements and enjoy the app without any cost.
66
 
67
+ **Why Choose Wunjo Professional?**
68
+
69
+ - **More features:** First access to updates, additional and more advanced features.
70
+ - **Public links:** Host your own server (PC) application accessible from anywhere in the world.
71
+ - **Unlimited performance:** Process multiple tasks simultaneously to increase overall productivity.
72
+
73
+ Step into the future of AI-powered creativity with Wunjo.
74
 
75
  <!-- DONAT -->
76
  ## Support the Project
77
 
78
+ You can support the author of the project in the development of his creative ideas on <a href="https://boosty.to/wunjo">Boosty</a> or <a href="https://wladradchenko.ru/donat">CloudTips</a>. Thanks to Boosty, you will have the opportunity to use your voice to choose which functions from the Professional version will appear in the Community Edition in new updates. There are other ways to support the development of the project, more details on [page](https://github.com/wladradchenko/wunjo.wladradchenko.ru/wiki/Support-the-Project).
79
 
80
  <div align="center">
81
  <table>
82
+ <tr>
83
+ <th>Boosty</th>
84
+ <th>CloudTips</th>
85
  </tr>
86
  <tr align="center">
87
+ <td><img src="example/wunjo-donate.png" alt="pizza" width="250"></td>
88
  <td><img src="https://github.com/wladradchenko/wunjo.wladradchenko.ru/assets/56233697/acc80acd-0e39-4476-88db-0a10f2098e25" alt="coffee" width="250"></td>
89
  </tr>
90
  </table>
 
99
 
100
  Project on GitHub: [https://github.com/wladradchenko/wunjo.wladradchenko.ru](https://github.com/wladradchenko/wunjo.wladradchenko.ru)
101
 
102
+ Web site: [wunjo.online](https://wunjo.online)
103
 
104
  <!-- PREMISE -->
105
  ## Premise
 
109
  <!-- CREDITS -->
110
  ## Credits
111
 
112
+ Wunjo is built upon the remarkable work of various open-source projects. Each integrated component reflects a commitment to improving and adapting existing technologies within the collaborative landscape of open-source development. The list below highlights the projects that have been adapted and enhanced for inclusion in Wunjo:
113
+
114
+ - **Speech Synthesis & Voice Cloning:** Adapted versions of [Tacotron 2](https://github.com/NVIDIA/tacotron2), [Waveglow](https://github.com/NVIDIA/waveglow), and improved [Real-Time Voice Cloning](https://github.com/CorentinJ/Real-Time-Voice-Cloning) with [VoiceFixer](https://github.com/haoheliu/voicefixer)
115
+ - **User Interface & Packaging:** Implementations of [Flask UI](https://github.com/ClimenteA/flaskwebgui) and [BeeWare](https://beeware.org/project/projects/tools/briefcase/)
116
+ - **Audio Processing:** Adapted [Open-Unmix](https://github.com/sigsep/open-unmix-pytorch) for audio separation
117
+ - **Facial Animation & Enhancement:** Adapted versions of [Wav2lip](https://github.com/Rudrabha/Wav2Lip), [Face Utils](https://github.com/xinntao/facexlib)
118
+ - **Image & Video Enhancement:** Adapted [Real-ESRGAN](https://github.com/xinntao/Real-ESRGAN) for superior quality enhancements
119
+ - **Video Processing & Segmentation:** Adaptations of [Segment Anything](https://github.com/facebookresearch/segment-anything), [Rerender a Video](https://github.com/williamyang1991/Rerender_A_Video), [GMFlow](https://github.com/haofeixu/gmflow), [ControlNet](https://github.com/lllyasviel/ControlNet) and upgraded [Ebsynth](https://github.com/jamriska/ebsynth)
120
+ - **AI Art Generation:** Adaptation of [Stable Diffusion](https://github.com/Stability-AI/stablediffusion) for creative video AI-driven art
121
+
122
+ I extend my deepest gratitude to the original contributors of these technologies. Their groundbreaking work has been instrumental in advancing the capabilities of Wunjo CE. For the persistent storage and versioning of the models I have personally trained, I utilize the [Hugging Face Model Storage](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru). If you're interested in contributing to Wunjo CE, especially in the area of voice cloning for new languages, please feel free to propose your models or reach out for collaboration via [GitHub Discussions](https://github.com/wladradchenko/wunjo.wladradchenko.ru/discussions) or the [Hugging Face](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/discussions).
123
 
124
  <p align="right">(<a href="#top">to top</a>)</p>