wladradchenko
commited on
Commit
•
55f4049
1
Parent(s):
6d3ac46
Update README.md
Browse files
README.md
CHANGED
@@ -49,42 +49,42 @@ tags:
|
|
49 |
|
50 |
Welcome to the dedicated cloud repository for Wunjo AI's neural network models. Unlock the unparalleled capabilities of neural networks with Wunjo AI. Whether you're delving into speech synthesis, crafting deepfake animations, drawing Stable Diffusion video by text prompt or video making, Wunjo AI has got you covered.
|
51 |
|
52 |
-
|
53 |
|
54 |
-
-
|
55 |
-
- **Voice Cloning:** [Models](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/tree/main/rtvc) Encoder, Vocoder and Synthesizer to cloning voice.
|
56 |
-
- **Video-to-Video by Text Prompt:** Ebsynth build for CUDA 11.8 on [Linux](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/ebsynth/ebsynth_linux_cu118) and [Windows](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/ebsynth/EbSynth-Beta-Win.zip).
|
57 |
-
- **Deepfake Animation:**
|
58 |
-
- [Model](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/faceswap.onnx) to swap faces in videos, GIFs, and photos using just a single photograph.
|
59 |
-
- [Model](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/emo2lip.pth) to change the emotions of a person in the video, with the help of a text description with Wav2lip architecture.
|
60 |
-
- **AI Retouch Tool:** Model to [remove object](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/retouch_object.pth) from video or image and model to [retouch face](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/retouch_face.pth).
|
61 |
-
- **Text Detection:** Model to detect text as [baseline](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/vgg16_baseline.pth) and [pretrined](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/resolve/main/deepfake/vgg16_east.pth) for weights
|
62 |
|
63 |
-
|
64 |
-
From voiceovers in commercials to character voicing in games, from audiobook narrations to fun deepfake projects, Wunjo AI offers endless possibilities and all is free and local on your device.
|
65 |
|
66 |
-
|
|
|
|
|
67 |
|
68 |
- **All-in-One:** A comprehensive tool catering to both your voice and visual AI needs.
|
69 |
- **User-friendly:** Designed for all, from beginners to professionals.
|
70 |
- **Privacy First:** Functions locally on your desktop, ensuring your data remains private.
|
71 |
- **Open-source & Free:** Benefit from community-driven enhancements and enjoy the app without any cost.
|
72 |
|
73 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
74 |
|
75 |
<!-- DONAT -->
|
76 |
## Support the Project
|
77 |
|
78 |
-
You can support the author of the project in the development of his creative ideas
|
79 |
|
80 |
<div align="center">
|
81 |
<table>
|
82 |
-
<tr
|
83 |
-
<th>
|
84 |
-
<th>
|
85 |
</tr>
|
86 |
<tr align="center">
|
87 |
-
<td><img src="
|
88 |
<td><img src="https://github.com/wladradchenko/wunjo.wladradchenko.ru/assets/56233697/acc80acd-0e39-4476-88db-0a10f2098e25" alt="coffee" width="250"></td>
|
89 |
</tr>
|
90 |
</table>
|
@@ -99,7 +99,7 @@ Email: [[email protected]]([email protected])
|
|
99 |
|
100 |
Project on GitHub: [https://github.com/wladradchenko/wunjo.wladradchenko.ru](https://github.com/wladradchenko/wunjo.wladradchenko.ru)
|
101 |
|
102 |
-
Web site: [
|
103 |
|
104 |
<!-- PREMISE -->
|
105 |
## Premise
|
@@ -109,9 +109,16 @@ Wunjo comes from the ancient runic alphabet and represents joy and contentment,
|
|
109 |
<!-- CREDITS -->
|
110 |
## Credits
|
111 |
|
112 |
-
|
113 |
-
|
114 |
-
|
115 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
116 |
|
117 |
<p align="right">(<a href="#top">to top</a>)</p>
|
|
|
49 |
|
50 |
Welcome to the dedicated cloud repository for Wunjo AI's neural network models. Unlock the unparalleled capabilities of neural networks with Wunjo AI. Whether you're delving into speech synthesis, crafting deepfake animations, drawing Stable Diffusion video by text prompt or video making, Wunjo AI has got you covered.
|
51 |
|
52 |
+
In <a href="https://github.com/wladradchenko/wunjo.wladradchenko.ru/releases">version 1.6</a>, Wunjo supports multiple languages for voice cloning and speech synthesis, TTS model training, real-time speech recognition, audio enhancement, a multi-language interface, and the use of the "pass" keyword in the video-to-video feature.
|
53 |
|
54 |
+
The new version 2.0 introduces a completely redesigned interface, enhanced performance, improved face swap functionality, a generator for non-existent people’s faces, and a deepfake analyzer. It also includes improvements in lip sync, content enhancement, object, text, and background removal, as well as content and component restyling using text prompts. Additionally, public links enable community creation and collaboration.
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
55 |
|
56 |
+
Future updates will reintroduce and enhance the missing audio functionalities from version 1.6, making them even better.
|
|
|
57 |
|
58 |
+
Available as both a free Community Edition and a subscription-based Professional Edition on <a href="https://wunjo.online/pricing">wunjo.online</a>, Wunjo caters to a wide range of users, from beginners to professionals, ensuring privacy by operating locally on your device.
|
59 |
+
|
60 |
+
**Why Choose Wunjo Community Edition?**
|
61 |
|
62 |
- **All-in-One:** A comprehensive tool catering to both your voice and visual AI needs.
|
63 |
- **User-friendly:** Designed for all, from beginners to professionals.
|
64 |
- **Privacy First:** Functions locally on your desktop, ensuring your data remains private.
|
65 |
- **Open-source & Free:** Benefit from community-driven enhancements and enjoy the app without any cost.
|
66 |
|
67 |
+
**Why Choose Wunjo Professional?**
|
68 |
+
|
69 |
+
- **More features:** First access to updates, additional and more advanced features.
|
70 |
+
- **Public links:** Host your own server (PC) application accessible from anywhere in the world.
|
71 |
+
- **Unlimited performance:** Process multiple tasks simultaneously to increase overall productivity.
|
72 |
+
|
73 |
+
Step into the future of AI-powered creativity with Wunjo.
|
74 |
|
75 |
<!-- DONAT -->
|
76 |
## Support the Project
|
77 |
|
78 |
+
You can support the author of the project in the development of his creative ideas on <a href="https://boosty.to/wunjo">Boosty</a> or <a href="https://wladradchenko.ru/donat">CloudTips</a>. Thanks to Boosty, you will have the opportunity to use your voice to choose which functions from the Professional version will appear in the Community Edition in new updates. There are other ways to support the development of the project, more details on [page](https://github.com/wladradchenko/wunjo.wladradchenko.ru/wiki/Support-the-Project).
|
79 |
|
80 |
<div align="center">
|
81 |
<table>
|
82 |
+
<tr>
|
83 |
+
<th>Boosty</th>
|
84 |
+
<th>CloudTips</th>
|
85 |
</tr>
|
86 |
<tr align="center">
|
87 |
+
<td><img src="example/wunjo-donate.png" alt="pizza" width="250"></td>
|
88 |
<td><img src="https://github.com/wladradchenko/wunjo.wladradchenko.ru/assets/56233697/acc80acd-0e39-4476-88db-0a10f2098e25" alt="coffee" width="250"></td>
|
89 |
</tr>
|
90 |
</table>
|
|
|
99 |
|
100 |
Project on GitHub: [https://github.com/wladradchenko/wunjo.wladradchenko.ru](https://github.com/wladradchenko/wunjo.wladradchenko.ru)
|
101 |
|
102 |
+
Web site: [wunjo.online](https://wunjo.online)
|
103 |
|
104 |
<!-- PREMISE -->
|
105 |
## Premise
|
|
|
109 |
<!-- CREDITS -->
|
110 |
## Credits
|
111 |
|
112 |
+
Wunjo is built upon the remarkable work of various open-source projects. Each integrated component reflects a commitment to improving and adapting existing technologies within the collaborative landscape of open-source development. The list below highlights the projects that have been adapted and enhanced for inclusion in Wunjo:
|
113 |
+
|
114 |
+
- **Speech Synthesis & Voice Cloning:** Adapted versions of [Tacotron 2](https://github.com/NVIDIA/tacotron2), [Waveglow](https://github.com/NVIDIA/waveglow), and improved [Real-Time Voice Cloning](https://github.com/CorentinJ/Real-Time-Voice-Cloning) with [VoiceFixer](https://github.com/haoheliu/voicefixer)
|
115 |
+
- **User Interface & Packaging:** Implementations of [Flask UI](https://github.com/ClimenteA/flaskwebgui) and [BeeWare](https://beeware.org/project/projects/tools/briefcase/)
|
116 |
+
- **Audio Processing:** Adapted [Open-Unmix](https://github.com/sigsep/open-unmix-pytorch) for audio separation
|
117 |
+
- **Facial Animation & Enhancement:** Adapted versions of [Wav2lip](https://github.com/Rudrabha/Wav2Lip), [Face Utils](https://github.com/xinntao/facexlib)
|
118 |
+
- **Image & Video Enhancement:** Adapted [Real-ESRGAN](https://github.com/xinntao/Real-ESRGAN) for superior quality enhancements
|
119 |
+
- **Video Processing & Segmentation:** Adaptations of [Segment Anything](https://github.com/facebookresearch/segment-anything), [Rerender a Video](https://github.com/williamyang1991/Rerender_A_Video), [GMFlow](https://github.com/haofeixu/gmflow), [ControlNet](https://github.com/lllyasviel/ControlNet) and upgraded [Ebsynth](https://github.com/jamriska/ebsynth)
|
120 |
+
- **AI Art Generation:** Adaptation of [Stable Diffusion](https://github.com/Stability-AI/stablediffusion) for creative video AI-driven art
|
121 |
+
|
122 |
+
I extend my deepest gratitude to the original contributors of these technologies. Their groundbreaking work has been instrumental in advancing the capabilities of Wunjo CE. For the persistent storage and versioning of the models I have personally trained, I utilize the [Hugging Face Model Storage](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru). If you're interested in contributing to Wunjo CE, especially in the area of voice cloning for new languages, please feel free to propose your models or reach out for collaboration via [GitHub Discussions](https://github.com/wladradchenko/wunjo.wladradchenko.ru/discussions) or the [Hugging Face](https://huggingface.co/wladradchenko/wunjo.wladradchenko.ru/discussions).
|
123 |
|
124 |
<p align="right">(<a href="#top">to top</a>)</p>
|