File size: 2,980 Bytes
1ae9872
fa556b1
 
 
 
 
 
 
1ae9872
 
 
a973422
 
17a14e9
a12f521
 
15f2ccc
 
17a14e9
 
 
a12f521
8eb9ce4
3e1c3ec
17a14e9
 
 
 
15f2ccc
7f4e1be
a12f521
17a14e9
 
15f2ccc
17a14e9
7f4e1be
17a14e9
15f2ccc
17a14e9
 
1fdff79
3e1c3ec
17a14e9
 
15f2ccc
17a14e9
 
 
 
7f4e1be
 
 
1fdff79
a125be2
 
1964f63
 
 
a125be2
a12f521
 
 
 
a125be2
a12f521
 
a125be2
1fdff79
 
 
 
 
 
 
a125be2
9af3c99
a125be2
9af3c99
a12f521
9af3c99
7f4e1be
9af3c99
a12f521
9af3c99
15f2ccc
 
7f4e1be
1964f63
9af3c99
a973422
 
 
 
 
fa556b1
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
---
title: My Face Enhancement Space
emoji: 😊
colorFrom: blue
colorTo: green
sdk: gradio
sdk_version: 5.25.2
app_file: app.py
pinned: false
---

# Face Enhance
A tool for improving facial consistency and quality in AI-generated images. Dramatically enhance facial fidelity while preserving the original image's background, lighting, and composition.

<div style="text-align: center;">
  <img src="examples/elon_compare.gif" alt="Elon Comparison" width="600"/>
</div>

## Installation

### Prerequisites
- Python 3.11 or higher
- 1 GPU with 48GB VRAM
- At least 50GB of free disk space

### Setup

1. Set up your Hugging Face token:
   - Create a token at [Hugging Face](https://huggingface.co/settings/tokens)
   - Log into Hugging Face and accept their terms of service to download Flux
   - Set the following environment variables:
     ```
     export HUGGINGFACE_TOKEN=your_token_here
     export HF_HOME=/path/to/your/huggingface_cache
     ```
   - Models will be downloaded to `$HF_HOME` and symlinked to `./ComfyUI/models/`

2. Create the virtual environment:
   ```
   python -m venv venv
   source venv/bin/activate
   python -m pip install -r requirements.txt
   ```

3. Run the install script:
   ```
   python install.py
   ```

   This will
   - Install ComfyUI, custom nodes, and required dependencies to your venv
   - Download all required models (Flux.1-dev, ControlNet, text encoders, PuLID, and more)

4. Run inference on one example:

   ```
   python main.py --input examples/dany_gpt_1.png --ref examples/dany_face.jpg --out examples/dany_enhanced.png
   ```

## Running on ComfyUI

Using the ComfyUI workflows is the fastest way to get started. Run `python run_comfy.py`
- `./workflows/FaceEnhancementProd.json` for face enhancement
- `./workflows/FaceEmbedDist.json` for computing the face embedding distance


<!-- ## Configuration

Create a .env file in the project root directory with your API keys:
```
touch .env
echo "FAL_API_KEY=your_fal_api_key_here" >> .env
```

The FAL API key is used for face upscaling during preprocessing. You can get one at [fal.ai](https://fal.ai/). -->

## Gradio Demo

A simple web interface for the face enhancement workflow. 

1. Run `python gradio_demo.py`

2. Go to http://localhost:7860. You may need to enable port forwarding.

### Notes
- The script and demo run a ComfyUI server ephemerally
- Gradio demo is faster than the script because models remain loaded in memory
- All images are saved in `./ComfyUI/input/scratch/`
- Temporary files are created during processing and cleaned up afterward

### Troubleshooting

- **Out of memory errors**: If your GPU has less than 48 GB VRAM, install [Flux.1-dev at float8 precision](https://huggingface.co/Comfy-Org/flux1-dev).
- **Face detection issues**: This method works for photorealistic images of people. It may not work on cartoons, anime characters, or non-human subjects.
- **Downloading models fails**: Check your Hugging Face token has proper permissions.