jrrjrr commited on
Commit
74f2bd3
·
1 Parent(s): 8b56088

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +6 -9
README.md CHANGED
@@ -5,7 +5,7 @@ tags:
5
  - stable-diffusion
6
  - text-to-image
7
  ---
8
- # ControlNet v1.1 Models And Compatible Stable Diffusion v1.5 Type Models Converted To Apple CoreML Format
9
 
10
  ## For use with a Swift app like [**MOCHI DIFFUSION**](https://github.com/godly-devotion/MochiDiffusion) or the SwiftCLI
11
 
@@ -19,9 +19,7 @@ If you are using a GUI like [**MOCHI DIFFUSION**](https://github.com/godly-devot
19
 
20
  Please note that when you unzip the "Originl" ControlNet files (for example Canny.zip) from this repo, they will unzip into a folder, with the actual four model files inside that folder. This folder is just a holding folder for the zipping process. **What you want to move into your ControlNet model folder in Mochi Diffusion will be the individual files, not the folder they unzip into.** The "Split-Einsum" zips just have a single file and don't use a holding folder. To make things even more confusing, on some Mac systems, an individual ControlNet model file, for example Canny-5x5.mlmodelc, will appear in Finder as a folder, not a file. You want to move the Canny-5x5.mlmodelc file or folder (and other .mlmodelc files or folders) into your ControlNet store folder. Don't move the plain "Canny" folder. This is different from base models, where you do want to be moving the folder that the downloaded zip file unzips into. See the images [**here**](https://huggingface.co/jrrjrr/CoreML-Models-For-ControlNet/blob/main/CN/-Settings.jpg) and [**here**](https://huggingface.co/jrrjrr/CoreML-Models-For-ControlNet/blob/main/CN/-Folders.jpg) for an example of how my folders are set up for Mochi Diffusion.
21
 
22
- The SD models in this repo are all "Original" and built for CPU and GPU. They are each for the output size noted. They are FP-16, with the standard SD-1.5 VAE embedded. "Split-Einsum" versions that support ControlNet are currently being added. Models that support both "Original" and "Split-Einsum" will be relocated to individual model repos listed on the [**CORE ML MODELS**](https://huggingface.co/coreml) main page. The relocated models will also be linked below on this page.
23
-
24
- The full SD type (base) models remaining at this repo are in the "SD" folder of this repo. They are in subfolders by model name and individually zipped for a particular resolution. They need to be unzipped for use after downloading. The models still stored here are built only for "Original".
25
 
26
  The Stable Diffusion v1.5 model and the other SD 1.5 type models contain both the standard Unet and the ControlledUnet used for a ControlNet pipeline. The correct one will be used automatically based on whether a ControlNet is enabled or not.
27
 
@@ -29,11 +27,11 @@ They have VAEEncoder.mlmodelc bundles that allow Image2Image to operate correctl
29
 
30
  The sizes noted for all model type inputs/outputs are WIDTH x HEIGHT. A 512x768 is "portrait" orientation and a 768x512 is "landscape" orientation.
31
 
32
- There is also a "MISC" folder that has text files with some notes and a screencap of my directory structure. These are provided for those who want to convert models themselves and/or run the models with a SwiftCLI. The notes are not perfect, and may be out of date if any of the Python or CoreML packages referenced have been updated recently. You can open a Discussion here if you need help with any of the "MISC" items.
33
 
34
  For command line use, the "MISC" notes cover setting up a miniconda3 environment. If you are using the command line, please read the notes concerning naming and placement of your ControlNet model folder. Briefly, they will need to go inside a "controlnet" folder that you placed inside your base model folder. You'll need a "controlnet" folder inside each base model folder, or a symlink named "controlnet" pointing to a central folder with all your ControlNet models inside it.
35
 
36
- **If you encounter any models that do not work correctly with image2image and/or a ControlNet, using the current apple/ml-stable-diffusion SwiftCLI pipeline for i2i or CN, or Mochi Diffusion 3.2 using i2i, or Mochi Diffusion 4.0 using i2i or CN, please leave a report in the Community Discussion area. If you would like to add models that you have converted, leave a message there as well, and we will grant you access to this repo.**
37
 
38
  ## ControlNet Models - All Current SD-1.5-Type ControlNet Models
39
  Each larger zip file contains a set of 4 "Original" types at resolutions of 512x512, 512x768, 768x512 and 768x768. Each smaller zip file, with the "SE" notation, contains a single "Split-Einsum" file.
@@ -52,11 +50,10 @@ Each larger zip file contains a set of 4 "Original" types at resolutions of 512x
52
  - SoftEdge -- Find And Reuse Soft Edges
53
  - Tile -- Subtle Variations Within Batch Run
54
 
55
- ## Base Models - A Variety Of SD-1.5-Type Models For Use With ControlNet
56
- Each folder remaining at this repo contains 4 "Original" zipped model files, output sizes as indicated: 512x512, 512x768, 768x512 or 768x768
57
  - DreamShaper v5.0, 1.5-type model, "Original" & "Split-Einsum" -- Reloacted to: https://huggingface.co/coreml/coreml-DreamShaper-v5.0_cn
58
  - GhostMix v1.1, 1.5-type anime model, "Original" & "Split-Einsum" -- Relocated to: https://huggingface.co/coreml/coreml-ghostmix-v20-bakedVAE_cn
59
  - Realistic Vision v2.0, 1.5-type model, "Original" & "Split-Einsum" -- Relocated to: https://huggingface.co/coreml/coreml-realisticVision-v20_cn
60
  - MeinaMix v9.0 1.5-type anime model, "Original" & "Split-Einsum" -- Relocated to: https://huggingface.co/coreml/coreml-MeinaMix-v9_cn
61
- - MyMerge v1.0 1.5-type NSFW model, "Original"
62
  - Stable Diffusion v1.5, "Original" & "Split-Einsum" -- Relocated to: https://huggingface.co/coreml/coreml-stable-diffusion-v1-5_cn
 
5
  - stable-diffusion
6
  - text-to-image
7
  ---
8
+ # ControlNet v1.1 Models And Links To Compatible Stable Diffusion v1.5 Type Models Converted To Apple CoreML Format
9
 
10
  ## For use with a Swift app like [**MOCHI DIFFUSION**](https://github.com/godly-devotion/MochiDiffusion) or the SwiftCLI
11
 
 
19
 
20
  Please note that when you unzip the "Originl" ControlNet files (for example Canny.zip) from this repo, they will unzip into a folder, with the actual four model files inside that folder. This folder is just a holding folder for the zipping process. **What you want to move into your ControlNet model folder in Mochi Diffusion will be the individual files, not the folder they unzip into.** The "Split-Einsum" zips just have a single file and don't use a holding folder. To make things even more confusing, on some Mac systems, an individual ControlNet model file, for example Canny-5x5.mlmodelc, will appear in Finder as a folder, not a file. You want to move the Canny-5x5.mlmodelc file or folder (and other .mlmodelc files or folders) into your ControlNet store folder. Don't move the plain "Canny" folder. This is different from base models, where you do want to be moving the folder that the downloaded zip file unzips into. See the images [**here**](https://huggingface.co/jrrjrr/CoreML-Models-For-ControlNet/blob/main/CN/-Settings.jpg) and [**here**](https://huggingface.co/jrrjrr/CoreML-Models-For-ControlNet/blob/main/CN/-Folders.jpg) for an example of how my folders are set up for Mochi Diffusion.
21
 
22
+ The SD models (base models) linked at the bottom of this page were relocated from this repo to individual model repos at the [**CORE ML MODELS**](https://huggingface.co/coreml) repo. The links will take you directly to each model. They are for "Original" and "Split-Einsum".
 
 
23
 
24
  The Stable Diffusion v1.5 model and the other SD 1.5 type models contain both the standard Unet and the ControlledUnet used for a ControlNet pipeline. The correct one will be used automatically based on whether a ControlNet is enabled or not.
25
 
 
27
 
28
  The sizes noted for all model type inputs/outputs are WIDTH x HEIGHT. A 512x768 is "portrait" orientation and a 768x512 is "landscape" orientation.
29
 
30
+ There is also a "MISC" folder at this repo that has text files with some notes and a screencap of my directory structure. These are provided for those who want to convert models themselves and/or run the models with a SwiftCLI. The notes are not perfect, and may be out of date if any of the Python or CoreML packages referenced have been updated recently. You can open a Discussion here if you need help with any of the "MISC" items.
31
 
32
  For command line use, the "MISC" notes cover setting up a miniconda3 environment. If you are using the command line, please read the notes concerning naming and placement of your ControlNet model folder. Briefly, they will need to go inside a "controlnet" folder that you placed inside your base model folder. You'll need a "controlnet" folder inside each base model folder, or a symlink named "controlnet" pointing to a central folder with all your ControlNet models inside it.
33
 
34
+ **If you encounter any models in this repo that do not work correctly with ControlNet, using the current apple/ml-stable-diffusion SwiftCLI pipeline, or Mochi Diffusion 4.0, please leave a report in the Community Discussion area. If you would like to add models that you have converted, leave a message there as well, and we will grant you access to the appropriate repo.**
35
 
36
  ## ControlNet Models - All Current SD-1.5-Type ControlNet Models
37
  Each larger zip file contains a set of 4 "Original" types at resolutions of 512x512, 512x768, 768x512 and 768x768. Each smaller zip file, with the "SE" notation, contains a single "Split-Einsum" file.
 
50
  - SoftEdge -- Find And Reuse Soft Edges
51
  - Tile -- Subtle Variations Within Batch Run
52
 
53
+ ## Base Models - A Variety Of SD-1.5-Type Models Compatible With ControlNet
 
54
  - DreamShaper v5.0, 1.5-type model, "Original" & "Split-Einsum" -- Reloacted to: https://huggingface.co/coreml/coreml-DreamShaper-v5.0_cn
55
  - GhostMix v1.1, 1.5-type anime model, "Original" & "Split-Einsum" -- Relocated to: https://huggingface.co/coreml/coreml-ghostmix-v20-bakedVAE_cn
56
  - Realistic Vision v2.0, 1.5-type model, "Original" & "Split-Einsum" -- Relocated to: https://huggingface.co/coreml/coreml-realisticVision-v20_cn
57
  - MeinaMix v9.0 1.5-type anime model, "Original" & "Split-Einsum" -- Relocated to: https://huggingface.co/coreml/coreml-MeinaMix-v9_cn
58
+ - MyMerge v1.0 1.5-type NSFW model, "Original" & "Split-Einsum" -- Relocated to: https://huggingface.co/coreml/coreml-MyMerge-v1_cn
59
  - Stable Diffusion v1.5, "Original" & "Split-Einsum" -- Relocated to: https://huggingface.co/coreml/coreml-stable-diffusion-v1-5_cn