Hugging Face's logo

thibaud
/
controlnet-sd21

Diffusers
English
art
stable diffusion
controlnet
Model card Files Community
41
controlnet-sd21
File size: 2,502 Bytes 
8bf87de
 
 
099ed23
8bf87de
 
 
 
36b26b9
099ed23
8bf87de
4552dfc
 
2259ab6
8f48b5d
 
4552dfc
 
2259ab6
4552dfc
 
2259ab6
05fb976
 
 
a9865ae
 
 
649b5ff
 
 
7326808
 
 
ad2a44f
 
 
6517140
 
 
 
 
 
 
 
 
 
 
 
4552dfc
05fb976
963c772
 
 
 
05fb976
 
 
 
963c772
4552dfc
 
 
 
8bbf281
8f48b5d
 
 
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
 
---
language:
- en
license: openrail++
tags:
- art
- diffusers
- stable diffusion
- controlnet
datasets: laion/laion-art
---
Here's the first version of controlnet for stablediffusion 2.1
Trained on a subset of laion/laion-art

### Safetensors version uploaded, only 700mb!

### Canny:
![<canny> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_canny.png)

### Depth:
![<depth> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_depth.png)

### ZoeDepth:
![<depth> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_zoedepth.png)

### Hed:
![<hed> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_hed.png)

### Scribble:
![<hed> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_scribble.png)

### OpenPose:
![<hed> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_openpose.png)

### Color:
![<hed> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_color.png)

### OpenPose:
![<hed> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_openposev2.png)

### LineArt:
![<hed> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_lineart.png)

### Ade20K:
![<hed> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_ade20k.png)

### Normal BAE:
![<hed> 0](https://huggingface.co/thibaud/controlnet-sd21/resolve/main/example_normalbae.png)

### To use with Automatic1111:
* Download the ckpt files or safetensors ones
* Put it in extensions/sd-webui-controlnet/models
* in settings/controlnet, change cldm_v15.yaml by cldm_v21.yaml
* Enjoy

### To use ZoeDepth:
You can use it with annotator depth/le_res but it works better with ZoeDepth Annotator. My PR is not accepted yet but you can use my fork.
My fork: https://github.com/thibaudart/sd-webui-controlnet 
The PR: https://github.com/Mikubill/sd-webui-controlnet/pull/655#issuecomment-1481724024

### Misuse, Malicious Use, and Out-of-Scope Use

The model should not be used to intentionally create or disseminate images that create hostile or alienating environments for people. This includes generating images that people would foreseeably find disturbing, distressing, or offensive; or content that propagates historical or current stereotypes.


Thanks https://huggingface.co/lllyasviel/ for the implementation and the release of 1.5 models.
Thanks https://huggingface.co/p1atdev/ for the conversion script from ckpt to safetensors pruned & fp16