Hugging Face's logo

thibaud
/
controlnet-sd21

Diffusers
English
art
stable diffusion
controlnet
Model card Files Community
41
controlnet-sd21 / README.md
thibaud's picture
thibaud
Update README.md (#32)
6517140
preview code
|
raw
history blame
2.5 kB
metadata
language:
  - en
license: openrail++
tags:
  - art
  - diffusers
  - stable diffusion
  - controlnet
datasets: laion/laion-art

Here's the first version of controlnet for stablediffusion 2.1 Trained on a subset of laion/laion-art

Safetensors version uploaded, only 700mb!

Canny:

<canny> 0

Depth:

<depth> 0

ZoeDepth:

<depth> 0

Hed:

<hed> 0

Scribble:

<hed> 0

OpenPose:

<hed> 0

Color:

<hed> 0

OpenPose:

<hed> 0

LineArt:

<hed> 0

Ade20K:

<hed> 0

Normal BAE:

<hed> 0

To use with Automatic1111:

  • Download the ckpt files or safetensors ones
  • Put it in extensions/sd-webui-controlnet/models
  • in settings/controlnet, change cldm_v15.yaml by cldm_v21.yaml
  • Enjoy

To use ZoeDepth:

You can use it with annotator depth/le_res but it works better with ZoeDepth Annotator. My PR is not accepted yet but you can use my fork. My fork: https://github.com/thibaudart/sd-webui-controlnet The PR: https://github.com/Mikubill/sd-webui-controlnet/pull/655#issuecomment-1481724024

Misuse, Malicious Use, and Out-of-Scope Use

The model should not be used to intentionally create or disseminate images that create hostile or alienating environments for people. This includes generating images that people would foreseeably find disturbing, distressing, or offensive; or content that propagates historical or current stereotypes.

Thanks https://huggingface.co/lllyasviel/ for the implementation and the release of 1.5 models. Thanks https://huggingface.co/p1atdev/ for the conversion script from ckpt to safetensors pruned & fp16