NEW 2vXpSwA7: anytest-v4 | openpose-v2_1 || abovzv: segment || bdsqlsz: canny | depth | lineart-anime | mlsdv2 | normal | normal-dsine | openpose | recolor | segment | segmentv2 | sketch | softedge | t2i-color-shuffle | tile-anime-α | tile-anime-β | tile-real || BRIA AI: bg-gen | canny | colorgrid | depth | NEW fill | openpose | recolor || CVL-Heidelberg: canny | depth || destitech: inpaint | inpaintv2 || diffusers: canny small | mid | full | depth small | mid | full | zoe || EcomXL: inpaint | softedge || Eugeoter: NEW noobai canny | depth | lineart-anime | lineart-real | mangaline | normal | scribble-pidi | scribble-hed | softedge-hed | tile | sdxl anime-canny | vidit-depth || h94: ip-adapter | ipa-vith | ipa+ | ipa+face || Hetaneko: pony canny | cannyv2 | color | depth | replicate | replicatev2 || HighCWu: canny-v3 || huchenlei: PuLID || Kataragi: canny | flatline | flatline-lora | inpaint | NEW ipa | line2color | line2color-lora | lineart | lineart-lora | NEW noob-ipa | recolor | recolor-lora | NEW rough-coating | tori29-blur | xdog-sketch || kohya-ss: real blur | canny | depth | anime blur | blur-beta | canny | depth | openpose | openposev2 | replicate | replicatev2 | scribble || PromeAI: lineart || ShermanG lineart || Stability.ai: canny | depth | recolor | revision | sketch || SargeZT: depth-16b-zoe | depth-faid-vidit | depth-zeed | depth-zoe | softedge | t2i-adapters binary | canny | color | depth | segmentation | softedge || TencentARC: canny | depth-midas | depth-zoe | lineart | openpose | recolor | sketch || TheMistoAI: mistoline | mistoline-lora || thibaud: openpose | openpose-lora || ttplanet: tile-real | tile-realv2 || NEW windsingai: pose | tile | tile-10w || xinsir: canny | cannyv2 | depth | openpose | openpose-twins | scribble | scribble-anime | tile | union | union-promax
ControlNetXL (CNXL) - A collection of Controlnet models for SDXL
(13.01.2025 - First NoobAI controlnets uploaded by Eugeoter)
(12.01.2025 - First Illustrious controlnets uploaded: windsingai-pose & -tile)
This collection strives to create a convenient download location of all currently available Controlnet models for SDXL. Please do read the version info for model specific instructions and further resources. If you are the author of one of these models and don't want it to appear here, please contact me to sort this out. The naming scheme of the files follows lllyasviel's from here https://huggingface.co/lllyasviel/sd_control_collection/tree/main.
CAUTION: The variants of controlnet models are marked as checkpoints only to make it possible to upload them all under one version, otherwise the already huge list would be even bigger. If you use downloading helpers the correct target folders are extensions/sd-webui-controlnet/models for automatic1111 and models/controlnet for forge/comfyui.
Requirements for Automatic1111: at least version 1.5.0, better upgrade to the latest version of 1.6.0. + sd-webui-controlnet extension v0.400+. Bugs or weird behaviour might occur. If you encounter any irregularities you can join us on our discord and ask for support or get in contact with the developers of Automatic1111/Controlnet via github/huggingface.
A huge thanks to all the authors, devs and contributors including but not limited to: abovzv, bdsqlsz, BRIA AI, CVL-Heidelberg, destitech, the diffusers institution, Eugeoter, h94, Hetaneko, HighCWu, huchenlei, lllyasviel, kataragi, kohya-ss, Mikubill, PromeAI, SargeZT, ShermanG, Stability.ai, TencentARC, TheMistoAI, thibaud, ttplanet, windsingai and xinsir.
Description
Canny control-lora model trained and released by Stability.ai at huggingface
https://huggingface.co/stabilityai/control-lora#midas-and-clipdrop-depth
FAQ
Comments (17)
Trying to checkout the SDXL branch returns an error saying it does not exist. When I do a git branches I get main as the only one.
may i invite you to join our discord? we have a dedicated support section there :)
@eurotaku hey buddy, can you please invite me or give me the link? Been waiting for SDXL Controlnet on automatic1111 for a while now :)
@yoloswagg45 you can either reach our discord via clicking on the little discord icon found in the bottom info bar on civitai.com. it links to https://civitai.com/discord. or you can use this invite code to join: https://discord.gg/nktB6V69 (expires in 7 days)
type:
git switch sdxl
how to reset the control-net extension to the 1.5 branch? thx
with a git checkout main and a git pull you are back on the old branch.
Has anyone been able to procure or generate .yaml files for these models? Some software won't recognize these without them.
these .yaml files don't work? https://github.com/Mikubill/sd-webui-controlnet/tree/main/models
@eurotaku Hi, these .yamls are for SD 1.5 and 2.1, but I don't see any for XL. I don't think they're interchangeable.
@AnalogFlow well, they look very generic to me, so might be worth a try
@AnalogFlow Since they are safetensors you don't need yaml files. At least, my ControlNet for A1111 recognizes them
@Daedalus_7 yes, auto1111 doesn't need any config files for them (unlike with the sd 1.5 ones).
@eurotaku Hi, as of last night, Cmdr2, the Easy Diffusion developer got SDXL Controlnet working in Easy Diffusion Beta without the need for config or YAML files, so we're off to the races!
which annotator is for the revision model?
does it need one? just asking, cause i honestly don't know. original name of that model on huggingface is clip_vision_g.safetensors and i found a similarly named folder under \extensions\sd-webui-controlnet\annotator\clip_vision. is that related to your issue?
@eurotaku yes, that's it, thank you
Details
Files
controlnetxlCNXL_saiCanny.safetensors
Mirrors
control-lora-canny-rank256.safetensors
controlnetxlCNXL_saiCanny.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
sai-canny-sdxl-lora256.safetensors
sai-canny-sdxl-lora256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
control-lora-canny-rank256.safetensors
controlnetxlCNXL_saiCanny.safetensors
Mirrors
controlnetxlCNXL_saiCanny.safetensors
control-lora-canny-rank128.safetensors
controlnetxlCNXL_saiCanny_1.safetensors
control-lora-canny-rank128.safetensors
control-lora-canny-rank128.safetensors
control-lora-canny-rank128-sdxl.safetensors
control-lora-canny-rank128.safetensors
control-lora-canny-rank128.safetensors
control-lora-canny-rank128.safetensors
control-lora-canny-rank128.safetensors
control-lora-canny-rank128.safetensors
control-lora-canny-rank128.safetensors
control-lora-canny-rank128.safetensors
control-lora-canny-rank128.safetensors
control-lora-canny-rank128.safetensors
