NEW 2vXpSwA7: anytest-v4 | openpose-v2_1 || abovzv: segment || bdsqlsz: canny | depth | lineart-anime | mlsdv2 | normal | normal-dsine | openpose | recolor | segment | segmentv2 | sketch | softedge | t2i-color-shuffle | tile-anime-α | tile-anime-β | tile-real || BRIA AI: bg-gen | canny | colorgrid | depth | NEW fill | openpose | recolor || CVL-Heidelberg: canny | depth || destitech: inpaint | inpaintv2 || diffusers: canny small | mid | full | depth small | mid | full | zoe || EcomXL: inpaint | softedge || Eugeoter: NEW noobai canny | depth | lineart-anime | lineart-real | mangaline | normal | scribble-pidi | scribble-hed | softedge-hed | tile | sdxl anime-canny | vidit-depth || h94: ip-adapter | ipa-vith | ipa+ | ipa+face || Hetaneko: pony canny | cannyv2 | color | depth | replicate | replicatev2 || HighCWu: canny-v3 || huchenlei: PuLID || Kataragi: canny | flatline | flatline-lora | inpaint | NEW ipa | line2color | line2color-lora | lineart | lineart-lora | NEW noob-ipa | recolor | recolor-lora | NEW rough-coating | tori29-blur | xdog-sketch || kohya-ss: real blur | canny | depth | anime blur | blur-beta | canny | depth | openpose | openposev2 | replicate | replicatev2 | scribble || PromeAI: lineart || ShermanG lineart || Stability.ai: canny | depth | recolor | revision | sketch || SargeZT: depth-16b-zoe | depth-faid-vidit | depth-zeed | depth-zoe | softedge | t2i-adapters binary | canny | color | depth | segmentation | softedge || TencentARC: canny | depth-midas | depth-zoe | lineart | openpose | recolor | sketch || TheMistoAI: mistoline | mistoline-lora || thibaud: openpose | openpose-lora || ttplanet: tile-real | tile-realv2 || NEW windsingai: pose | tile | tile-10w || xinsir: canny | cannyv2 | depth | openpose | openpose-twins | scribble | scribble-anime | tile | union | union-promax
ControlNetXL (CNXL) - A collection of Controlnet models for SDXL
(13.01.2025 - First NoobAI controlnets uploaded by Eugeoter)
(12.01.2025 - First Illustrious controlnets uploaded: windsingai-pose & -tile)
This collection strives to create a convenient download location of all currently available Controlnet models for SDXL. Please do read the version info for model specific instructions and further resources. If you are the author of one of these models and don't want it to appear here, please contact me to sort this out. The naming scheme of the files follows lllyasviel's from here https://huggingface.co/lllyasviel/sd_control_collection/tree/main.
CAUTION: The variants of controlnet models are marked as checkpoints only to make it possible to upload them all under one version, otherwise the already huge list would be even bigger. If you use downloading helpers the correct target folders are extensions/sd-webui-controlnet/models for automatic1111 and models/controlnet for forge/comfyui.
Requirements for Automatic1111: at least version 1.5.0, better upgrade to the latest version of 1.6.0. + sd-webui-controlnet extension v0.400+. Bugs or weird behaviour might occur. If you encounter any irregularities you can join us on our discord and ask for support or get in contact with the developers of Automatic1111/Controlnet via github/huggingface.
A huge thanks to all the authors, devs and contributors including but not limited to: abovzv, bdsqlsz, BRIA AI, CVL-Heidelberg, destitech, the diffusers institution, Eugeoter, h94, Hetaneko, HighCWu, huchenlei, lllyasviel, kataragi, kohya-ss, Mikubill, PromeAI, SargeZT, ShermanG, Stability.ai, TencentARC, TheMistoAI, thibaud, ttplanet, windsingai and xinsir.
Description
Tori29 Blur model released by kataragi on huggingface
FAQ
Comments (27)
Can I ask you how to install other preprocessors in ControlNet for Automatic1111, say for IP-Adapter? Or are the best ones already included in the extension? I've tried to find a location to install encoders and preprocessors with no luck.
Also, what is the best way to update Controlnet within Automatic1111 or are these posts for manual updating?
Anytest v4 is awesome. Not sure what you did here, but it works in Forge and does a great job at anything thrown at it. You can even give it a picture and it works as a pseudo image to image if you turn the strength down, while keeping the fidelity of edges intact. Things like hands keep their shape nicely most of the time. Great job. Also anyone having the "Sizes of tensors must match" problem in Forge w/ the other CNXL models, i've found that switching it to another model then switching it back to XL fixes it. I think this sets the default size back. Not sure why these models only accept a specific size but it is what it is I guess.
what is anytest v4 for?
@LindezaBlue i think its trying to be like a controlnet union model where you can throw anything at it like depth, canny, softedge etc. either way, its one of the few on this long list worth checking out and seeing if it works in your workflow
does anytest v4 contains openpose inside it?
Anyone having issues with the BDSQLSZ models? They are throwing an error saying the SafeTensor is not a valid size
RuntimeError: Sizes of tensors must match except in dimension 2. Expected size 4784 but got size 4929 for tensor number 1 in the list.I think I solved the problem. Image Dimensions needs to be multiples of 32. That seems to be unique with controllite. Other Control net Models don't care.
could someone tell wihch one is the best TILE for upscaling?
Thanks, model 2vXpSwA7 for openpose works fine with Illustrious.
Dumb question but where to do I put the files for each of the models? In controlnet folder in comfyui\models\controlnet? Or do they have seperate folders?
And any easy way to tell which does what I need it to? Realistic hands fix?
https://education.civitai.com/civitai-guide-to-controlnet/ There's download location info further down on this page. You can rename the beginning of the files to help out with which is which maybe?
Both ComfyUI and WebUI Forge both have them in models/controlnet.
I'd suggest reading/watching a basic overview of either Forge or Comfy and the features. Otherwise, you're going to struggle even if you figure this out. They're not hard to use, but they have a lot of fiddly little things you need to know.
@DetroitArtDude got it working, renaming them helped sort them out. Thanks both of you.
Please advise which tile model is currently best to use for tile-upscale on Illustrious-based models?
Dump question
Does anytest-v4
includes Openpose for sdxl ?
or i should download openpose-v2_1
im using CyberRealistic Pony v9
Would be awesome if we could get an updated animal openpose model for XL/IL. Thanks!
Hi folks. When trying to use the "bdsqlsz: segmentv2" or v1 model, I get the following error in ComfyUI (latest build): "ERROR: controlnet file is invalid and does not contain a valid controlnet model." I also tried the original files from huggingface, but got the same result. I am using an Illustrious checkpoint. Anybody else have this issue or an idea on how to solve it?
Can you recommend another one as replacement?
I have found that all of the models by that author give that error, at least when using SwarmUI. I just use different versions.
did you found a fix? I have the same error
I have low expectations of this ever being answered (I will add solution here if I ever solve this). Does anyone have a Comfy UI workflow to use any of the Inpainting controlnet models? The only model source which includes one is the destitech model - however, this model uniquely does not required a controlnet preprocessor, while all the other inpainting models do. They are all extremely simple to use via A1111 / Forge / Reforge etc but I cannot find guidance anywhere on how to correctly run inpainting controlnet models/input through preprocessor.
Where are the explanations how to use each model? Just because you link somewhere doesn't mean the page exists or provide a readme.
CNXL does not working in some xlbase model,how should i know which xlbase model can use CNXL?
@theally could you point me to tutorial about those CNs above? I cannot load some of them, nor see the guides for pony
There's an tutorial here, a bit old, but should still mostly apply! https://education.civitai.com/civitai-guide-to-controlnet/
It is stated that Kataragi-inpaint was downloaded from "https://huggingface.co/kataragi/controlnetXL_inpaint_test", but the SHA256 value is different. The HF version is 5c32ec, while this one is ccdc440d.
Does anyone know how to use "T2I-Adapter-Color Shuffle model released by bdsqlsz" in Forge webui? They say on hugging face that it's something for "controlnet-lllite" but i cant find any mentions of this inside forge, forge's controlnet integrated doesnt do anything (t2i mode)
Is it ok to use it with SD Forge integrated Controlnet ? I am getting bizzare abominations for dw_openpose_full and your model :(