NEW 2vXpSwA7: anytest-v4 | openpose-v2_1 || abovzv: segment || bdsqlsz: canny | depth | lineart-anime | mlsdv2 | normal | normal-dsine | openpose | recolor | segment | segmentv2 | sketch | softedge | t2i-color-shuffle | tile-anime-α | tile-anime-β | tile-real || BRIA AI: bg-gen | canny | colorgrid | depth | NEW fill | openpose | recolor || CVL-Heidelberg: canny | depth || destitech: inpaint | inpaintv2 || diffusers: canny small | mid | full | depth small | mid | full | zoe || EcomXL: inpaint | softedge || Eugeoter: NEW noobai canny | depth | lineart-anime | lineart-real | mangaline | normal | scribble-pidi | scribble-hed | softedge-hed | tile | sdxl anime-canny | vidit-depth || h94: ip-adapter | ipa-vith | ipa+ | ipa+face || Hetaneko: pony canny | cannyv2 | color | depth | replicate | replicatev2 || HighCWu: canny-v3 || huchenlei: PuLID || Kataragi: canny | flatline | flatline-lora | inpaint | NEW ipa | line2color | line2color-lora | lineart | lineart-lora | NEW noob-ipa | recolor | recolor-lora | NEW rough-coating | tori29-blur | xdog-sketch || kohya-ss: real blur | canny | depth | anime blur | blur-beta | canny | depth | openpose | openposev2 | replicate | replicatev2 | scribble || PromeAI: lineart || ShermanG lineart || Stability.ai: canny | depth | recolor | revision | sketch || SargeZT: depth-16b-zoe | depth-faid-vidit | depth-zeed | depth-zoe | softedge | t2i-adapters binary | canny | color | depth | segmentation | softedge || TencentARC: canny | depth-midas | depth-zoe | lineart | openpose | recolor | sketch || TheMistoAI: mistoline | mistoline-lora || thibaud: openpose | openpose-lora || ttplanet: tile-real | tile-realv2 || NEW windsingai: pose | tile | tile-10w || xinsir: canny | cannyv2 | depth | openpose | openpose-twins | scribble | scribble-anime | tile | union | union-promax
ControlNetXL (CNXL) - A collection of Controlnet models for SDXL
(13.01.2025 - First NoobAI controlnets uploaded by Eugeoter)
(12.01.2025 - First Illustrious controlnets uploaded: windsingai-pose & -tile)
This collection strives to create a convenient download location of all currently available Controlnet models for SDXL. Please do read the version info for model specific instructions and further resources. If you are the author of one of these models and don't want it to appear here, please contact me to sort this out. The naming scheme of the files follows lllyasviel's from here https://huggingface.co/lllyasviel/sd_control_collection/tree/main.
CAUTION: The variants of controlnet models are marked as checkpoints only to make it possible to upload them all under one version, otherwise the already huge list would be even bigger. If you use downloading helpers the correct target folders are extensions/sd-webui-controlnet/models for automatic1111 and models/controlnet for forge/comfyui.
Requirements for Automatic1111: at least version 1.5.0, better upgrade to the latest version of 1.6.0. + sd-webui-controlnet extension v0.400+. Bugs or weird behaviour might occur. If you encounter any irregularities you can join us on our discord and ask for support or get in contact with the developers of Automatic1111/Controlnet via github/huggingface.
A huge thanks to all the authors, devs and contributors including but not limited to: abovzv, bdsqlsz, BRIA AI, CVL-Heidelberg, destitech, the diffusers institution, Eugeoter, h94, Hetaneko, HighCWu, huchenlei, lllyasviel, kataragi, kohya-ss, Mikubill, PromeAI, SargeZT, ShermanG, Stability.ai, TencentARC, TheMistoAI, thibaud, ttplanet, windsingai and xinsir.
Description
IP-adapter trained and released by h94 at huggingface
FAQ
Comments (15)
THANKS for crediting the authors of all those ControlNet models and for providing hyperlinks to their code repositories. This is great !
(edited from a previous message requesting this)
I have provided a link to the original release location on hugginface in every models version description
edit: in addition to that i just added that clicking on the names of the authors of these models leads to their hugging face account,
@eurotaku Perfect !
@AugmentedRealityCat i also included a thanks to all contributors in the description, the devs and testers especially did a great job the last weeks to get the extension support for all those models working.
@eurotaku I modified my message - basically changed my PLEASE into a THANKS.
As for support for ALL those models, sadly we are not there yet. There are many that will require some extra work, like the latest ones from SargeZT.
Some already work, like the Blur ones from Kohya, but would require some new pre-processor to be convenient to use. Right now you must use a third-party app (or an extension) to pre-blur the image.
But we will get there I'm sure !
@AugmentedRealityCat yeah, i uploaded all models i could find, whether they are already supported or not. i'm also very confident, they all will be eventually :)
btw, feel free to post any important news like e.g. new controlnet models here, as i'm not a regular visitor of huggingface/github.
Does anyone know if there is, or will be, a "tile" model for ControlXL? I miss being able to use Ultimate SDUpscale with ControlNet.
Yes, waiting for this one!
Kohya blur is a decent substitute while you're waiting. Been using it for a couple days now. Usually end it at 0.85, and combine it with low strength canny, but I've managed full txt2img resamples at double resolution to increase detail. Img2img upscales are fairly reliable up to high denoising strengths. The tone of the image tends to shift more than a tile resample, but it's pretty good at preserving structure and detail.
@xnihil0zer0254 I really love the blur one, that is a great new addition to the CN! Didn't think of using it that way tough, what you are describing is essentially a tile - genius! I will def try it! Thanks!
@xnihil0zer0254 My apologies for not entirely understanding... Would you mind being a little more specific about how you go about using Kohya Blur as a replacement for Tile upscaling? Thank you
@97Buckeye As I understand it, it's not a replacement so much as a stand-in-for...
The only model I wait for is inpaint+lama
Lama can be run by itself, its just a kind of preprocessor so instead of img2img with pure noise or existing image it fills with a very neutral inpaint model before inpainting. You can run it alone in https://github.com/hhhzzyang/Comfyui_Lama . You can use diffuser inpaint SDXL model with it.
@Aerilyn235 thanx, man, appreciate it!
Details
Files
controlnetxlCNXL_h94IpAdapter.bin
Mirrors
ipAdapterModelsForSDXL_ipAdapterSDXL.bin
ip-adapter_sdxl.bin
controlnetxlCNXL_h94IpAdapter.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.pth
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip_adapter.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
ip-adapter_sdxl.bin
controlnetxlCNXL_h94IpAdapter.safetensors
Mirrors
ip-adapter_sdxl.safetensors
controlnetxlCNXL_h94IpAdapter.safetensors
ip-adapter_sdxl.safetensors
controlnetxlCNXL_h94IpAdapter.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
ip-adapter_sdxl.safetensors
