NEW 2vXpSwA7: anytest-v4 | openpose-v2_1 || abovzv: segment || bdsqlsz: canny | depth | lineart-anime | mlsdv2 | normal | normal-dsine | openpose | recolor | segment | segmentv2 | sketch | softedge | t2i-color-shuffle | tile-anime-α | tile-anime-β | tile-real || BRIA AI: bg-gen | canny | colorgrid | depth | NEW fill | openpose | recolor || CVL-Heidelberg: canny | depth || destitech: inpaint | inpaintv2 || diffusers: canny small | mid | full | depth small | mid | full | zoe || EcomXL: inpaint | softedge || Eugeoter: NEW noobai canny | depth | lineart-anime | lineart-real | mangaline | normal | scribble-pidi | scribble-hed | softedge-hed | tile | sdxl anime-canny | vidit-depth || h94: ip-adapter | ipa-vith | ipa+ | ipa+face || Hetaneko: pony canny | cannyv2 | color | depth | replicate | replicatev2 || HighCWu: canny-v3 || huchenlei: PuLID || Kataragi: canny | flatline | flatline-lora | inpaint | NEW ipa | line2color | line2color-lora | lineart | lineart-lora | NEW noob-ipa | recolor | recolor-lora | NEW rough-coating | tori29-blur | xdog-sketch || kohya-ss: real blur | canny | depth | anime blur | blur-beta | canny | depth | openpose | openposev2 | replicate | replicatev2 | scribble || PromeAI: lineart || ShermanG lineart || Stability.ai: canny | depth | recolor | revision | sketch || SargeZT: depth-16b-zoe | depth-faid-vidit | depth-zeed | depth-zoe | softedge | t2i-adapters binary | canny | color | depth | segmentation | softedge || TencentARC: canny | depth-midas | depth-zoe | lineart | openpose | recolor | sketch || TheMistoAI: mistoline | mistoline-lora || thibaud: openpose | openpose-lora || ttplanet: tile-real | tile-realv2 || NEW windsingai: pose | tile | tile-10w || xinsir: canny | cannyv2 | depth | openpose | openpose-twins | scribble | scribble-anime | tile | union | union-promax
ControlNetXL (CNXL) - A collection of Controlnet models for SDXL
(13.01.2025 - First NoobAI controlnets uploaded by Eugeoter)
(12.01.2025 - First Illustrious controlnets uploaded: windsingai-pose & -tile)
This collection strives to create a convenient download location of all currently available Controlnet models for SDXL. Please do read the version info for model specific instructions and further resources. If you are the author of one of these models and don't want it to appear here, please contact me to sort this out. The naming scheme of the files follows lllyasviel's from here https://huggingface.co/lllyasviel/sd_control_collection/tree/main.
CAUTION: The variants of controlnet models are marked as checkpoints only to make it possible to upload them all under one version, otherwise the already huge list would be even bigger. If you use downloading helpers the correct target folders are extensions/sd-webui-controlnet/models for automatic1111 and models/controlnet for forge/comfyui.
Requirements for Automatic1111: at least version 1.5.0, better upgrade to the latest version of 1.6.0. + sd-webui-controlnet extension v0.400+. Bugs or weird behaviour might occur. If you encounter any irregularities you can join us on our discord and ask for support or get in contact with the developers of Automatic1111/Controlnet via github/huggingface.
A huge thanks to all the authors, devs and contributors including but not limited to: abovzv, bdsqlsz, BRIA AI, CVL-Heidelberg, destitech, the diffusers institution, Eugeoter, h94, Hetaneko, HighCWu, huchenlei, lllyasviel, kataragi, kohya-ss, Mikubill, PromeAI, SargeZT, ShermanG, Stability.ai, TencentARC, TheMistoAI, thibaud, ttplanet, windsingai and xinsir.
Description
ColorGrid model released by BRIA AI on huggingface
https://huggingface.co/briaai/BRIA-2.3-ControlNet-ColorGrid
FAQ
Comments (13)
Thanks for this all-in-one "repo". Are you sure these are all the controlnets available?
no idea. if you find one, leave a comment :D
Cannot get the PDXL (Pony Diffusion XL) Controlnets to work in ComfyUI. Has anyone found a solution to this?
are you using the "load lllite" node from this suite https://github.com/kohya-ss/ControlNet-LLLite-ComfyUI ? you can find an example workflow there, too
@eurotaku Thank you, I'll use the "load lllite" node (which was used for the BDSQLSZ models.
Tried Hetaneko (Pony): depth, works worser than normal depth sdxl version..
Also it doesn't work on specific resolutions like 1280x720 etc. i notice that it's probably not the full version of model, it's 400mb, i am using a full version 2gb sdxl model and it's works way better. Upload to full versions of Pony models if you can please.
This "normal sdxl" that you mention, are they the diffusers (canny/depth) "full"?
@thiagojramos normal sdxl is the one default xl version. Seems work better than Pony version for me, but not perfect..
Just to clarify, are you saying you are having these results with the pony base model or are you using it with a different checkpoint?
these are controlnet lllite format models, i uploaded them like they were released by hetaneko. there are "full" controlnet models like sargezt's depth e.g., but i can only provide what's offered by the original creators obviously (well, i convert full fp32 5gb models to fp16, but that's it).
@eurotaku Thanks anyways, i just wanted to say that with "mid" "small" versions, you'll get a bad results and a lot of artifacts. I guess hetaneko just released them like that.. there is no full versions then.
@Ah_Not_The_Bees I used them with Pony Diffusion checkpoint.
@chrisss1 you can definitely see the training data bleeding through a bit when comparing it to other depth models. still it is better than nothing and, if you experience bad results for classic sdxl controlnets with a pony based checkpoint, definitely worth a try. also keep in mind that these are community created models, but at least we got quite a few to choose from.