NEW 2vXpSwA7: anytest-v4 | openpose-v2_1 || abovzv: segment || bdsqlsz: canny | depth | lineart-anime | mlsdv2 | normal | normal-dsine | openpose | recolor | segment | segmentv2 | sketch | softedge | t2i-color-shuffle | tile-anime-α | tile-anime-β | tile-real || BRIA AI: bg-gen | canny | colorgrid | depth | NEW fill | openpose | recolor || CVL-Heidelberg: canny | depth || destitech: inpaint | inpaintv2 || diffusers: canny small | mid | full | depth small | mid | full | zoe || EcomXL: inpaint | softedge || Eugeoter: NEW noobai canny | depth | lineart-anime | lineart-real | mangaline | normal | scribble-pidi | scribble-hed | softedge-hed | tile | sdxl anime-canny | vidit-depth || h94: ip-adapter | ipa-vith | ipa+ | ipa+face || Hetaneko: pony canny | cannyv2 | color | depth | replicate | replicatev2 || HighCWu: canny-v3 || huchenlei: PuLID || Kataragi: canny | flatline | flatline-lora | inpaint | NEW ipa | line2color | line2color-lora | lineart | lineart-lora | NEW noob-ipa | recolor | recolor-lora | NEW rough-coating | tori29-blur | xdog-sketch || kohya-ss: real blur | canny | depth | anime blur | blur-beta | canny | depth | openpose | openposev2 | replicate | replicatev2 | scribble || PromeAI: lineart || ShermanG lineart || Stability.ai: canny | depth | recolor | revision | sketch || SargeZT: depth-16b-zoe | depth-faid-vidit | depth-zeed | depth-zoe | softedge | t2i-adapters binary | canny | color | depth | segmentation | softedge || TencentARC: canny | depth-midas | depth-zoe | lineart | openpose | recolor | sketch || TheMistoAI: mistoline | mistoline-lora || thibaud: openpose | openpose-lora || ttplanet: tile-real | tile-realv2 || NEW windsingai: pose | tile | tile-10w || xinsir: canny | cannyv2 | depth | openpose | openpose-twins | scribble | scribble-anime | tile | union | union-promax
ControlNetXL (CNXL) - A collection of Controlnet models for SDXL
(13.01.2025 - First NoobAI controlnets uploaded by Eugeoter)
(12.01.2025 - First Illustrious controlnets uploaded: windsingai-pose & -tile)
This collection strives to create a convenient download location of all currently available Controlnet models for SDXL. Please do read the version info for model specific instructions and further resources. If you are the author of one of these models and don't want it to appear here, please contact me to sort this out. The naming scheme of the files follows lllyasviel's from here https://huggingface.co/lllyasviel/sd_control_collection/tree/main.
CAUTION: The variants of controlnet models are marked as checkpoints only to make it possible to upload them all under one version, otherwise the already huge list would be even bigger. If you use downloading helpers the correct target folders are extensions/sd-webui-controlnet/models for automatic1111 and models/controlnet for forge/comfyui.
Requirements for Automatic1111: at least version 1.5.0, better upgrade to the latest version of 1.6.0. + sd-webui-controlnet extension v0.400+. Bugs or weird behaviour might occur. If you encounter any irregularities you can join us on our discord and ask for support or get in contact with the developers of Automatic1111/Controlnet via github/huggingface.
A huge thanks to all the authors, devs and contributors including but not limited to: abovzv, bdsqlsz, BRIA AI, CVL-Heidelberg, destitech, the diffusers institution, Eugeoter, h94, Hetaneko, HighCWu, huchenlei, lllyasviel, kataragi, kohya-ss, Mikubill, PromeAI, SargeZT, ShermanG, Stability.ai, TencentARC, TheMistoAI, thibaud, ttplanet, windsingai and xinsir.
Description
Canny model released by BRIA AI on huggingface
FAQ
Comments (40)
How to use the kohya-ss
models on comfyui?!?
We have been trying, but we put it into a controlnetloader, and it gives an error either about invalid block dimentions, or noattributecopy.
Kohya models require the Kohya LLLite custom node
@Alespacetrip94 used that node, still nothing, its atleast not throwing an error, but its not affecting the image.https://drive.google.com/uc?id=1yIb1lifcRD1KnH0xpAq_02C_lGvxDWID
FYI, I downloaded this (openpose) model and encountered a 'NoneType' object has no attribute 'copy' error... I tried everything, updating comfy, deleting controlnet folder and installing again, etc... nothing worked... finally, I went to the huggingface page https://huggingface.co/thibaud/controlnet-openpose-sdxl-1.0/tree/main and downloaded the control-lora-openposeXL2-rank256.safetensors model and it works... so if anyone encounter this problem, this should work...😁
hm, it should be the exact same file. perhaps a corrupted download?
I've run into the same issue, but only with the lllite models (bdsqlz). The issue was they needed to use his custom lllite loader node, and then they'd work (at least with specific aspect ratios, and then break on a number of other nodes like facedetailer)
Does the SDXL model for Tile/Blur exist now？
sadly no :(
bdsqlsz. is not affecting my generations at all, heres workflow. https://drive.google.com/uc?id=15L31f5YZkoSgszwSr7_yYz57AwXBz3l2
Seems to be a weights issue. working now.
@Endless_Fantasy great :)
cool
found this densepose for sdxl
https://huggingface.co/jschoormans/controlnet-densepose-sdxl/tree/main
what preprocessor for densepose should We use for comfyui?
@Endless_Fantasy have a look at this example https://github.com/Fannovel16/comfyui_controlnet_aux/blob/main/examples/example_densepose.png
All of the bdsqlz files are broken. They pop up with a copy type of 'none' error message. I've seen this mentioned elsewhere too, there may be a workaround but using different files is an easier solution.
hm, seems i'll have to test them again, then. were you using auto1111 or comfyui (or something entirely different) to test them?
confirmed today doesnt work while using forge
@Monkellie same, nothing for SDXL works using forge besides reference and a scant few other things
Same with the new Tile Real
is there a hand model for sdxl?
some kind of solution perhaps? https://github.com/wenquanlu/HandRefiner/?tab=readme-ov-file#important-qa
bdsqlsz / heidelberg are not for SDXL thank you.
both their readme pages on huggingface clearly state that they were trained on sdxl and i also used them successfully with sdxl. so you're wrong, thank you :)
@eurotaku i tried with LLLite loader node, and it's working. thank you for sharing
bdsqlsz seem not working for me on sdxl on a1111
@zwow_aiArt really hard to troubleshoot from a distance, but you can join our discord for support :)
@eurotaku i think it works on 1024... anything larger i get error. im using forge webui.
does bdsqlsz work? open pose seem like not affecting anything.... can someone confirm this....
tried increasing controlnet weight? or other controlnet models? in general the available controlnet models for sdxl seem to be less consistent than their sd1.5 counterpart.
you can try this https://huggingface.co/lllyasviel/sd_control_collection/tree/main download the thibaud xl_openpose.safetensors 2,5gb
I am trying to use controlnetxlCNXL_sargeztT2iSegment
but getting this error:
Error occurred when executing ControlNetApply: 'NoneType' object has no attribute 'copy'
hard to say without any context, may i invite you to our discord for support with this issue? :)
same error in comfyui just trying to load the controlnet
same issue, can't load into ComfyUI's controlnet loader
have the same error message but with a different model. "controlnetxlCNXL_bdsqlszTileReal", using ApplyControlNet (Advanced) or Apply ControlNet node.
Error occurred when executing ControlNetApplyAdvanced: 'NoneType' object has no attribute 'copy' File "/app/webui/execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/webui/execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/webui/execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "/app/webui/nodes.py", line 790, in apply_controlnet c_net = control_net.copy().set_cond_hint(control_hint, strength, (start_percent, end_percent)) ^^^^^^^^^^^^^^^^
Thank you so much for your work.
Please add a new one bdsqlsz_controlllite_xl_tile_realistic.safetensors
great, thanks. added :)