This workflow makes it very quick and simple to use a common set of settings for multiple controlnet processors. The common input parameters like prompt, number of steps, image size, etc. are all established in a simple workflow all in one region. Those settings can then be applied to one or multiple different controlnet processors by turning them on and off in any combination.
The workflow also includes an option to include up to 3 LoRAs in your image creation process, easily expandable beyond that as explained in the included notes.
Includes controlnet flows for:
Depth (Zoe)
Depth (LeReS)
Canny
HED Soft Edge Lines
The workflow makes extensive use of SetNode and GetNode to move information through settings in memory rather than node connector lines. Even with just 4 controlnet processors on the screen, the node lines were a little insane, so this cuts down on the clutter by a great deal.
In addition, by moving data through variables instead of connectors, it's easy to copy/paste entire processor groups to add your own. You won't need to draw a bunch of connectors, you can just swap out the specialized nodes for any new controlnet processor and run.
I attempted to name and display the set/get nodes clearly so the flow of information is clear for anyone who wants to tinker with it or learn from it. A series of notes across the top of the workspace will guide the user through running the flow.
How to use
You should use the ComfyUI Manager to identify any missing nodes from this workflow. If you haven't used ControlNet with Flux before, you will have some downloading to do at huggingface. The models used in this workflow as published are:
https://huggingface.co/XLabs-AI/flux-controlnet-depth-v3
https://huggingface.co/XLabs-AI/flux-controlnet-canny-v3
https://huggingface.co/XLabs-AI/flux-controlnet-hed-v3
If you work through the guides from XLabs on running these different models, you will find all the links to download any other resources needed for the process.
Description
I made several changes to make this a more general-purpose workflow for Flux image generation. Now includes plain Flux prompt-based image generation in addition to the original ControlNet workflows, plus LoRA capability.
Updates:
Added plain Flux prompt-based workflow, with no ControlNet
Unified seed value to make it easier to use the same seed for all workflows
Prompt text now supports wildcards (https://github.com/adieyal/comfyui-dynamicprompts)
Various node adjustments to make things a bit easier and clearer
FAQ
Comments (6)
i don´t know what "Controlnet_path" is. My controlnet preprocessors are in ComfyUI/Models/Controlnet but that don´t work... Please help someone
In my installation, this is the path to the flux-<whatever>-controlnet-v3.safetensors file that you need to use for each controlnet flow. There is one for depth, for canny, and for hed. My path looks like "ComfyUI/models/xlabs/controlnets". The nodes used in this workflow are from xlabs. If you create the "xlabs" directory inside your "models" directory, you can save all the controlnet files there.
I followed installation instructions from xlabs here: https://github.com/XLabs-AI/x-flux-comfyui
@darkroast175696 i thank you very much for help. If i get it to work i will post pics here...
Thanks you kindly offer good workflow! Then will this workflow apply one of 4 controllers for each out put image, but will not apply 2 or 3 controllers with each weight at same time ?
I know custom nodes which can apply multi controllers at same time for sdxl, but it cause error for flux (with flux controller model) so I hope to know correct way.
This workflow will only run one controlnet flow on an image at a time. You can turn on all the controlnets, but you will get 4 separate images with one controlnet each. It would be more like a comparison render so you could pick the best result.
I'm not sure how to pipe the output from one controlnet into the input of another with flux, but then I haven't tried. I only have a 3060 so it's possible my machine couldn't do it. The controlnet models are pretty heavy. I might give it a try if I get some time.
@darkroast175696
I see . At current I use union model, for many control nets, https://www.youtube.com/watch?v=WHuhxKk40k4&list=PL-pohOSaL8P9kLZP8tQ1K1QWdZEgwiBM0&index=14 .
It need to download Flux ControlNet Union Pro.
Though I tried to set 2 "Apply Control Net" nodes with get set node. But can not confirm if it is right ways,.
(For SDXL there was "apply multi control net" node which can apply multi control nets at once, but it cause error for Flux so I need to set 2 or 3 "apply control net" with connection)
Anyway your sample workflow was pretty useful to learn many things which I have not learned. I really thank you!