ComfyUI workflow for the Union Controlnet Pro from InstantX / Shakker Labs. Available modes: Depth / Pose / Canny / Tile / Blur / Grayscale / Low quality Instructions:<ol><li>Update ComfyUI to the latest version</li><li>Download the <a target="_blank" rel="ugc" href="https://huggingface.co/Shakker-Labs/FLUX.1-dev-ControlNet-Union-Pro">model</a> to models/controlnet</li><li>Load this workflow</li><li>Select the correct mode from the SetUnionControlNetType node (above the controlnet loader) Important: currently need to use this exact mapping to work with the new Union model:<ul><li>canny - "openpose"</li><li>tile - "depth"</li><li>depth - "hed/pidi/scribble/ted"</li><li>blur - "canny/lineart/anime_lineart/mlsd"</li><li>pose - "normal"</li><li>gray - "segment"</li><li>low quality - "tile"</li></ul> So for example, to use the depth mode you would choose "hed/pidi/scribble/ted" in the SetUnionControlNetType node.</li><li>Adjust the strength and end_percent in the ControlNetApply node to find a suitable amount of influence. The sample values in the workflow (0.4 and 0.6) are quite gentle, you may want to increase them to have a stronger influence on the image. The model developer has given a recommended range of 0.3-0.8 for strength.</li></ol> The archive also contains the openpose image used to generate the example image and the original photo the pose was extracted from. Optional: if you want to extract input information from your own images, install the "ControlNet Auxiliary Preprocessors" custom node. For openpose you can then enable the openpose extractor node (ctrl+b or right click -&gt; Bypass). Auxiliary preprocessors also include extractors for other modes such as depth and canny which you can put in place of the openpose image (remember to set the correct mode afterwards).

Files with SHA256: a583b9e67497468c37b271ab842c479098e6c801b319e8450b2c9297910d097a