Hello there and thanks for checking out this workflow!
What's new in v27? : Major rework with new SubGraphs to streamline and compact the workflow even more, removal of outdated/broken nodes + fixes and optimizations all over!
—Purpose—
Built to provide an advanced, versatile and modular workflow for Flux with focus on efficiency, structure and information.
It comes with many notes explaining node settings and recommendations, as well as general guides from instructions to troubleshooting.
—Features—
Convenient loaders for all common versions of Flux and Clip models
Full metadata; recognized by CivitAI
LoRA support
SageAttention, EasyCache + Model Compile acceleration
ControlNet with Union support
Flux Tools LoRAs Canny + Depth (alt. to CNet based on LoRA)
Flux Redux (similar to IPAdapter)
PuLID (SVDQuant version only)
Wildcard prompting
Installation and download guide for models and nodes
multiple passes with optional upscales
— 1st : Detail Daemon + Variation Seed
— 2nd : DD. + Tiled Diffusion / UltimateSDUpscale
— ADetailer with dedicated LoRA Loader
— Inpainting
—Custom Nodes—
ComfyUI-nunchaku — SVDQuant version only
All of which can be installed through the ComfyUI-Manager
—Troubleshooting—
If nodes show up red (failing to load), check the 'Install Missing Custom Nodes' tab of the ComfyUI Manager for the missing node packs and install them.
Please check if all custom node packs load properly after installing, i.e. no
(IMPORT FAILED)messages next to any of them in the console upon ComfyUI startup.Always reload/drag'n'drop the original, downloaded workflow file into ComfyUI to reload an intact version of the workflow.
→ The last opened workflow that appears on startup shows a cached version of the workflow, "remembering" group nodes that failed due to missing nodes as failed, keeping them broken even after having everything installed correctly.
—Thanks—
The workflow would not be possible as is without these custom node packs. If you want to support the custom node creators, give them a ⭐ on their github repos! Thank you!
Feel free to ask questions, share improvements and suggestions in the comment section!
Let me know if you encounter confusing points I can elaborate on in the next update!
Description
v10
— addition of .gguf clip model support
— addition of ADetailer Pass
— addition of Inpainting option
— introduction of display options to show stats beneath previews
v10.1
— rework of data handling
— replacement of LoRA strength node with one that allows negative values
v10.2
— changed inpainting pass saving to work like the other passes
v10.3
— added additional saving option in case of the metadata one not working properly
FAQ
Comments (11)
No image is saved once workflow is done running. Also no issues were there till v7 in version v8, v9, v10 have to setup LORAs to avoid none error.
Hey there! Thank you for reporting this, I uploaded a version with a temporary saving option that does not take metadata, but should help out with saving at least.
About the LoRA having to be loaded in. I had to use a "Load Lora (model only" node within the Loader group node, which requires the loras to exist and can not be muted like the rgthree lora power loader could, when that was still handled externally in v7.
Sorry for the inconvenience!
If you could provide log data or further information about your system I might be able to find out why that metadata saving node is not working correctly for some people. I personally never ran into any issues with it, so I am still in the dark about potential causes.
Still not working for me, also I am only assigning gguf checkpoint. Here are the logs:
got prompt
Failed to validate prompt for output 5007:
* UNETLoader 5149:11:
- Value not in list: unet_name: '-EXAMPLE-MODEL-.safetensors' not in ['Flux\\flux1-dev-fp8.safetensors']
* CheckpointLoaderSimple 5149:3:
- Value not in list: ckpt_name: '-EXAMPLE-MODEL-.safetensors' not in ['Flux\\flux1-dev-bnb-nf4-v2.safetensors', 'sd15\\cyberrealistic_v50-inpainting.safetensors', 'sd15\\cyberrealistic_v50.safetensors', 'sd15\\cyberrealistic_v60.safetensors', 'sdxl\\Realism\\cyberrealisticXL_v22.safetensors', 'sdxl\\Realism\\juggernautXL_juggXIByRundiffusion.safetensors', 'sdxl\\Realism\\zavychromaxl_v100.safetensors']
Output will be ignored
Failed to validate prompt for output 7567:0:
* (prompt):
- Return type mismatch between linked nodes: anything, MODEL != *
* Anything Everywhere? 7567:0:
- Return type mismatch between linked nodes: anything, MODEL != *
Output will be ignored
Failed to validate prompt for output 7567:2:
* (prompt):
- Return type mismatch between linked nodes: anything, VAE != *
* Anything Everywhere? 7567:2:
- Return type mismatch between linked nodes: anything, VAE != *
Output will be ignored
Failed to validate prompt for output 5011:
Output will be ignored
Failed to validate prompt for output 5009:
Output will be ignored
Failed to validate prompt for output 4490:
Output will be ignored
Failed to validate prompt for output 3317:0:
* (prompt):
- Return type mismatch between linked nodes: anything, INT != *
* Anything Everywhere? 3317:0:
- Return type mismatch between linked nodes: anything, INT != *
Output will be ignored
Failed to validate prompt for output 7563:1:
* (prompt):
- Return type mismatch between linked nodes: anything, DICT != *
* Anything Everywhere? 7563:1:
- Return type mismatch between linked nodes: anything, DICT != *
Output will be ignored
Failed to validate prompt for output 7504:3:
Output will be ignored
Failed to validate prompt for output 7567:1:
* (prompt):
- Return type mismatch between linked nodes: anything, CLIP != *
* Anything Everywhere? 7567:1:
- Return type mismatch between linked nodes: anything, CLIP != *
Output will be ignored
Failed to validate prompt for output 7609:
Output will be ignored
Failed to validate prompt for output 13:
Output will be ignored
Failed to validate prompt for output 6308:
Output will be ignored
Failed to validate prompt for output 7617:
Output will be ignored
Failed to validate prompt for output 5006:
Output will be ignored
Failed to validate prompt for output 7567:4:
* (prompt):
- Return type mismatch between linked nodes: anything, INT != *
* Anything Everywhere? 7567:4:
- Return type mismatch between linked nodes: anything, INT != *
Output will be ignored
Failed to validate prompt for output 4486:
Output will be ignored
Failed to validate prompt for output 5005:
Output will be ignored
Failed to validate prompt for output 5455:
Output will be ignored
Failed to validate prompt for output 5010:
Output will be ignored
Failed to validate prompt for output 7556:1:
Output will be ignored
Failed to validate prompt for output 7563:0:
* (prompt):
- Return type mismatch between linked nodes: anything, CONDITIONING != *
* Anything Everywhere? 7563:0:
- Return type mismatch between linked nodes: anything, CONDITIONING != *
Output will be ignored
Failed to validate prompt for output 7561:1:
Output will be ignored
Failed to validate prompt for output 7567:6:
* (prompt):
- Return type mismatch between linked nodes: anything, DICT != *
* Anything Everywhere? 7567:6:
- Return type mismatch between linked nodes: anything, DICT != *
Output will be ignored
Failed to validate prompt for output 3317:1:
* (prompt):
- Return type mismatch between linked nodes: anything, STRING != *
* Anything Everywhere? 3317:1:
- Return type mismatch between linked nodes: anything, STRING != *
Output will be ignored
Failed to validate prompt for output 7561:19:
Output will be ignored
Failed to validate prompt for output 7608:
Output will be ignored
Failed to validate prompt for output 7567:5:
* (prompt):
- Return type mismatch between linked nodes: anything, INT != *
* Anything Everywhere? 7567:5:
- Return type mismatch between linked nodes: anything, INT != *
Output will be ignored
Failed to validate prompt for output 7556:19:
Output will be ignored
Failed to validate prompt for output 7567:3:
* (prompt):
- Return type mismatch between linked nodes: anything, LATENT != *
* Anything Everywhere? 7567:3:
- Return type mismatch between linked nodes: anything, LATENT != *
Output will be ignored
Failed to validate prompt for output 5008:
Output will be ignored
Failed to validate prompt for output 7563:2:
* (prompt):
- Return type mismatch between linked nodes: anything, STRING != *
* Anything Everywhere? 7563:2:
- Return type mismatch between linked nodes: anything, STRING != *
Output will be ignored
model weight dtype torch.bfloat16, manual cast: None
model_type FLUX
Using pytorch attention in VAE
Using pytorch attention in VAE
model weight dtype torch.bfloat16, manual cast: None
model_type FLUX
Flux\flux1-dev-Q4_K_S.gguf
ggml_sd_loader:
0 471
12 304
1 5
model weight dtype torch.bfloat16, manual cast: None
model_type FLUX
WAS Node Suite: Wildcard Path: C:\Github\ComfyUI_windows_portable\ComfyUI\custom_nodes\was-node-suite-comfyui\wildcards
WAS Node Suite: CLIPTextEncode Prased Prompt:
cartoon illustration of a red frog getting squashed by a toy car
Requested to load FluxClipModel_
Loading 1 new model
loaded completely 0.0 3376.30810546875 True
Requested to load Flux
Loading 1 new model
loaded completely 0.0 6490.570556640625 True
100%|████████████████████████████████████████████████████████████████████████████████████| 6/6 [00:12<00:00, 2.04s/it]
100%|██████████████████████████████████████████████████████████████████████████████████| 10/10 [00:18<00:00, 1.80s/it]
Requested to load AutoencodingEngine
Loading 1 new model
loaded completely 0.0 159.87335777282715 True
Prompt executed in 185.42 seconds
@blue_zima_blue Every single -EXAMPLE-... selection has to be switched out for some actually existing model on your system. All loaders insist on a model existing even when not using it. That is just the way ComfyUI handles it.
So until there is one established way to load Flux I have to have all those loaders present to accomodate each user
If I switch it with models that I have on my system I get these errors:
model weight dtype torch.float8_e4m3fn, manual cast: torch.bfloat16
model_type FLUX
model weight dtype torch.bfloat16, manual cast: None
model_type FLUX
!!! Exception during processing !!! Error(s) in loading state_dict for Flux:
size mismatch for img_in.weight: copying a param with shape torch.Size([98304, 1]) from checkpoint, the shape in current model is torch.Size([3072, 64]).
size mismatch for time_in.in_layer.weight: copying a param with shape torch.Size([393216, 1]) from checkpoint, the shape in current model is torch.Size([3072, 256]).
size mismatch for time_in.out_layer.weight: copying a param with shape torch.Size([4718592, 1]) from checkpoint, the shape in current model is torch.Size([3072, 3072]).
@blue_zima_blue That error indicates that you tried to load the wrong model type in a loader. Like picking an NF4 for the regular checkpoint loader or a non-Flux model in any loader.
The 1st is for All In One Flux models that load like regular checkpoints and have clip and vae included
The 2nd is for All In One Flux models in NF4 version
The 3rd is for GGUFs that are UNet only and use the extra selected clip and vae models
The 4th is for UNet only models in NF4 version
The 5th is for regular UNet Flux models like the default ones that first came out without clips and vae
That means that it requires you to have one of each or else Comfy errors out.
I can add another version as an alternative which allows muting model types you might not have, but it will take more space and will not look as nice as the current one.
@redpinkretro "That means that it requires you to have one of each or else Comfy errors out.
I can add another version as an alternative which allows muting model types you might not have, but it will take more space and will not look as nice as the current one."
I think this would be required by most of the users, since no one is going to download various version of flux to run a single workflow.
@blue_zima_blue Yeah, I agree. It really is a bad prerequisite to have. I am already on it and might even have a working solution already. 👌
Hey, really like the concept you've got going on here. However. I seem to be having issues. I've got some type mismatches for the following nodes
#7561 workflow/Save — Pass III
#7563 workflow/wifi tri
#7567 workflow/wifi hepta
#3317 workflow/wifi double
I've been trying to follow your instructions to a T, but something is a bit borked.
The error itself is a tad repetitive.
Failed to validate prompt for output 7567:3:
* (prompt):
- Return type mismatch between linked nodes: anything, LATENT != *
* Anything Everywhere? 7567:3:
- Return type mismatch between linked nodes: anything, LATENT != *
Output will be ignored
Failed to validate prompt for output 7563:1:
* (prompt):
- Return type mismatch between linked nodes: anything, DICT != *
* Anything Everywhere? 7563:1:
- Return type mismatch between linked nodes: anything, DICT != *
Output will be ignored
Failed to validate prompt for output 3317:1:
* (prompt):
- Return type mismatch between linked nodes: anything, STRING != *
* Anything Everywhere? 3317:1:
- Return type mismatch between linked nodes: anything, STRING != *
Output will be ignored
Failed to validate prompt for output 7563:2:
* (prompt):
- Return type mismatch between linked nodes: anything, STRING != *
* Anything Everywhere? 7563:2:
- Return type mismatch between linked nodes: anything, STRING != *
Output will be ignored
Failed to validate prompt for output 3317:0:
* (prompt):
- Return type mismatch between linked nodes: anything, INT != *
* Anything Everywhere? 3317:0:
- Return type mismatch between linked nodes: anything, INT != *
Output will be ignored
Failed to validate prompt for output 7567:2:
* (prompt):
- Return type mismatch between linked nodes: anything, VAE != *
* Anything Everywhere? 7567:2:
- Return type mismatch between linked nodes: anything, VAE != *
Output will be ignored
Failed to validate prompt for output 7563:0:
* (prompt):
- Return type mismatch between linked nodes: anything, CONDITIONING != *
* Anything Everywhere? 7563:0:
- Return type mismatch between linked nodes: anything, CONDITIONING != *
Output will be ignored
Failed to validate prompt for output 7567:4:
* (prompt):
- Return type mismatch between linked nodes: anything, INT != *
* Anything Everywhere? 7567:4:
- Return type mismatch between linked nodes: anything, INT != *
Output will be ignored
Failed to validate prompt for output 7567:1:
* (prompt):
- Return type mismatch between linked nodes: anything, CLIP != *
* Anything Everywhere? 7567:1:
- Return type mismatch between linked nodes: anything, CLIP != *
Output will be ignored
Failed to validate prompt for output 7567:0:
* (prompt):
- Return type mismatch between linked nodes: anything, MODEL != *
* Anything Everywhere? 7567:0:
- Return type mismatch between linked nodes: anything, MODEL != *
Output will be ignored
Failed to validate prompt for output 7567:5:
* (prompt):
- Return type mismatch between linked nodes: anything, INT != *
* Anything Everywhere? 7567:5:
- Return type mismatch between linked nodes: anything, INT != *
Output will be ignored
Failed to validate prompt for output 7567:6:
* (prompt):
- Return type mismatch between linked nodes: anything, DICT != *
* Anything Everywhere? 7567:6:
- Return type mismatch between linked nodes: anything, DICT != *
Output will be ignored
Hey there! Thank you!
Are the errors actually impacting the functionality in your case?
Those occur when Anything Everywhere nodes are fused to group nodes, but they should still work properly. At least those errors never caused any issues for me whatsoever and only looked scary in the log for no reason 😄
If you go to the respective nodes (everything wifi di/tri/tetra ...), right click on them and select the option "Convert to nodes" it should retain all connections without any change in functionality, but all those errors will no longer pop up.
@redpinkretro Well. I thought they were impacting my functionality because comfy crashes without being able to make it past the checkpoint select. After converting to nodes and a quick restart, the errors are gone. Granted the #7610 Allor node is ImageClamp, so maybe there's an issue with the Allor Module? Or maybe it's a seperate issue. I'll need to try and make my logs more verbose.