Workflow description :
The aim of this workflow is to generate video using the face from an existing photo in a simple window.
Resources you need:
馃搨Files :
WAN2.1
Recommendation :
24 gb Vram: Q8_0
16 gb Vram: Q5_K_S
<12 gb Vram: Q4_K_S
I2V Quant Model: Wan2.1-I2V-14B-480P-gguf or Wan2.1-I2V-14B-720P-gguf
In models/diffusion_models
CLIP: umt5_xxl_fp8_e4m3fn_scaled.safetensors
in models/clip
CLIP-VISION: clip_vision_h.safetensors
in models/clip_vision
VAE: wan_2.1_vae.safetensors
in models/vae
FLUX
GGUF_Model: FLUX.1-dev-gguf
"flux1-dev-Q8_0.gguf" in ComfyUI\models\unet
GGUF_clip: t5-v1_1-xxl-encoder-gguf
"t5-v1_1-xxl-encoder-Q8_0.gguf" in \ComfyUI\models\clip
Text encoder: ViT-L-14-TEXT-detail-improved-hiT-GmP-TE-only-HF.safetensors
"ViT-L-14-GmP-ft-TE-only-HF-format.safetensors" in \ComfyUI\models\clip
VAE: ae.safetensors
"ae" in \ComfyUI\models\vae
FLUX PuLID : pulid_flux_v0.9.0.safetensors
"pulid_flux_v0.9.0" in \ComfyUI\models\pulid
ANY upscale model (depreciated):
Realistic : RealESRGAN_x4plus.pth
Anime : RealESRGAN_x4plus_anime_6B.pth
in models/upscale_models
馃摝Custom Nodes :
PuLID need your python to have Insightface :
Check your python version :
for windows portable version : (the path depends on where you unzipped ComfyUI)
Download Insightface whl which corresponds here : Assets/Insightface
(Here my local python is on 310 and mobile version in 312)
Then install all prerequisites and insightface :
python.exe -m pip install --use-pep517 facexlibpython.exe -m pip install git+https://github.com/rodjjo/filterpy.git
python.exe -m pip install onnxruntime==1.19.2 onnxruntime-gpu==1.15.1 insightface-0.7.3-cp310-cp310-win_amd64.whl
Description
What's new? :
ComfyUi 0.3.29 positive node fix,
LoRA fix with torch compile.
FAQ
Comments (35)
What is in this v2.1 update? Just fixes?
All in in "about this version" :
What's new? :
ComfyUi 0.3.29 positive node fix, (because last update break lot of node)
LoRA fix with torch compile. (now lora work with torch compile)
@UmeAiRT聽thanks i've been using this site for months and never noticed that section
Author just broke it 馃ぃ (I am joking) but version 2.1 not working聽for me
All your ComfyUI nodes are missing required inputs, like vae_name, expression, format, frame_rate, noise_seed, sampler_name, etc.
@DarkMaster13聽If you have installed the mixlab nodes, delete them and see if the problem persists.
I'm really confused, I've used this before and had no issues, now I'm getting OOM and my settings everything is the same, am I missing something, I'm running 4060 8gbvram 32gb ram I've tried sage I've tried lowram. It will complete all the way up to the part going into making the video then I'll get the OOM. Before it didn't do that, I am using GGUF too.
Same, new workflow 2.1 make almost my GGUF OOM.
@ritonenier聽What i ended up doing is using face2video then bypassing the winvideo node so it stops, then i use the picture i just made into image2video, and that worked i guess for now
Using FLUX and WAN in the same workflow requires a lot of VRAM. It is better to make the image with FLUX first as suggested by drdewme618 to save VRAM. (torchcompile use lot of VRAM too)
@UmeAiRT聽Is there anyway to make a FACE TO IMAGE workflow? THen i could just use that face and put it into image2 video. if possible thank you for the reply
Add a Clean VRAM mode and Unload all models node after each generation. I do this and can run on 8GB VRAM laptop GGUF.
@mrw21j聽can you share your workflow? mine not working
This workflow causes issues after issue, ive fixed about 4 hours of issues and then 20 more crop up, rebuilt everything, reinstalled everything, and still, i feel like i need to get a team of code scientists to work on this 24/7 for a year just to backtrack all the missing dependencies.
Just use his all in one installer. You probably just messed up somewhere. Easy to do. Comfy, and python in general is finnicky as hell.
@johannesdolch539聽his installer couldn't pass middle steps and just drops lots of errors then freezes the command line, was even trying to install it on a freshly installed clean windows, simply not working. And according to comments, there isn't just a single problem, unfortunately he broke it with updates
I'v got an issue with the following line in python 3.12.9
.\python.exe -m pip install --use-pep517 facexlibpython.exe -m pip install git+https://github.com/rodjjo/filterpy.git
return value "no such option: -m"
All the requierement seems well install, i've got the facexlib into this folder "ComfyUI_windows_portable-0.3.29\python_embeded\Lib\site-packages\facexlib\"
it 2 different commands use it separately聽
python.exe -m pip install --use-pep517 facexlib
python.exe -m pip install git+https://github.com/rodjjo/filterpy.git
and for python 3.12 (download insightface-0.7.3-cp312-cp312-win_amd64.whl before of cource:)聽 )
python.exe -m pip install onnxruntime==1.19.2 onnxruntime-gpu==1.19.2 insightface-0.7.3-cp312-cp312-win_amd64.whl
No module named 'fused_layer_norm_cuda'
Same issue here.
@ag13trash994聽This problem comes from apex which is not present or not compiled with CUDA
@UmeAiRT聽I used your most recent version of the all in one installer. It looks like it was not able to install apex into the embedded python at all.
@ag13trash994聽I fixed this problem in the installer for FLUX, I have to do it for WAN too.
@UmeAiRT聽10-4. Thank you
@UmeAiRT聽thanks, so i have to run the installer again?
@ag13trash994聽thanks a lot
i have this issue how can i fix it
PulidFluxEvaClipLoader
No module named 'fused_layer_norm_cuda'
@ag13trash994聽you installed the CPU version instead of GPU version, xxx_cuda is GPU version, since you renamed it it will use the CPU (slower)
getting the same error as well,
Also go the "fused_layer_norm_cuda" error. Fixed with the suggest rename, then I progress to this error:
ApplyPulidFlux
CUDA error: no kernel image is available for execution on the device CUDA kernel errors might be asynchronously reported at some other API call, so the stacktrace below might be incorrect. For debugging consider passing CUDA_LAUNCH_BLOCKING=1 Compile with TORCH_USE_CUDA_DSA to enable device-side assertions.
I am using the combined installer, and get no issue with i2v workflow.
I got the same error
love this workflow! any chance you'll make it for wan2.2?
Same question
Download Insightface whl which corresponds here : Assets/Insightface
Good afternoon! Can you tell me where to download it?