I found 2 WF that i liked and decide to put them together:
I dont know what settings is right to use (cfg/steps/ lora strength). But it seems to be working as it is for now.
I use Sage Attention - LINK
UPDATE COMFYUI BEFORE USE
==========
v.1.0 (WAN 2.2 FLF2V)
WAN 2.2 has FLF2V (First-Last Frame to Video) native capabilities. So i tried to adjust my workflow to make it work and seems it does. Hope you like it.
Enjoy.
==========
v.1.0 (WAN 2.2 I2V)
I just rearange nodes so it works with WAN 2.2 GGUF
https://huggingface.co/bullerwins/Wan2.2-I2V-A14B-GGUF/tree/main
Notice that for 14B model you need both models - HIGH noise and LOW noise
==========
v.1.1 (WAN 2.1 I2V)
Instead using CausVid lora i used FusionX lora which is already have CausVid
I set lora streinght 0.4 in first Ksampler (HIGH CFG START) and 0.8 in second one (LOW CFG END)
In version 1.0 you can just change loras in Dual samplers group
==========
v.1.0 (WAN 2.1 I2V)
1 - CausVid 2 Sampler Workflow for Wan 480p/720p I2V (Main part)
I Used this lora: Wan21_CausVid_14B_T2V_lora_rank32.safetensors
2 - WAN 2.1 IMAGE to VIDEO with Caption and Postprocessing (Florence Caption, last frame, Color match)
==========
I saw suggestions that dpmpp_2m - normal works good.
There is dpmpp_2m - simple in this WF
Description
I rearange a litle bit for WAN 2.2
FAQ
Comments (18)
WARNING- node flow2-wan-video is preventing wan2.2 i2v from working. Delete this node via the manager from ComfyUI.
First time seing this. Well i spose you have cinflict nodes.
I see 2 solutions.
1. Delete node
2. Create separate installation of comfy
GFrost Two solutions??? Deleting a useless, badly written, obsolete node is the actual solution that makes sense. Across time we all download no end of node packs for workflows we then never use (because they are awful). This is a reminder that removing node packs that have no author and no decent start ratings is probably a very good idea if we don't use them successfully in our current workflows.
Sorry i didnt know is written badly . I just use what was given. Mb there is some spare node that can replace existend. Il try to find. I cant please everyone. Next time somone call node that you using absolete . Who knows. No hate bro.
blobby99 I cant find problematic node .
The best WAN 2.1 workflow is back and works amazingly well with wan 2.2. I've only checked two wan 2.2 workflows, first was okish and this gave amazing results. However florence did what it does and in my pic wrote "man is looking at something in his hand", which isn't exactly the case, and the vid produced a guy with a pai pai, so yeah, florence is not the end of it all solution for prompts lol.
Thnx man =)
I heard 2.2 its the same 2.1 just trained more.
And who knew that they decide to separate generations on 2 samplers .
GFrost Thanks to you for this great wf ;) I check r/StableDiffusion and they're pretty impressed with wan 2.2, and the video i got with your wf was better than anything before it, so i think it's a solid step up from wan 2.1, but yeah nothing truly revolutionary.
Florence is the worst. There has to be a better auto prompter.
JCD007 Yeah, i think i saw few but this one is small and simple. I use it just for assistence to build prompts. Cus im Lazy.
You can use own prompt in WF if you want, There is a switch for that.
У меня что-то похожее с natangel.
Ошибка:
KSamplerAdvanced
Given groups=1, weight of size [5120, 36, 1, 2, 2], expected input[1, 64, 21, 78, 106] to have 36 channels, but got 64 channels instead
CLIP использую такой же, как с комментария внизу.
Модели:
wan2.2_i2v_high_noise_14B_Q4_K_M.gguf
wan2.2_i2v_low_noise_14B_Q4_K_M.gguf
umt5_xxl_fp8_e4m3fn_scaled.safetensors
wan22Vae.safetensors
clip_vision_h.safetensors
Florence не использую.
Чувствую, проблема в нестыковке размеров какой-то из моделей.
Может подскажешь, какими моделями пользуешься, чтоб наверняка?
Привет!
1. Надо обновить Comfyui до последней версии. Ну и ноды соответственно.
2. В группе 0 можно попробовать использовать fp8_scaled модели, например тут https://huggingface.co/Kijai/WanVideo_comfy_fp8_scaled/tree/main или тут https://comfyanonymous.github.io/ComfyUI_examples/wan22
Для этого надо переключить ноды на Diffusion Model Loader (там внизу ноды reroute) . Если конечно видюха позволяет.
3. Используй 2.1 Vae, я не пробовал но говорят 2.2 медленная и глючная. хорошо работает только на 5B
4. Тушить группу флоренс не надо, просто используй красную bolean ноду на true. Затем введи собственный промт в "Your own prompt" ноду
P.S. В галерее есть снимок workflow. Там можно подсмотреть какие модели у меня стоят.
Спасибо большое за ответ. Прроблема действительно была в VAE2.2. Прекрасно работает на vae2.1.
Спасибо за схему.
For anyone having mxtoolkit nodes not showing correctly (for example no way to change height, frames, etc) check this solution for comfyui-mixlab, it worked for me: https://github.com/Smirnov75/ComfyUI-mxToolkit/issues/28#issuecomment-2603091317
Nice work! I get good result but I think it's not using Frame Interpolation. I only have 16 fps videos. I'm a noob btw
Hi!
Hmmm, check that goup 3 Frame interpolation is on. It should transform RAW 16fps output to 32 fps interpolated output . If you still have issue send an screenshot of your workflow via image host services like https://ibb.co
Ok it's work when I execute the Frame Interpolation manually. I thought it was automatic.
Jehuty64 Glad you worked this out.
yeah i turn interpolation on when i am satisfied with 16fps result.