If you're tired of ComfyUI errors and complicated nodes, you can use the online platform for free.
https://www.runninghub.ai/post/1969068684759212034
and don't forget to use this code (rh-v1213)
The FP8 model downloading address is inside.
******
Wan-Animate: Unified Character Animation and Replacement with Holistic Replication
Function Overview
Wan-Animate can animate any character based on a performer's video, precisely replicating the performer's facial expressions and movements to generate highly realistic character videos.
Wan-Animate can replace characters in a video with animated characters, preserving their expressions and movements while also replicating the original lighting and color tone for seamless environmental integration."
Abstract
We introduce Wan-Animate, a unified framework for character animation and replacement. Given a character image and a reference video, Wan-Animate can animate the character by precisely replicating the expressions and movements of the character in the video to generate high-fidelity character videos. Alternatively, it can integrate the animated character into the reference video to replace the original character, replicating the scene's lighting and color tone to achieve seamless environmental integration. Wan-Animate is built upon the Wan model. To adapt it for character animation tasks, we employ a modified input paradigm to differentiate between reference conditions and regions for generation. This design unifies multiple tasks into a common symbolic representation. We use spatially-aligned skeleton signals to replicate body motion and implicit facial features extracted from source images to reenact expressions, enabling the generation of character videos with high controllability and expressiveness. Furthermore, to enhance environmental integration during character replacement, we develop an auxiliary Relighting LoRA. This module preserves the character's appearance consistency while applying the appropriate environmental lighting and color tone. Experimental results demonstrate that Wan-Animate achieves state-of-the-art performance. We are committed to open-sourcing the model weights and its source code
Description
FAQ
Comments (4)
How can I get the WanVideoAnimateEmbeds and facemaskfromposekeypoints node? I saw it in someone’s workflow but can’t find it anywhere. Is it part of a specific extension or custom node pack?
do you mean those node don't work? because i have the exact same problem. updating the wanvideo nodes doesn't work, updating comfyui neither
@MoreColors Had the same problem as you, had to manually install ComfyUI-WanVideoWrapper, and it's requirements.txt
@zipac2 found a solution on reddit. Revert the wanvideo custom nodes to 1.3.3, restart, then update to nightly. Now the nodes are there.