This is meant to be an image to image workflow and not a video workflow.
Using Xinsir's Union Controlnet in Tile mode with low weight results in a very nice pose transfer. This can be used in conjunction with LoRAs to transfer pose from real to Anime.
Description
FAQ
Comments (4)
please make it video to video flow with reference image
There are some ideas that have been suggested by redditors. I'm testing the ideas out to see if they work.
In fact, I'd rather divide it into more zones to create high-quality dynamics.
1. Video 2 Picture
2.IMG 2 IMG (add LORA) - (SD1.5~SDXL~FLUX) {SD3.5}
3.IMG 2 video and audio
--
4.Thinking - Stability/Quality/Fast/Length/
--
Special circumstances, restoration thinking of old films. Plus stable content-specific replacements. Become a timeless film.
I think this workflow just does 2.
For 3, IMG to video should be done with CogVideoX. Video to audio can be achieved with Foley crafter.