Versions 1.0
Take an image of your character, take a clip of dialog, and generate a video of that character talking, with emotions and gestures! Works for a variety of styles. Simple as cheesecake!
Inputs:
1 image of your character
1 clip of dialog, either from an audio or video file
1 prompt either simple or complex
Outputs:
1 animated video of your character talking for the length of your audio clip
Tutorial:
Cheese and have a good one!
Brie Wensleydale ~
📂 ComfyUI/
├── 📂 models/
│ ├── 📂 clip_vision/
│ │ └── clip_vision_h.safetensors
│ ├── 📂 diffusion_models/
│ │ └── Wan 2.1 I2V 14B GGUF models
│ │ └── Wan 2.1 I2V 14B FP8 models
│ ├── 📂 loras/
│ │ └── lightx2v_I2V_14B_480p_cfg_step_distill_rank64_bf16.safetensors
│ ├── 📂 vae/
│ │ └── Wan2_1_VAE_fp32.safetensors
Description
Initial Commit!
Take a piece of audio and an image of a character and make it talk!
FAQ
Comments (2)
nice my bro I need to find some time to try this!
Depends on what you need. For simple local Dialog + Image to Lip Synced Video, this is a good option.
I will do Infinite Talk Dialog + Video for Lip Synced Video, then probably something with Wan 2.2 Animate.
I just want my full set of options with my own workflows.