IntroductionThis workflow is used to create AI Tiktok dance videos, with the action of the AI avatar driven by an actual dance video.v7 includes audio reactive background using Depthflow and RyanOnThe Inside nodes. Models NeededThe models required are the red nodes in the workflow, explanation is in the notes (brown nodes) in the workflow. Recommend to install with ComfyUI Manager.<ul><li>SD1.5 LCM: <a target="_blank" rel="ugc" href="https://civarchive.com/models/81458?modelVersionId=256668">https://civarchive.com/models/81458?modelVersionId=256668</a></li><li>SDXL Lightning: <a target="_blank" rel="ugc" href="https://civarchive.com/models/133005/juggernaut-xl?modelVersionId=920957">https://civarchive.com/models/133005/juggernaut-xl?modelVersionId=920957</a></li><li>AnimateLCM_sd15_t2v.ckpt (<a target="_blank" rel="ugc" href="https://huggingface.co/wangfuyun/AnimateLCM">https://huggingface.co/wangfuyun/AnimateLCM</a>)</li><li>Install Using Manager:<ul><li>IPAdapter Models. ip-adapter_sd15.safetensors, ip-adapter-plus_sd15.safetensors.</li><li>Clip-Vision. CLIP-ViT-H-14-laion2B-s32B-b79K.safetensors and CLIP-ViT-bigG-14-laion2B-39B-b160k.safetensors.</li><li>AnimateDiff V3: v3_sd15_mm.ckpt, v3_sd15_adapter.ckpt.</li><li>xinsir/ControlNet++: All-in-one ControlNet (ProMax model).</li><li>control_v11f1p_sd15_depth.safetensors</li><li>depth_anything_v2_vitl.pth</li></ul></li></ul>Custom Nodes NeededInstall missing custom nodes using manager.<ul><li>ComfyUI's ControlNet Auxiliary Preprocessors</li><li>ComfyUI Frame Interpolation</li><li>ComfyUI_IPAdapter_plus</li><li>ComfyUI-Advanced-ControlNet</li><li>AnimateDiff Evolved</li><li>ComfyUI-VideoHelperSuite</li><li>rgthree's ComfyUI Nodes</li><li>ComfyUI Essentials</li><li>KJNodes for ComfyUI</li><li>Crystools</li><li>ComfyUI-Inspyrenet-Rembg</li><li>Depthflow Nodes</li><li>RyanOnTheInside</li></ul>

Tik Tok Dance Workflow (Animate LCM, IPAdapter, Controlnet)

A 16 frame looping video is generated for the background.GroundingDINO is used to segment out the character. A 2nd pass KSampler is used to generate the character, only in the areas segmented out by grouding dino, leaving the background intact.

Files with SHA256: 06e9f9a07fb950ae16fcf888c25161a5581c37636795ec661cbeea09c3629835