Welcome to the next generation of audio-driven animation. This isn't just an update; it's a complete optimization overhaul. Building on the revolutionary concept of using sound to direct video motion, V2.0 focuses on speed, stability, and accessibility.This workflow is a masterpiece of efficiency, designed to leverage the WAN2.2 S2V 14B model's capabilities without the traditional hardware constraints. Whether you're creating talking-head videos, music visualizers, or dynamic narrations, this suite provides a professional, reliable, and incredibly fast pipeline.<hr /><h2 id="what's-new-in-v2.0-(key-updates)">What's New in V2.0? (Key Updates)</h2><ol><li>⚡ Lightning-Fast Generation: Integrated the <code>Wan2.2-Lightning_I2V-A14B-4steps-lora</code>. This cuts the generation steps from 20+ down to just 4, drastically reducing render times while maintaining impressive quality. This is the biggest performance upgrade.</li><li>💾 Massive VRAM Optimization: Replaced the standard CLIP loader with a <code>ClipLoaderGGUF</code> node, using a quantized <code>umt5-xxl-encoder-q4_k_m.gguf</code> model. This significantly reduces memory usage, making the workflow accessible to users with less VRAM.</li><li>🖼️ Smart Image Handling: Added an auto-image scaling and dimension detection pipeline (<code>GetImageSize</code> + <code>ImageScaleToTotalPixels</code>). The workflow now automatically reads your input image's dimensions and scales it optimally (to 0.2 megapixels by default) before animation, ensuring consistency and saving you manual steps.</li><li>🔧 Streamlined Sampling: Updated the <code>KSampler</code> to use <code>dpmpp_2m</code>, which pairs perfectly with the Lightning LoRA for fast, high-quality results in just 4 steps.</li><li>🎯 Improved Integration: The final <code>VHS_VideoCombine</code> node is now properly linked to the generated TTS audio, ensuring the final MP4 has perfect audio-video sync out of the box.</li></ol><hr /><h2 id="features-and-technical-details">Features &amp; Technical Details</h2>🧩 Core Components:<ul><li>Model: <code>wan2.2_s2v_14B_bf16.safetensors</code> (The specialized Sound-to-Video model)</li><li>Speed Booster: <code>Wan2.2-Lightning_I2V-A14B-4steps-lora_LOW_fp16.safetensors</code> (For 4-step generation)</li><li>VAE: <code>Wan2.1_VAE.safetensors</code></li><li>CLIP (GGUF): <code>umt5-xxl-encoder-q4_k_m.gguf</code> (VRAM-efficient)</li><li>Audio Encoder: <code>wav2vec2_large_english_fp16.safetensors</code></li></ul>🎙️ Integrated Voice Cloning (TTS):<ul><li>Node: <code>ChatterBoxVoiceTTSDiogod</code> - Generate narrated audio from any text.</li><li>Auto-Duration: The workflow still automatically calculates the perfect video length for your audio.</li></ul>🎬 Professional Output:<ul><li>Primary Output: <code>VHS_VideoCombine</code> node creates a finalized MP4 video with synchronized audio.</li><li>High Efficiency: The entire pipeline is built for speed and lower resource consumption.</li></ul><hr /><h2 id="how-to-use-steps-to-run">How to Use / Steps to Run</h2><h3 id="prerequisites:">Prerequisites:</h3><ol><li>The Specialized Model: You must have the <code>wan2.2_s2v_14B_bf16.safetensors</code> model.</li><li>The Lightning LoRA: Ensure you have <code>Wan2.2-Lightning_I2V-A14B-4steps-lora_LOW_fp16.safetensors</code> in your <code>wan_loras</code> folder.</li><li>GGUF CLIP Model: Download <code>umt5-xxl-encoder-q4_k_m.gguf</code> for the GGUF loader.</li><li>ComfyUI Manager: To install any missing custom nodes (<code>comfy-mtb</code>, <code>gguf</code>, <code>comfyui-videohelpersuite</code>).</li></ol><h3 id="instructions:">Instructions:</h3><ol><li>Load Your Image: In the <code>LoadImage</code> node, select your starting image. The workflow will automatically handle its size!</li><li>**(Optional) Voice Clone: Provide a reference audio file for the TTS node to clone.</li><li>Write Your Script/Prompt: Change the text in the <code>ChatterBoxVoiceTTSDiogod</code> node and the positive <code>CLIPTextEncode</code> node to match your desired content.</li><li>Queue Prompt. Watch the workflow generate a video in a fraction of the previous time.</li></ol>⏯️ Output: Your finished video will be saved in your ComfyUI <code>output/video/</code> folder as an MP4 file with perfect audio sync.<hr /><h2 id="tips-and-tricks">Tips &amp; Tricks</h2><ul><li>Quality vs. Speed: The Lightning LoRA is set to strength <code>1</code>. For potentially higher quality (but slower generation), try lowering the LoRA strength to <code>0.7-0.8</code>.</li><li>Prompt Power: The audio drives the motion, but your text prompt still defines the character's appearance and style. Use it to guide the visual output.</li><li>Resolution Control: The <code>ImageScaleToTotalPixels</code> node is set to <code>0.2</code> megapixels for speed. Increase this value (<code>0.4</code>, <code>0.6</code>) for higher resolution input, which may improve final detail but will use more VRAM.</li><li>First Run: On the first execution, ComfyUI will cache the GGUF model. This may take a few minutes, but subsequent runs will be very fast.</li></ul><hr /><h2 id="tags">Tags</h2><code>WAN2.2</code>, <code>S2V</code>, <code>Sound2Vid</code>, <code>ComfyUI</code>, <code>Workflow</code>, <code>V2</code>, <code>Lightning</code>, <code>4-Step</code>, <code>Fast</code>, <code>Optimized</code>, <code>GGUF</code>, <code>VRAM</code>, <code>Efficient</code>, <code>Audio-Driven</code>, <code>Voice Cloning</code>, <code>TTS</code>, <code>I2V</code>, <code>Animation</code>, <code>14B</code>, <code>Talking Head</code><hr /><h3 id="final-notes">Final Notes</h3>V2.0 transforms this workflow from a technical showcase into a practical, daily driver for content creation. The combination of the Lightning LoRA and GGUF loading makes it arguably the most efficient and accessible way to experiment with and produce high-quality sound-to-video content.Experience the future of AI video generation, optimized for speed and simplicity.

Files with SHA256: 343d0cf6bf0aaf0314a8185ae7b6bd862395efa775be4d724083f3e2bed77a23