CivArchive
    Audio Driven Animation in ComfyUI Examples - String Scheduling
    NSFW
    Preview 3153187

    Showing an example of how to use music to drive AI animations. This should make it easier to create AI animation of music videos.

    Under the hood we're using the amplitude of certain frequencies to change the prompt.

    String Scheduling

    This version shows the example of shuffling a set of prompts when the amplitude hits a certain threshold.

    Prompts can be loop and / or shuffled to create more dynamic content.

    Description

    FAQ

    Comments (5)

    settima_aiOct 25, 2023
    CivitAI

    Can you add a video file with audio?

    Would be more interesting....

    a1lazydog
    Author
    Oct 25, 2023· 2 reactions
    settima_aiOct 26, 2023· 1 reaction

    @a1lazydog thanks

    pawellipowczanFeb 16, 2024

    what about voiceover - is it possible to generate a talking avatar?

    BoltMonkeyMay 25, 2024

    @pawellipowczan use a mouth open-close slider

    Workflows
    Other

    Details

    Downloads
    252
    Platform
    CivitAI
    Platform Status
    Available
    Created
    10/25/2023
    Updated
    5/7/2026
    Deleted
    -