base on framepack

The FramePack LoRA training conducted using the Musubi tuner utilized 13 videos for the generation of big swing dance.

you can download this video,then drag into comfyui to see the workflow and parameter

The training took approximately 24 hours on 4090. I would highly recommend using a GPU with greater than 24GB of VRAM for training.

I have only tested this on BF16 precision and have not conducted any evaluations under FP8 precision.

thanks to 青龙圣者 , for addressing some questions regarding training parameters.

It can be observed that FramePack, even without using F1, achieves a remarkably significant improvement in motion amplitude when employing LoRA.

So I’m wondering if a single LoRA could simply amplify all motion amplitudes significantly.

On the RTX 4080 32GB, it takes an average of 1 minute per second to generate.