Workflow for creating a morphing effect between two images (or video frames). It uses a combination of RiFE frame interpolation and i2i with IPA (SD1.5).
The main difference between this and pure RiFE is that using diffusion model (SF1.5) for key frames allows a much smooth effect where in-between images make more sense, rather than being gargled blobs of color.
Using SD1.5 adds a bit more otherworldly mesmerizing effects due to being trained on low resolution (512), and key frames being scaled to large resolution (~1024).
For examples of this approach being used for cuts between clips, I have used this on a youtube series here:
Description
FAQ
Comments (1)
For more examples, I have used this to interpolate between clips in a youtube series I am creating, e.g. here: https://youtube.com/shorts/LzjGplJLr-U?feature=share