Convert animation into a realistic style using Bernini.
Description
Comments (8)
Other!OMG! Is this Wan? LTX? KREA? Or what???
Bernini-R is a checkpoint of Wan 2.2. You can either download the checkpoint and use it with Wan2.2 T2V or download Bernini-R-Diffusers which bundles Bernini and Wan2.2 into one model.
@tarn59 Okay, thank you very much for clearing up my doubt.
Good job! Could you please use Asian faces in the next version? The current version's characters are too Westernized, which looks out of place in Japanese and Chinese anime.
Bernini supports image reference for character replacement. You should be able to use that with the Lora to make the character any ethnicity you want.
@tarn59 Thank you for your suggestion. This is very simple for a few-second video, but for longer videos, it requires more reference images and manual intervention, which is extremely time-consuming. I prefer to have the model complete the process in one go using the director's console node, so I plan to train a LoRa style transfer image that is more suited to Asian aesthetics myself. I already knew that training this type of model requires training data in pairs, A and B, similar to image editing models. If you could provide me with the dataset and training set configuration file, I only need to change the B result video in the dataset to an Asian style; nothing else needs to be changed, which would save me a lot of time.
@lp2l65319805 I don't plan on opening the dataset, but you can use my anime transfer lora to change asians to anime and then use the results in the a new dataset (just use the anime version as input and the asian as the output). That is how I built most of my dataset.
@tarn59 This idea is fantastic and incredibly useful. Thank you for your suggestions on LoRA and dataset construction methods.