Trained for PonyXL with anime screencaps, thanks to https://fancaps.net/, and other various sources using kohya_ss. I recommend a weight of 1. This model is capable of generating Maomao and Jinshi together or separately.
Please check prompt combinations in the example images. Use screencap to get the anime style. I prefer to use AutismMix for this model.
Since this model is mostly trained on screencaps I also deliberately train to replicate the anime style to get the character likeness as close as possible. If you want to apply a different style do not use screencap in the positive prompt.
Description
FAQ
Comments (3)
Do you have any tips for training two characters together using Pony? I'm literally in the process of gathering data for this purpose. Was wondering if I should make three folders. One for the two chars together, then another two for them separate.
It was my first model for multiple characters so I don't yet know what the optimal strategy is but from my experience with SD it's best to strip all character specific tags (eye color, hair color, hair length etc.) unless they are variant, e.g. freckles. In examples where she does have a different hairstyle, I describe the hairstyle. My dataset in this case consists of 4 folders: jinshi (only screencaps of Jinshi with solo tag), maomao (screencaps of Maomao), maomao_and_jinshi (screencaps where they are together), maomao_and_jinshi_misc (non-screencap images with a mix of Jinshi, Maomao together and solo - including nsfw).
The reason why I believe it's important to remove the character trait tags is because the trained network will associate all the tags with the character and you will be required to use them in the prompt to actually get the character. This is ok (but also not necessarily recommended) for solo characters but for multiple characters SD mixes the trait prompts and generated characters will more likely have the wrong eye color for example because it doesn't really understand how the world works. Hopefully SD3 will be better at this.
@dude_ Hoping the same thing in regards to SD3. SD loves to mass merge them together. I hasn't thought about using four folders. I'll have to try that out and see how it works. Even though this is your first you've don't a great job and thank you for detailing your experience!
Details
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.