https://civitai.com/models/320637 While training on SDXL (or PDXL) takes more time, it seems to have higher chance (compared to sd1.5) to succeed at making something useful with very limited dataset. So I tried with a light novel waifu who has only a few official illustrations.