While training on SDXL (or PDXL) takes more time, it seems to have higher chance (compared to sd1.5) to succeed at making something useful with very limited dataset. So I tried with a light novel waifu who has only a few official illustrations.
Certainly not a final version.
darkmel-pdxl-004.safetensors
dataset.zip