Lets sum it up, style training on Photography with a bigger database via Loras is a pain, chose the version you like the most. I won't spent more time on this :D

In general training styles work best on 10-20 images max, singlecaption with mixed no caption, or no caption at all seems also very good, but yeah small datasets everything else should be finetuned