It's hard to determine from afar what could be the issue so let me share some points from my workflow. I am using the Flux LoRA Workflow with Finetune/Upscale from punzel. Especialy to note is the second Lora that is used there which is XLabs Flux Realism LoRA. Use it at around 0.5 strength or less. It makes a huge difference. Also try to use the triggerword together with woman. Sometimes this seems to make a difference e.g. "photo of a blonde woman sabcarp standing behind a counter...." Hope this helps.