This is a model I merged that works really well with loras. Give it a try!

Recommended Samplers: DPM++ 2M/DPM++ 2M SDE
Sampling steps: 30-50

Clip Skip: 1-2

CFG Scale: 4-6

Optional: Adetailer/Hiresfix

This is not my model, i take no credit for it. all credit goes to the creator @ https://civitai.com/models/1685120/naturalbeauty