If you want it more subtle, like closed mouth, it is necessary to add on the prompt, I have tested it with strength 0.5, but feel free to try different compositions and let me know if you found any creepy or displeasing issue with frequency. I am not sure how it might work with other loras, hopefully just fine.