This version of the model is too strong, use lora with a strength of 0.2 to 0.4 maximum.
checkpoint-e18_s432.safetensors