The strength of Lora is recommended to be around 0.7.I think it will be more stable than without Lola.
nun_XL_V1.0.safetensors
