I recommend using Illustrious version for two reasons, because even without lora Illustrious knows about bangboo and Pony doesn't. But I did Pony version anyway and it somewhat works.
You need to prompt more for Pony, especially mentioning eyes is important. But it makes mistakes anyway.