What if I've tried to increase the prompt adherence in <a target="_blank" rel="ugc" href="https://civarchive.com/models/795765/illustrious-xl">Illustrious v0.1</a> and its siblings? It's only a test though, because I'm not entirely sure if I did it correctly. :)Left image - original checkpoint, right image - modified checkpoint. It seems the 'characteristics' of the original remain in the modified model, but prompt adherence is better for the most part.Another observation - VAE inclusion gets 'reset', the resulting checkpoint doesn't have it.

Illustrious v0.1 and its variants sprinkled with Illustrious v2.0-Stable CLIP

I decided to try and apply the same approach to all 3 <a target="_blank" rel="ugc" href="https://civitai.com/models/811067/illustrious-xl-smoothft">advokat's Illustrious models</a>. This is the second from the 'triad', has added SPO (Step-by-step Preference Optimization), but still, adding the CLIP makes a headway. :)

illustriousV01AndIts_smoothftSPOV10.safetensors

SmoothFT-SPO v1.0

Illustrij v18

Nya-Lyriel ILL v1.0

Nova 3DCG XL Ill v5

BrDr XL v1.0

Kagereallustrious v2

Kageillustrious v6 (NLXL)

rouwei v0.8

Ars Divina - 7.2.4a-1.1

ANGRA Illustrious v1.0

zenijiMixRetro v1.0

Illustrij v16

pixijl_v1.0

Illustrij v15

Illustrious v1.0

SmoothFT-SOLID v1.0

SmoothFT v1.0

Illustrious v0.1

Files with SHA256: 444e33cf053f83d8853e0297cfe42cd411d98cefffe71fc86ee5b8155df965b3