👋 If you like what I do and want to support the development, feel free to buy me a coffee:<a target="_blank" rel="ugc" href="https://ko-fi.com/herrscheragga"><img src="https://camo.githubusercontent.com/7765e3dbce77c82639ff14d27dda26628b206727b61a6736190f90e81c78a121/68747470733a2f2f696d672e736869656c64732e696f2f62616467652f4b6f2d2d66692d537570706f72742532304d652d4646354535423f7374796c653d666f722d7468652d6261646765266c6f676f3d6b6f2d6669266c6f676f436f6c6f723d7768697465" alt="Ko-Fi" /></a><hr /><h3 id="hola!">Hola!,</h3>This week, I've been testing various merging methods and realized that most checkpoints suffer from a damaged Layer 11. This is the reason why they are sometimes incompatible with LoRAs. However, VAEs tend to filter out these issues, or they get ignored if the checkpoint is in FP32.Since I do everything using my free Google Colab account, I have to be very picky with RAM usage, but luckily, I managed to merge several checkpoints in a short time. (I'm not publishing those, as they are just tests or works in progress).The main idea behind this project was to merge checkpoints with the damaged Layer 11 and then repair them using NoobAI as a base, since this flaw typically occurs during merging. I wrote a script for this purpose, and I also created a tool that prevents NaN generation in already published checkpoints (<a target="_blank" rel="ugc" href="https://github.com/HerrscherAGGA/AGGA-STL/tree/main">just click here</a>).<h3 id="how-to-replace-damaged-parts">How to replace damaged parts?</h3><ul><li>Simply copy and paste this script into Colab.</li></ul><pre><code>import torch
from safetensors.torch import load_file, save_file
import gc

# 1. ROUTES
# We will use Illustrious/ Noobai as the donor because we have confirmed that it is 100% clean
ruta_master_con_nans = "/content/HerrscherAGGA2026_FurrySpec_V15.safetensors"
ruta_donante_sano = "/content/civitai_downloads/furryspecSimpleFurry_v1.safetensors"
ruta_salida_parcheada = "/content/HerrscherAGGA2026_FurrySpec_V2.safetensors"

print("Initiating surgical patching of Layer 11...")

# 2. Load models
master = load_file(ruta_master_con_nans)
sano = load_file(ruta_donante_sano)

# 3. Identify and replace only the broken tensioners in Layer 11
parches = 0
# We specifically looked at the CLIP architecture (conditioner)
keys_a_revisar = [k for k in master.keys() if "layers.11" in k]

for key in keys_a_revisar:
 if torch.isnan(master[key]).any() or torch.isinf(master[key]).any():
 print(f"Repairing an infected tensioner: {key}")
 if key in sano:
 # Direct replacement for the sound value of Illustrious/ Noob
 master[key] = sano[key].to(master[key].dtype)
 parches += 1
 else:
 # If it's not in the donor (unlikely), we clean with zeros
 master[key] = torch.nan_to_num(master[key], nan=0.0)
 parches += 1

# 4. Final Verification (Safety cleaning of the entire model)
for key in master.keys():
 if torch.isnan(master[key]).any() or torch.isinf(master[key]).any():
 master[key] = torch.nan_to_num(master[key], nan=0.0)

# 5. Guardar
print(f"\n✅ Surgery completed. Specific {parches} patches were applied.")
save_file(master, ruta_salida_parcheada)
print(f"💾 Save on: {ruta_salida_parcheada}")

# 6. Cleaning
del master, sano
gc.collect()
torch.cuda.empty_cache()</code></pre><hr />Here is the recipe:<pre><code>furry = [
 {"path": "/content/civitai_downloads/furrytoonmix_xlIllustriousV2.safetensors", "alpha": 1.0},
 {"path": "/content/civitai_downloads/yiffymix_v63Noobxl.safetensors", "alpha": 0.35},
 {"path": "/content/civitai_downloads/oopsAllToons_naiV10Toonitup.safetensors", "alpha": 0.30},
 {"path": "/content/civitai_downloads/bananaSplitzXL_vee9PointOh.safetensors", "alpha": 0.30},
 {"path": "/content/civitai_downloads/molKeunMix_deepnavyV4.safetensors", "alpha": 0.25},
]</code></pre><img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/1c3adc78-eefd-44ed-b6ef-44c205e1d7b4/original=true/1c3adc78-eefd-44ed-b6ef-44c205e1d7b4.jpeg" />

Files with SHA256: 3ce0133ccb862ec4dd2dc6d6e9807e8cf02b72b28e37d31a77973f74ef93cb73