SharpSpectrumVAE but XL WOO!
Someone (cough FallenIncursio cough) asked if I could make it for SDXL and I did.
Since the original SDXL VAE is already pretty good, you won't see much difference, instead you get contrast and colors™️. (I do have one that does more, but it also comes with some quirks normal users shouldn't have to get annoyed with, so won't be releasing that publicly, unless I find a way to fix those)
Yes, it will work on all SDXL derivatives. That means PonyXL as well.
It is based on the FP16-fix of the SDXL VAE, so it shouldn't produce NaNs hopefully™️.
Note: V-pred models may or may not work.
Description
Just a direct fp8 conversion of SharpSpectrumVAEXL that may or may not fix any NaNs
Doesn't have the exact same effect as the OG, but close enough (maybe you'll prefer the result since it's not as strong)
FAQ
Comments (16)
The best VAE for SDXL, thx m8
@DannyDs ❤️
you're right that base SDXL VAE is good (with the fp16 fix, of course) but SharpSpectrum is just slightly better for certain compositions - anything that needs darker darks and more contrast and brighter colors. Works especially well with popular checkpoint NightvisionXL, for obvious reasons.
Thank you!
Really amazing VAE, thank you very, VERY much! for sharing and letting it available for on-site generation, Pitpe!!!
I wonder why in the hell I can't recommend this VAE in my models by Civitai system??
It is as VAE category, but no matter how I look for it, it never appears as option... ¬¬
All my checkpoints are based on this VAE, so yeah, it's really frustrating that I have to recommend it manually...
@ChaosExperience Yeah, I don't know. I also have issues with that. Used to work fine and then now it doesn't 😂. Thank you though ❤️
Great. This VAE provides more saturated and dark colors without causing distortion.
I could see the opposite of this being useful, with a lower contrast, for if you get slightly burned images from pushing things too much.
@plk What I do in that case is increase the steps or decrease the CFG, or both.
Hello, the VAE colors you've created are truly excellent. However, when I try to generate larger resolutions (e.g., 832*1216) and then perform a 2x high-definition redraw upscale, I consistently encounter VRAM overflow issues resulting in black images. Do you have any solution to fix this problem? Based on my tests, when using the official VAE at the same resolution, this issue doesn't occur - it seems VAEs around 300MB in size don't have this problem.
您好，您制作的vae颜色真的非常棒，不过我在生成较大分辨率，如：832*1216再高清重绘放大两倍的情况下都会爆显存生成黑图，您有办法修复这个问题吗？根据我的测试，使用官方的vae在生成同样大小分辨率的图片就不会有这个问题，貌似容量在300多mb的vae都不会出现这个问题
@ko2712382591 Hello, this is most likely an issue with your GPU. Maybe it can't handle the numbers. My 3060 12gb can do 832x126 and 2x upscale just fine with either the full 300mb VAE or the fp8 VAE, no black images. Never had an issue with the VAE. I use Forge/Comfy. Sorry, I can't really help.
@Pitpe11 Thank you for your reply. After using Forge, the problem was resolved.
@ the Autor "SDXL VAE" is not the safe basis, if you wnat get rid of NaNs you should use "sdxl-vae-fp16-fix" in my testes its superios compared to standat sdxl vae in terms of stability
Doesn't seem to play nice with v-pred models. On these it tends to produce blurry and hyper saturated outputs.
@0xHomunculus Yes, that's not surprising. I'll add a note.
Details
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.