AiARTiST SDXL Commercial Design and Advertising Material Workflow

CFG++: Manifold-constrained CFG for Diffusion Models

Classifier Free Guidance

Original Source: https://arxiv.org/html/2406.08070v1

Classifier Free Guidance (CFG) is a fundamental tool for text-guided generation in modern diffusion models. Although CFG is effective, it also has notable drawbacks. For example, CFG-adapted DDIM lacks reversibility, leading to complex image editing; moreover, high guidance scales crucial for high-quality output often result in pattern collapse issues. Contrary to the common belief that these are inherent limitations of diffusion models, research reveals that these problems actually stem from non-manifold phenomena associated with CFG, rather than the diffusion models themselves.

More specifically, inspired by the recent advances in the Diffusion Inversion Solver (DIS) based on diffusion models, the project team redefines text-guidance as an inverse problem with text-conditioned score-matching loss and develops CFG++, a new method that addresses non-manifold challenges inherent in traditional CFG. CFG++ features surprisingly simple fixes to CFG but offers significant improvements, including better text-to-image generation sample quality, reversibility, smaller guidance scales, reduced pattern collapse, and more. Additionally, CFG++ seamlessly interpolates between unconditional and conditional sampling at lower guidance scales, consistently outperforming traditional CFG at all scales. Experimental results confirm that our approach significantly enhances text-to-image generation, DDIM inversion, editing, and solving inverse problems, demonstrating the wide-ranging impact and potential applications of our method in various domains utilizing text guidance.

ComfyUI recently introduced a sampling method called Euler A++, based on CFG++ technology.

Finally, the SDXL model's long-standing deficiencies in saturation, contrast, have been addressed while optimizing scenarios with low CFG values that previously resulted in blurry and overexposed images.

It perfectly supports models with low CFG parameters like HYPER, Lightning, LCM, Turbo, compensating for losses in image quality.

Compatible with CADS \ UNIT \ ACG \ MIST XL series acceleration models (Hyper), not only does it provide better inference sampling results within 8-10 steps, but also further enhances image quality.

This workflow for CFG++ sampler image generation configuration aims to inspire more applications supporting new technologies and sustain the prosperity of the SDXL ecosystem!

The CFG++ workflow configuration is equally user-friendly, avoiding cryptic methods (AiARTiST has always believed that practical value lies in technology that can be diffused).

Make sure to update ComfyUI to versions after June 26, 2024

————————————————————————————————————————