Warning: Although these quants work perfectly with ComfyUI - I couldn't get them to work with Forge UI yet. Let me know if this changes. The original non-k quants can be found <a target="_blank" rel="ugc" href="https://civarchive.com/models/662112/gguf-flux-unchained">HERE</a> which are verified working with Forge UI.[Note: Unzip the download to get the GGUF. Civit doesn't support it natively, hence this workaround]GGUF version of FluxUnchained by <a target="_blank" rel="ugc" href="https://civarchive.com/user/socalguitarist">socalguitarist</a> . Credit goes to him for tuning this model. More specifically these are the K (_M) quants for this model. K quants usually lead to better quality for the same model size. Also, the inference can be slightly faster. The non-K quants can be found <a target="_blank" rel="ugc" href="https://civarchive.com/models/662112/gguf-flux-unchained">here</a>.It can be used in ComfyUI with this <a target="_blank" rel="ugc" href="https://github.com/city96/ComfyUI-GGUF">custom node</a>. But I couldn't get these to work with Forge UI.See <a target="_blank" rel="ugc" href="https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/1050">https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/1050</a> to learn more about Forge UI GGUF support and also where to download the VAE, clip_l and t5xxl models.<h3 id="which-model-should-i-download-sltqbl8zj">Which model should I download?</h3>[Current situation: Using the updated Comfy UI (GGUF node) I can run all of these quants on my 11GB 1080ti.]Download the one that fits in your VRAM. The additional inference cost is quite small if the model fits in the GPU. Size order is Q2 &lt; Q3 &lt; Q4 &lt; Q5 &lt; Q6. However, I wouldn't recommend using Q2 and Q3 unless you absolutely have to, because they tend to mess up text and finer details.All the license terms associated with Flux.1 Dev apply.

GGUF_K: Flux Unchained K_M Quants

ggufKFluxUnchainedKM_q2K.zip

Files with SHA256: 2d7c102ca2d56797c844ca7cbf07d224964fb30f3ebe8cbb15dd70bc22d5d419