Source <a target="_blank" rel="ugc" href="https://huggingface.co/city96/FLUX.1-dev-gguf/tree/main">https://huggingface.co/city96/FLUX.1-dev-gguf/tree/main</a> by <a target="_blank" rel="ugc" href="https://huggingface.co/city96">city96 </a> This is a direct GGUF conversion of Flux.1-dev. As this is a quantized model not a finetune, all the same restrictions/original license terms still apply. Basic <a target="_blank" rel="ugc" href="https://github.com/ggerganov/llama.cpp/blob/master/examples/perplexity/README.md#llama-3-8b-scoreboard">overview </a>of quantization types. The model files can be used with the ComfyUI-GGUF <a target="_blank" rel="ugc" href="https://github.com/city96/ComfyUI-GGUF">custom node</a>. Place model files in <code>ComfyUI/models/unet</code> - see the GitHub readme for further install instructions. Also working with Forge since the latest <a target="_blank" rel="ugc" href="https://github.com/lllyasviel/stable-diffusion-webui-forge/commit/1bd6cf0e0ce048eae49f52cf36ce7d0deede9d17">commit</a>! ☕ Buy me a coffee: <a target="_blank" rel="ugc" href="https://ko-fi.com/ralfingerai">https://ko-fi.com/ralfingerai</a> 🍺 Join my discord: <a target="_blank" rel="ugc" href="https://discord.com/invite/pAz4Bt3rqb">https://discord.com/invite/pAz4Bt3rqb</a>

Flux.1-Dev GGUF Q2.K Q3.KS Q4/Q4.1/Q4.KS Q5/Q5.1/Q5.KS Q6.K Q8

flux1-dev-Q4_K_S.zip

Q4.KS

Q2.K

Q3.KS

Q5.KS

Q6.K

Q5.1

Q4.1

Q5.0

Q4.0

Files with SHA256: 0dcbffa26e33901d1770ae9cd517ad4a834256c616fba60e0072822157499046