I'm not the original author of the model, created by TencentARC all credit goes to them.Important Notes:<ul><li>I have 8GB VRAM GPU and I saw times between 12 seconds and 120 seconds to generate an image between 512x512 to 1024x1024 so it depends what settings you use</li><li>I highly recommend switching from KSAMPLER to SHARKSAMPLER as it delivers way better results for this model <a target="_blank" rel="ugc" href="https://huggingface.co/TencentARC/flux-mini/tree/main">https://huggingface.co/TencentARC/flux-mini/tree/main</a><h3 id="diffusion_models-version-lrjspf7o8">diffusion_models version</h3><ul><li>this is the original format as provided by the authors</li></ul><ul><li>This is a Flux Transformers Format based model that means Load Checkpoint node will not work in ComfyUI for this version</li><li>The file must be placed in the <code>diffusion_models</code> directory for it to be found by `Load Diffusion Model` node.</li><li>To use it you must use the Load Diffusion Model node to load the model and then just the traditional Flux setup for the rest will work.</li></ul><h3 id="checkpoints-version-mtoqj7k9x">checkpoints version</h3><ul><li>this is the format that has been converted by me to work with Load Checkpoint node</li><li>This is still in Flux Transformers Format but has had the keys of the structure prefixed to work with Load Checkpoint</li><li>This file must be placed in the <code>checkpoints</code> directory for it to be found by the Load Checkpoint node.</li><li>To use it you must use the Load Checkpoint node to load the model, it does not have the CLIP and VAE baked in so you must still source that elsewhere</li><li>Use DualClipLoader and Load VAE to get those into your workflow as usual</li></ul><h3 id="q8-version-97wefx5yj">q8 version</h3><ul><li>this is the format that has been converted to unet format and then quantsized to q8 gguf</li><li>This file must be placed in the <code>unet</code> directory for it to be found by the UNET Loader node.</li><li>To use this you must have this third party extension installed Unet Loader (GGUF)</li><li>This reduces the file to 3GB in size and further improvements in speed and total VRAM requirements with only a 0.1% difference between this and the original file.</li></ul><h3 id="aio-version-(all-in-one)-12f1j966z">aio version (all in one)</h3><ul><li>this is similar to the checkpoints format if you just want to use Load Checkpoint without having to also use DualClipLoader and Load VAE seperately</li><li>You can use this with the default workflow just pick the file and it should work out the box</li><li>Baked in T5 Model: t5xxl_fp8_e4m3fn.safetensors</li><li>Baked in CLIP-L: ViT-L-14-TEXT-detail-improved-hiT-GmP-TE-only-HF.safetensors</li><li>This one should deliver the fastest results ideally, q8 might still be faster, need further testing to determine.</li></ul></li></ul>A 3.2B MMDiT distilled from Flux-dev for efficient text-to-image generation Nowadays, text-to-image (T2I) models are growing stronger but larger, which limits their practical applicability, especially on consumer-level devices. To bridge this gap, we distilled the 12B <code>Flux-dev</code> model into a 3.2B <code>Flux-mini</code> model, trying to preserve its strong image generation capabilities. Specifically, we prune the original <code>Flux-dev</code> by reducing its depth from <code>19 + 38</code> (number of double blocks and single blocks) to <code>5 + 10</code>. The pruned model is further tuned with denoising and feature alignment objectives on a curated image-text dataset.We empirically found that different blocks have different impacts on the generation quality, thus we initialize the student model with several most important blocks. The distillation process consists of three objectives: the denoise loss, the output alignment loss as well as the feature alignment loss. The feature alignment loss is designed in a way such that the output of <code>block-x</code> in the student model is encouraged to match that of <code>block-4x</code> in the teacher model. The distillation process is performed with <code>512x512</code> Laion images recaptioned with <code>Qwen-VL</code> in the first stage for <code>90k steps</code>, and <code>1024x1024</code> images generated by <code>Flux</code> using the prompts in <code>JourneyDB</code> with another <code>90k steps</code>.Github link: <a target="_blank" rel="ugc" href="https://github.com/TencentARC/flux-toolkits">https://github.com/TencentARC/flux-toolkits</a>

Flux Mini 3B

This version is the simplest to use, should work with the default workflow, no extra nodes. Components<ul><li>CLIP L: ViT-L-14-TEXT-detail-improved-hiT-GmP-TE-only-HF.safetensors</li><li>T5: t5xxl_fp8_e4m3fn.safetensors</li><li>Model: 'checkpoints' model aka flux-mini-prefixed.safetensors</li></ul>This model has been packaged to include all the pieces needed to just work out of the box, additionally rather than using the base CLIP L model I've swapped it out for the upgraded fine tuned version that should deliver better text performance.

Files with SHA256: 9cfb1989e24cbb7e351a769133bae8b855e8ad46f552329b0d934c9a969fcef6