Flux.1-Dev Hyper NF4: Source: <a target="_blank" rel="ugc" href="https://huggingface.co/ZhenyaYang/flux_1_dev_hyper_8steps_nf4/tree/main">https://huggingface.co/ZhenyaYang/flux_1_dev_hyper_8steps_nf4/tree/main</a> from <a target="_blank" rel="ugc" href="https://huggingface.co/ZhenyaYang">ZhenyaYang </a>converted <a target="_blank" rel="ugc" href="https://huggingface.co/ByteDance/Hyper-SD">Hyper-SD</a> to NF4 (8 steps) Flux.1-Dev BNB NF4 (v1 &amp; v2): Source: <a target="_blank" rel="ugc" href="https://huggingface.co/lllyasviel/flux1-dev-bnb-nf4/tree/main">https://huggingface.co/lllyasviel/flux1-dev-bnb-nf4/tree/main</a> from <a target="_blank" rel="ugc" href="https://huggingface.co/lllyasviel">lllyasviel</a> Flux.1-Schnell BNB NF4: Source: <a target="_blank" rel="ugc" href="https://huggingface.co/silveroxides/flux1-nf4-weights/tree/main">https://huggingface.co/silveroxides/flux1-nf4-weights/tree/main</a> from <a target="_blank" rel="ugc" href="https://huggingface.co/silveroxides">silveroxides</a> ComfyUI: <a target="_blank" rel="ugc" href="https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4">https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4</a> Forge: <a target="_blank" rel="ugc" href="https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/981">https://github.com/lllyasviel/stable-diffusion-webui-forge/discussions/981</a> 💪Train your own model: <a target="_blank" rel="ugc" href="https://runpod.io?ref=gased9mt">https://runpod.io?ref=gased9mt</a> 🍺 Join my discord: <a target="_blank" rel="ugc" href="https://discord.com/invite/pAz4Bt3rqb">https://discord.com/invite/pAz4Bt3rqb</a>

Flux.1-Dev Hyper NF4 + Flux.1-Dev BNB NF4 + Flux.1-Schnell BNB NF4

flux1DevHyperNF4Flux1DevBNB_flux1SchnellBNBNF4.safetensors

Flux.1-Schnell Hyper BNB NF4

Flux.1-Schnell BNB NF4

Flux.1-Dev Hyper NF4

Flux.1-Dev BNB NF4 v2

Flux.1-Schnell NF4

Flux.1-Dev BNB NF4 v1

<ol><li>NF4 and FP8 Checkpoints:<ul><li>NF4 Checkpoint (flux1-dev-bnb-nf4.safetensors): Optimized for performance with speed improvements ranging from 1.3x to 4x compared to FP8, depending on the GPU and software setup. NF4 is now the recommended format for most users with compatible GPUs (RTX 3XXX/4XXX series).</li><li>FP8 Checkpoint (flux1-dev-fp8.safetensors): Provided as an alternative for older GPUs that do not support NF4.</li></ul></li><li>Performance Improvements:<ul><li>NF4 demonstrates faster inference speeds and reduced memory usage compared to FP8, making it highly efficient for image diffusion tasks.</li><li>The NF4 utilizes multiple tensor precisions (float32, float16, uint8, int4) to achieve higher numerical precision and dynamic range, outperforming FP8 in most scenarios.</li></ul></li><li>Distilled CFG Guidance:<ul><li>Flux-dev now includes distilled model guidance, where CFG is recommended to be set at 1 with a new "Distilled CFG Guidance" feature set at 3.5 for optimal results. Negative prompts are discouraged in this setup.</li></ul></li></ol><h2 id="installation-and-usage-instructions(comfyui):-wumi6n8nj">Installation and Usage Instructions(ComfyUI):</h2>NF4-BnB Node is now available at ComfyUI Manager. Need to select 'Channel: dev' in order to find it.<ul><li>1. Clone the Official Node: Clone the <a target="_blank" rel="ugc" href="https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4">official ComfyUI NF4 Node</a> repository into the <code>custom_nodes</code> folder using the following command: <code>git clone https://github.com/comfyanonymous/ComfyUI_bitsandbytes_NF4.git</code></li><li>2. Install Dependency:<ul><li>Activate Virtual Environment(venv).</li><li>Install or update the <code>bitsandbytes</code> package with the following command: <code>pip install -U bitsandbytes</code></li></ul></li><li>3. Update Requirement: Ensure your ComfyUI is up to date.</li><li>4. Node Setup: Use the <code>CheckpointLoaderNF4</code> node in your Flux workflow, replacing the regular checkpoint loader node.Workflow containing NF4 node included in post files. (.zip json - training data)</li><li>For ComfyUI Portable Version:<ul><li>1. Ensure your ComfyUI is up to date and that the NF4 Node is placed inside the <code>custom_nodes</code> directory.</li><li>2. From the <code>[comfy install dir]</code> directory, run the following command to install the required packages: <code>python_embeded\python.exe -m pip install -r ComfyUI\custom_nodes\ComfyUI_bitsandbytes_NF4\requirements.txt</code> This command should be executed at the root of the ComfyUI directory for the portable version.</li></ul></li></ul> Compatibility: Users with older GPUs or specific setups (like GTX 10XX/20XX) are cautioned to use the FP8 checkpoint, as their devices may not support NF4. Additionally, loading FP8 checkpoints with NF4 options can lead to unnecessary delays and reduced quality. Credits to: <a target="_blank" rel="ugc" href="https://github.com/lllyasviel">lllyasviel</a>

NF4 - Flux.1

Version Credit: <a target="_blank" rel="ugc" href="https://huggingface.co/silveroxides">silveroxides</a>

nf4Flux1_schnellNF4Bnb.safetensors

Schnell NF4-BnB

NF4-BnB

Files with SHA256: e6cba6afca8b2f5599879111e1a5f3dabebe69bcc3ee4a6af46807447adc6d09