<h1 id="transform-your-images-with-natural-language-instructions-df83pelye">🔮 Transform Your Images with Natural Language Instructions</h1><h2 id="the-perfect-companion-for-seamless-editing-sljgn240m">The Perfect Companion for Seamless Editing</h2>This guide outlines a complete workflow using FluxFill-Dev with ICEdit-MoE-LoRA for powerful natural language-based image editing.<h2 id="overview:-the-future-of-image-editing-is-here-0qyeoxh04">📝 Overview: The Future of Image Editing is Here</h2>ICEdit-MoE-LoRA represents a breakthrough in AI image editing - a lightweight Low-Rank Adaptation (LoRA) module that brings professional-grade, instruction-based editing capabilities to large diffusion transformers. By intelligently fine-tuning only 1% of parameters using just 0.5% of the original training data, it achieves extraordinary editing capabilities that match or even surpass premium commercial solutions.<h2 id="complete-workflow-4d450tgu9">📌 Complete Workflow</h2>This workflow combines FluxFill + ICEdit-MoE-LoRA for editing images with natural language instructions. For enhanced results, diffusion models like <a target="_blank" rel="ugc" href="https://civarchive.com/models/1534861">LEOPARD</a> , <a target="_blank" rel="ugc" href="https://civarchive.com/models/682369">Bernoulli</a> or <a target="_blank" rel="ugc" href="https://civarchive.com/models/661102/speedq8">SPEED_Q8</a> with the Gemini auto prompt node in 4-8 steps.(i used very light flux model which need less steps)<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/4bd1da3b-263a-4157-9176-3ef522066252/width=525/4bd1da3b-263a-4157-9176-3ef522066252.jpeg" />A diptych with two side-by-side images of the same scene. On the right, the scene is the same as on the left but "your edit"(prostyle included just put ur edit)<h2 id="complete-installation-guide-i63wumgmw">🛠️ Complete Installation Guide</h2><h3 id="setup-structure-akvqb7t8c">📁 Setup Structure</h3><pre><code>📂 ComfyUI/
├── 📂 models/
│ ├── 📂 diffusion_models/
│ │ ├── (basic)📄 fluxfill-dev.safetensors # https://civarchive.com/models/1108146/fluxfill-devgguf
│ │ ├──(option1)📄 LEOPARD.gguf # https://civarchive.com/models/1534861
│ │ ├──(option2)📄 Bernoulli.gguf # https://civarchive.com/models/682369
│ │ └──(option3)📄 SPEED_Q8.gguf # https://civarchive.com/models/661102/speedq8
│ ├── 📂 text_encoders/
│ │ ├── (basic)📄 clip_l.safetensors
│ │ ├── (option1)📄 t5xxl_fp16.safetensors
│ │ ├── (option2)📄 t5xxl_fp8_e4m3fn.safetensors
│ │ └── (option3)📄 t5xxl_fp8_e4m3fn_scaled.safetensors
│ ├── 📂 vae/
│ │ └── 📄 ae.safetensors
│ └── 📂 lora/
│ └── 📄 ICEdit-MoE.safetensors
</code></pre><h2 id="essential-components-366qa68gi">💎 Essential Components</h2><h3 id="lora-models-the-magic-touch-sdes52ji1">✨ LoRA Models - The Magic Touch</h3><ul><li><a target="_blank" rel="ugc" href="https://civarchive.com/models/1534577/icedit">ICEdit-MoE.safetensors - The star of the show!</a></li></ul><h3 id="text-encoders-the-brain-behind-natural-language-understanding-h6rvt589s">🔤 Text Encoders - The Brain Behind Natural Language Understanding</h3>Note: You only need to choose ONE of the T5XXL options below based on your hardware capabilities<ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/Comfy-Org/stable-diffusion-3.5-fp8/blob/main/text_encoders/clip_l.safetensors">clip_l.safetensors - Core understanding model</a></li><li>T5XXL Options (choose only one):<ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/Comfy-Org/stable-diffusion-3.5-fp8/blob/main/text_encoders/t5xxl_fp16.safetensors">t5xxl_fp16.safetensors - Highest quality, more demanding</a></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/Comfy-Org/stable-diffusion-3.5-fp8/blob/main/text_encoders/t5xxl_fp8_e4m3fn.safetensors">t5xxl_fp8_e4m3fn.safetensors - Balanced performance</a></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/Comfy-Org/stable-diffusion-3.5-fp8/blob/main/text_encoders/t5xxl_fp8_e4m3fn_scaled.safetensors">t5xxl_fp8_e4m3fn_scaled.safetensors - Optimized for speed</a></li></ul></li></ul><h3 id="vae-the-visual-artist-offuq5qjf">🎭 VAE - The Visual Artist</h3><ul><li><a target="_blank" rel="ugc" href="https://huggingface.co/Comfy-Org/HiDream-I1_ComfyUI/resolve/main/split_files/vae/ae.safetensors?download=true">ae.safetensors - Included in the FluxFill package</a></li></ul><h3 id="diffusion-models-the-imaging-engine-ba2a26631">🖼️ Diffusion Models - The Imaging Engine</h3><ul><li><a target="_blank" rel="ugc" href="https://civarchive.com/models/1108146/fluxfill-devgguf">fluxfill-dev.safetensors - Core diffusion model for editing</a></li></ul>##(You only need to choose ONE of those or use flux-dev itself its up to u)<ul><li><a target="_blank" rel="ugc" href="https://civarchive.com/models/1534861">LEOPARD.safetensors - Advanced diffusion model for refined outputs</a></li><li><a target="_blank" rel="ugc" href="https://civarchive.com/models/682369">Bernoulli.safetensors - Alternative diffusion model for enhanced generation</a></li><li><a target="_blank" rel="ugc" href="https://civarchive.com/models/661102/speedq8">SPEED_Q8.gguf - Enhanced flux-dev model for improved results</a></li></ul>Note: Any of these diffusion models can be used for efficient editing with fewer steps (4-8 steps recommended). Use flux-dev-fill for editing and flux-dev for enhancing results.<h3 id="-lsf3ae2n3"></h3><h2 id="example-instructions-you-can-try-mzbfso4na">🎬 Example Instructions You Can Try</h2><ul><li>"Add a majestic castle on the mountain in the background"</li><li>"Change the color of the car from red to electric blue"</li><li>"Remove the person from the image and replace with a flowering tree"</li><li>"Transform the style to watercolor painting while maintaining all details"</li><li>"Add dramatic sunset lighting to the scene"</li></ul><h2 id="developer-information-a139455yx">👨‍💻 Developer Information</h2>This workflow guide was created by Abdallah Al-Swaiti:<ul><li><a target="_blank" rel="ugc" href="https://www.linkedin.com/in/abdallah-issac/">LinkedIn Profile</a></li><li><a target="_blank" rel="ugc" href="https://github.com/al-swaiti">GitHub</a></li><li><a target="_blank" rel="ugc" href="https://huggingface.co/ABDALLALSWAITI">Hugging Face</a></li></ul>For additional tools and updates, check out the OllamaGemini Node: <a target="_blank" rel="ugc" href="https://github.com/al-swaiti/ComfyUI-OllamaGemini">GitHub Repository</a><h2 id="community-recognition-yhvchotuu">🙏 Community Recognition</h2>A special thank you to sanaka87 for revolutionizing open-source image editing by releasing the ICEdit-MoE-LoRA checkpoint and demos. Your contribution empowers creators everywhere and accelerates innovation across the AI art community!<img src="https://media.licdn.com/dms/image/v2/D4E22AQGWF0ZHIpw_Cw/feedshare-shrink_1280/B4EZbKjspeHcAo-/0/1747155079532?e=1750291200&amp;v=beta&amp;t=T8ORFEFvxKcyrqVGHjDH7ms7GY-eNXoRvpuO1qEVA1E" alt="No alternative text description for this image" />

Files with SHA256: 5abe308d4d3128ce6a1f6fd1a2bc3d53934fc3bd95ba61fd08d87900105f700e