Use this workflow for inpainting with Flux using Krita tool. If you don't use Krita Ai Diffusion (GitHub - Acly/krita-ai-diffusion: Streamlined interface for generating images with AI in Krita. Inpaint and outpaint with optional text prompt, no tweaking required.), this may be irrelevant to you!
Version 2.11:
Updated workflow based on Flux Tools - Flux Fill Model
The weight I used is from Flux1 Fill Dev fp8 e4m3fn - v1.0 | Flux Checkpoint | Civitai
For Old Version:
For basic inpainting workflow, you can use the version explained here: How to Inpaint FLUX with ComfyUI. BEST Workflows including ControlNet and LoRA. (Please look for his git page in the video description for workflow)
Download the control net model from here: alimama-creative/FLUX.1-dev-Controlnet-Inpainting-Beta · Hugging Face
Please tip buzz if you like it!!!
Instructions:
(Please refer images from old version as well if the below is not clear)
1. Start ComfyUI Server (from the ComfyUI installation folder)
2. Extract the downloaded workflow and Drag and Drop the extracted workflow to the UI (or you can open it directly from the graph)
3. Open Krita and change AI Image Generation type to Graph (If you don't have graph, please update the plugin (Interstice)
4. Select the workflow using the selection bar next to the Image Generation Type dropdown. If it shows , ComfyUI Web (.....), you are all set.
5. Open any image and create a mask. You can alternatively select some area of your image to create a "selection mask".
6. Enter prompt & make changes in settings
7. Click generate to generate images
(If not clear, watch Krita AI Plugin - ComfyUI Custom Workflows)
Note: Most of the Lora does not work well with the current Beta version of Control net model. However, you can use hyper lora.
I login every once in a while so I won't be able to answer questions!
Description
Updated the workflow based on Flux Fill Dev model and simplified the workflow
FAQ
Comments (5)
How is it different from ai diffusion inpainting?
AI Diffusion inpainting is "not fully integrated" as per the statement given by Acly even on latest release 1.29.0. I tried inpainting with 1.27 version in the past but I was not getting expected results so I started using the custom workflow for convenience and easier edit/control. I haven't really tried Flux inpainting with recent plugin versions as I started to like the workflow more.
did some one have this error
invalid load key, '\x03'.
it seem error on the load checkpoiint mode >
please edit workflow (click edit link in Krita and it will open up the workflow in a web browser for editing). Then select the right checkpoint name that is available in your local and select the right Lora name in your local.
Your link to Flux1 Fill Dev fp8 e4m3fn - v1.0 | Flux Checkpoint | Civitai is 404.