we use LoRA to improve ID consistency. IP-Adapter-FaceID can generate various style images conditioned on a face with only text prompts.
https://huggingface.co/h94/IP-Adapter-FaceID
Description
FAQ
Comments (5)
anyone else have an issue combining this with openpose, canny, depth etc? faces work but poses wont.
This is due to the Plus effect of the IPAdapter. You might want to segment your image or use a mask to control what it takes into effect, as I noticed the Plus component dragging everything into the new image.
I know how to use LORAs but how is this one used? Where does the ref picture go?
For anyone still looking:
You have to apply this LoRa + the associated controlnet + the associated faceid preprocessor. Your source image goes into the controlnet reference.
This is important as the LoRa works in a different way from the ControlNet which uses embeddings to inject the FaceID data AND (as this is a plus IPAdapter) data about the image. There is also a "pure" FaceID branch of the IPAdapter that does not add the Plus data but the FaceID data only. You CAN use both, and they do work together.
Good to know: As the ControlNet is based on embeddings, every model reacts differently to any source FaceID. Some models are better suited to create some faces and face shapes. A depth map or other CN might also help to get the egghead you need for your character ;)
1) You have to use this with ControlNet IP-Adapter (PreProcessor id-adapter_face_id_plus, Model ip-adapter-faceid-plusv2_sd15)
2) it sometimes conflicts with other loras, a solution is to use Adetailer on face detection with ControlNet Passthrough
Details
Files
ip-adapter-faceid-plusv2_sd15_lora.safetensors
Mirrors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid_plusv2_sd15_lora_lol.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
ip-adapter-faceid-plusv2_sd15_lora.safetensors
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.
