PhotoMerge - CivArchive (CivitAI Archive)

PhotoMerge - v1.2-inpainting

works well with natural language with some tags at the end. use updated v1.5 vae (or whatever vae you want, i'm not your mom).

trigger words aren't need imo. I also recommend a low cfg value like 3.5 or 5. 512x768, 512x512, or 768x768 likely works best, then use hi-res or img2img to get a higher resolution. model was not created with nudity in mind, but it can be unintentionally horny sometimes, so prompt accordingly (simpler prompts get hit harder by this, so be descriptive in what you want).

images generated with DEIS using onnxdiffusersui with max attention slicing, so you probably won't be able to recreate them with auto1111 due to how it handles seeds. quality should be comparable though.

Description

not tested much yet, but results seem good.

FAQ

Comments (21)

Kappa_NeuroFeb 10, 2023

CivitAI

Please indicate in the tags that this is NSFW, porn or erotica.

xzuyn

Author

Feb 10, 2023· 2 reactions

ive marked the images that are nsfw as nsfw. this model isn't specifically for nsfw content, and doesn't use nsfw oriented models.

unstablestDiffuserFeb 10, 2023

CivitAI

Hey, love this mix! Would you share the reddit post for that merge method?

xzuyn

Author

Feb 10, 2023· 3 reactions

https://github.com/xzuyn/OnnxDiffusersUI/blob/main/triMerge.py

modifed the code from here to take safetensors.
https://www.reddit.com/r/StableDiffusion/comments/1012lto/proposal_of_model_merging_technique_that_should/j2sf2kt/

mctwostFeb 11, 2023

CivitAI

Tried to look for DEIS sampler but couldn't find anything about it, can you share some info on that? would love to give it a try.

xzuyn

Author

Feb 11, 2023· 1 reaction

it was added in diffusers version 0.12.0, it is similar to the dpms schedulers, but better imo.

https://huggingface.co/docs/diffusers/api/schedulers/deis

mctwostFeb 11, 2023

@xzuyn I see, sorry to bother you again with this, im quite new and hard to find info. You know if it can be used on automatic1111? after updating webui and extensions still not there. Thanks for the info mate

xzuyn

Author

Feb 11, 2023

@mctwost i can't find anything about automatic1111 adding it, so unless you know how to edit the code to accept "DEISMultistepScheduler" as a scheduler, you won't be able to use it yet.

I don't use a1111 for anything other than merging checkpoints atm, so if you want you can make a feature request for "DEISMultistepScheduler" here https://github.com/AUTOMATIC1111/stable-diffusion-webui/issues/new/choose

etaFeb 11, 2023

CivitAI

Have an unpruned version for merging our own trainings?

xzuyn

Author

Feb 11, 2023· 1 reaction

v1.1 and v1.2 already are unpruned. the 4gb versions are unpruned and should contain ema weights, and the 2gb versions are pruned fp16.

etaFeb 12, 2023· 1 reaction

@xzuyn Weird, and interesting! I restarted my computer and A1111 and merged again, and now they seem to be working. Okay. Whew!

xzuyn

Author

Feb 12, 2023

@eta weird. i cant do training so i haven't tested it. the 4gb model is the same model that came out of the merges. maybe the trimerge method messes with it. sad because i feel like this would be a decent base for training on.

etaFeb 12, 2023· 1 reaction

@xzuyn I edited my reply, something was being weird on my end it seems, whew!

xzuyn

Author

Feb 12, 2023

@eta oh thats great. glad i can use this to train on once training becomes possible for amd users.

xzuyn

Author

Feb 12, 2023

CivitAI

let me know if there are any other high quality trained models, and i will test out a merge with them.

LuthFeb 19, 2023

CivitAI

how do I use the 1.5 vae?

xzuyn

Author

Feb 19, 2023

if you use automatic1111, rename the vae to the same as the model and put it in the same folder as the model.

if you use onnxdiffusersui, you need to convert it with the model using --vae_path with https://github.com/Amblyopius/Stable-Diffusion-ONNX-FP16/blob/main/conv_sd_to_onnx.py

im unsure how to do it with other softwares.

gagan602Jun 26, 2023

CivitAI

Hi,

very interesting. could you pls share the exact workflow? where to put the two images that will be merged in auto1111?

xzuyn

Author

Jun 26, 2023

I didn't use A1111, and I didn't merge any images. I used a script I found on reddit to merge 3 models at a time; https://github.com/xzuyn/OnnxDiffusersUI/blob/main/triMerge.py

That's the modified the code from here to take safetensors; https://www.reddit.com/r/StableDiffusion/comments/1012lto/proposal_of_model_merging_technique_that_should/j2sf2kt/

Merge recipe:

1. wavymulder_AnalogModelPortrait_v1-0 = (AnalogDiffusion_v1-0 + ModelShoot_v1-0 + PortraitPlus_v1-0 @ triMerge)

2. wavymulder_MegaMix_v1-0 = (wavymulder_AnalogModelPortrait_v1-0 + TimelessDiffusion_v1-0 + LomoDiffusion_v1-0 @ triMerge)

3. PhotoMerge_v1-2 = (wavymulder_MegaMix_v1-0 + Dreamlike-Photoreal_v2-0 + RealisticVision_v1-3 @ triMerge)

gagan602Jun 27, 2023

@xzuyn thanks! i want to merge two images, so this wont be compatible for that ? cause in the images here, i see elements of one image in the other. or is that a coincidence?

xzuyn

Author

Jun 27, 2023

@gagan602 the inpainting examples?

Checkpoint

SD 1.5

by xzuyn

Download (Beta) View on CivitAI