Project by <a target="_blank" rel="ugc" href="https://aiartlab.org">AiArtLab</a>Colorfulxl is out! But who cares then we have so great 1.5 checkpoint?<a target="_blank" rel="ugc" href="https://civarchive.com/models/185258/colorfulxl">https://civarchive.com/models/185258/colorfulxl</a>Thank you so much for the feedback and examples of your work! It's very motivating.<h2 id="heading-16">About v 8.0:</h2>This is a unique synthesis of cinematic, photos, anime and art.<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/d825e4e6-62fa-4e49-bc7d-f4024a7c64b5/width=525/d825e4e6-62fa-4e49-bc7d-f4024a7c64b5.jpeg" />I think this is the final version. Most likely I'll do ColorfulXL now. At the moment I don't see anything else that can be improved. Thanks to everyone who has been with me all this time (more then year)! Try different resolutions and check 1-step generation with DPM adaptive (but other samplers, with 10 steps may be faster)My settingsPortrait: 768*1088Landscape: 576*1280Samplers: DPM++2M SDE Karras - 20 steps, best (work with 10)Also work: Euler a, DPM2, DPM++2s a, DPM++ SDE, DPM++ 2s a KarrasDPM adaptive - 1 stepVAE - included! (civitai bug requires indication of a VAE that is not on this site: vae-ft-mse-840000-ema-pruned.safetensors)About v 7.3:A very controversial and complex version.Very sensitive to negative prompt, sampler, resolution and number of steps. Probably bad at art.In fact, an attempt was made to remake SD1.5 globally. Which often leads to incorrect anatomy. Still, I think it's an interesting version and I'm curious what you can create with it.Before<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/f747364f-e339-470b-b184-2436c9254ae2/width=525/f747364f-e339-470b-b184-2436c9254ae2.jpeg" />After<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/23381b36-021d-4e04-b1b6-c3dedec73cbc/width=525/23381b36-021d-4e04-b1b6-c3dedec73cbc.jpeg" />Most huge train details<a target="_blank" rel="ugc" href="https://wandb.ai/recoilme/finetuning/runs/nkfsrchd">https://wandb.ai/recoilme/finetuning/runs/nkfsrchd</a>About v 6.2:I don't have luck with hires training (1280 - just throw in trash millions steps and $70)So, i returned to v3.7 as a base and trained on 960*576, 576*960 and 768*768. Some cinematic added. But its not photorealistic model (i like art), mostly semi-realisticPlease respect my time and resources. If you use my model to make money - contact me for fair useAbout v 5.0:It was hard. But cheap) I spent less then $30 and ~1000 civitai credits on train.At 1st of all i preserve ability to generate in 9-12 steps on 768/832 resolution. By my opinion quality is better then Turbo/LCM. But it works only on some samplers<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/7f2a385c-8c4f-406e-b13d-1b860d2f84bc/width=525/7f2a385c-8c4f-406e-b13d-1b860d2f84bc.jpeg" />So, at 1st of all i continue playing with negative training. At this time i train deformed, worst_quality, oversaturated and so on loras<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/5066c256-8215-43c0-b9a9-342fd1fb9d15/width=525/5066c256-8215-43c0-b9a9-342fd1fb9d15.jpeg" />And merge it with different weights, like -0.3You will be surprised how many trash in SD 1.5!<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/2448f504-ddc8-48e7-97ce-2acf5a9c91cd/width=525/2448f504-ddc8-48e7-97ce-2acf5a9c91cd.jpeg" />At same time i train realistic checkpoint. Realistic is trickyFor example "woman, covered by snow", looks like<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/b167038f-5bc0-423a-8aba-acf0d0ffd837/width=525/b167038f-5bc0-423a-8aba-acf0d0ffd837.jpeg" />But thanks to Supermerger team and my brilliant cosine similarity merge algo, we may fix it to something like this<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/a03ef63d-cef8-4834-a8a7-3bb69de98fd7/width=525/a03ef63d-cef8-4834-a8a7-3bb69de98fd7.jpeg" />best ratio, a photo of attractive stunning Ukrainian woman, messy bun, covered by snow, skin pores, behind glacial mountains, snow, high detailed skin, film grainAnd lastAnatomy not ideal at hi res, images was cherrypicked from batch 4 on 832*1024. If you want more stable anatomy try 768 on 960 and lowHave fun!About v 4.6:I create 'ugly' dataset<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/668f5c8f-567c-4a55-9a3f-725177406bb8/width=525/668f5c8f-567c-4a55-9a3f-725177406bb8.jpeg" />And train on it, and merge with 'add difference'After that anatomy little better on 768*968, 968*768 and so on, before<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/9125b67f-86c8-437a-981b-3586aafdc9f6/width=525/9125b67f-86c8-437a-981b-3586aafdc9f6.jpeg" />after<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/39df7683-0320-4629-8595-6fc816fbee00/width=525/39df7683-0320-4629-8595-6fc816fbee00.jpeg" />But it was oversaturated:After a longer study, I discovered that this method gives a very large shift and, unfortunately, while correcting in one place, it breaks in another. This is no better than other methods available to us or direct training.So, i train again, but on "good images", and merge with cosine similarity<img src="https://image.civitai.com/xG1nkqKTMzGDvpLrqFT7WA/0d37775b-9048-423c-84a5-dbb68608140f/width=525/0d37775b-9048-423c-84a5-dbb68608140f.jpeg" />Strange, but i found what it may produce hi quality images at low steps in some casesAbout v 3.7:What's on the train. Compared to SDXL it is 10 times faster, I overfitted out of habit, saved the low lr 4e-7 and the adafactor (although I didn’t cut much). After 4 epochs the result is absolutely normal. Over the course of a night and an evening, she learned the realistic model, so much so that she forgot everything she had been taught all these years. I trimmed it with merging. Charged it for another 4 epochs - again it floated into realism. Trimmed it again)Something like that little by little. Taught in a multi aspect ratio with an emphasis on portrait and landscape generation. Few people like to generate squares. Dolls/cartoon - etched to a state by a certain semi-realist. Hands/faces in the distance/composition - better, but not perfectThe optimal resolution is 768 by 960. A negative prompt has a very strong effect on the quality, see the examples - I did well with this negative, but with the basic one it was kind of crap. Idnk why is this soOf course, it wasn’t possible to make SDXL from 1.5 overnight, but I’m happy as an elephant with the result)Contacts<ul><li><a target="_blank" rel="ugc" href="https://t.me/whargarbl">telegram</a> (russian)</li><li><a target="_blank" rel="ugc" href="https://www.youtube.com/channel/UC6Jt1FJ59xNbfww3fhCJxjA">youtube</a></li></ul>Models<ul><li><a target="_blank" rel="ugc" href="https://civarchive.com/models/7279/colorful">Colorful</a></li><li><a target="_blank" rel="ugc" href="https://civarchive.com/models/21916/animatrix">Animatrix</a></li></ul>

Colorful

Mixed with <a target="_blank" rel="ugc" href="https://huggingface.co/thiros/YuzuLemonTea">https://huggingface.co/thiros/YuzuLemonTea</a>Script is here: <a target="_blank" rel="ugc" href="https://github.com/recoilme/losslessmix/">https://github.com/recoilme/losslessmix/</a>The anime models are very dark, so I mixed with the colorful_v1.4, start from simple mix with some share (0.5 or 0.7, don't remember): <a rel="ugc" href="https://imgur.com/a/zhunzs3">result</a>And mix result with different share about 10 times, before anime was converted to semi - real. <pre><code>python3 weightedsim.py colorful_v14.ckpt yuzulemonmilk.ckpt --s .77

python3 weightedsim.py colorful_v14.ckpt merged-0.77.ckpt --s .76

python3 weightedsim.py colorful_v14.ckpt merged-0.76.ckpt --s .75

#After that i mix again with good old, not anime models like unstableinkdream

python3 weightedsim.py colorful_sr.ckpt unstableinkdream.ckpt --out ttt</code></pre>

Files with SHA256: 00caf369a7e6c91dc8ef25898a324af047d0ad476602cbe9d051985132bd11a2