CivArchive
    EnvyBetterHands LoCon - alpha-2
    NSFW
    Preview 567257
    Preview 567254
    Preview 567376
    Preview 567281
    Preview 567181
    Preview 567353
    Preview 567228
    Preview 567335
    Preview 567332
    Preview 567333
    Preview 567352
    Preview 567369
    Preview 567182
    Preview 567226

    This model is a LoCon. You MUST install the Lycoris extension for it to load.

    I'm using Lora Block Weight. I believe you can also use Additional Networks and SD Webui Lycoris.

    UPDATE 4/27/2023: I've hit a training plateau so I'm in the process of adding a bunch more images to the dataset, including some more complicated stuff like intertwined fingers. I'm probably going to have to drop the learning rate some more, so things may be slower from here on. I'll keep everyone posted as things progress.

    UPDATE: Prompting advice for beta 2:

    • This is a completely new train on top of vanilla Stable Diffusion 1.5. I did this based on the advice of a fellow enthusiast, and it's surprising how much more compatible it is with different model. It doesn't mess with the style of your model at all as far as I can tell, and it really only affects hands and occasionally arms, leaving everything else untouched.

    • It seems to work best at a strength of 1, although turning up higher than that (1.5, 2, etc) can help it on some images at the cost of making it worse on others. No need to mess with your CFG scale, as it doesn't cause things to overcook at these levels.

    • Freely mix it with other LoRAs.

    • I've had best results putting "nice hands, perfect hands" in the positive prompt (increasing the weight makes things worse), and "(extra fingers, deformed hands, polydactyl:1.5)" in the negative prompt. This is on EnvyMix v1 (and probably RevAnimated), but YMMV for other models.

    • "Bad hands" negative embeddings appear to make it worse, although I haven't tested this extensively.

    • As usual, this won't work miracles, but I do find that over a large number of images, it does make things generally better on average. Hopefully this will continue to improve with a few more nights of training.

    Prompting advice for alpha 3 and beta 1:

    • Note that this advice is for RevAnimated 1.2. YMMV with other models.

    • It overcooks things a bit, but you need the strength set to 1.0 for it to really work well. You can work around this by reducing the CFG value to 5 or 6 or so. I've had good luck with enabling the dynamic thresholding extension and setting it to mimic CFG 5, and then I can set my CFG value to 9 or 10 and things come out fine.

    • I tried using it with another LoRA and got some pretty strange results, so YMMV there as well. Right now I'm just trying to get it to work consistently in a simple use case.

    • Oddly, I think it's regressed a bit on hands in neutral positions, but it's noticeably better at more complicated interactions, such as holding objects (which is why I have so many pictures of blacksmiths and librarians in the example images).

    • Keep your prompts simple and it tends to do better.

    • With RevAnimated, I tend to get 1 or 2 usable images out of every 8, with a bunch of other ones that are pretty close and can probably be fixed with inpainting.

    Prompting advice for alpha 2:

    • It's getting stronger now, and it works best around strength 1. Setting it to 1.3 like the previous version will make things look bad.

    • My negative prompt is still "(extra fingers, deformed hands:1.15), (worst quality, low quality, poor quality, bad quality:1.35)"

    • I had good luck just putting "nice hands" in the main prompt.

    Prompting advice For alpha 1:

    • Your prompt should contain these words: "beautiful hands, perfect hands, fingernails". I've had the best luck with them towards the middle, and at no emphasis.

    • The alpha1 LoCon seems to work best at a strength of around 1.3 (on RevAnimated 1.1, where I'm testing it right now -- YMMV for other models)

    • Don't use negative embeddings for improving hands. When I removed badhandv4 from my negative prompt, things improved noticeably. You may want to try without any negative embeddings at all. I haven't used them for a while now.

    • My negative prompt is: "(extra fingers, deformed hands:1.15), (worst quality, low quality, poor quality, bad quality:1.35)", which I arrived at through a lot of experimentation adjusting strengths and terms one at a time. It should work decently well.

    • This all gives me hope that there's a real shot at solving hands on SD 1.5. Even with good prompting, I'm generally not getting perfect results, but things are close. I'll consider this done when it creates well-formed hands without having to add anything to the positive or negative prompt.

    Now back to your regularly scheduled readme...

    I'm testing the theory that maybe the reason MidJourney's hands are so much better now is that they just took the time to specifically train a network on a high quality set of pictures of hands, and literally nobody else has actually tried. This LoRA definitely isn't at MidJourney levels yet, but I've been training it over night for several nights now and adding to the dataset where it appears deficient, and quality seems to be steadily improving. As such, I'm going to post this now so people can start using it. Consider this an early alpha -- I'll only stop updating once it stops getting better.

    Example images are cherry-picked. Please don't expect this model to make all of your hand generations better. It may even make some of them worse, so you should evaluate its usefulness on a large number of images and not just one. If it works for you like it does for me, the a lot of your results should be the same or better quality (some will just be bad in different ways).

    Description

    So the numbers this time are: 45% better, 27% tied, and 24% worse. It seems to do worse with the "skirt lift" pose for some reason, but in most other cases it's better.

    It also seems a lot stronger than yesterday's version, so if you were running it at a strength of 1.3, you may need to set it down to 1.0 or lose some image quality, although this could again vary by model.

    FAQ

    Comments (24)

    hetrevilmigufumc7092Apr 21, 2023
    CivitAI

    Good effort hope you succeed

    _Envy_
    Author
    Apr 21, 2023· 1 reaction

    yeah, so do I. :)

    I've noticed that hands in general have started to look better with all of the model mixes and training going on, so I think it's possible if the data is good enough. I figured it was time to speed that process along.

    Kenshin786Apr 21, 2023
    CivitAI

    can you kindly tell me how to use? like all loras? any trigger words or something? sorry i am bit of a noob

    _Envy_
    Author
    Apr 21, 2023

    Use it like any other LoRA. No trigger words necessary.

    ModerApr 21, 2023

    @_Envy_ So, it is actually a LoRA and not a LoCon as stated in the title? Otherwise the lycoris extension would be necessary, as far as I know.

    _Envy_
    Author
    Apr 21, 2023

    @Moder @PM786 That's a good point.

    OP, you need to install automatic1111's lycoris extension for this to work. Once you've got that installed, it'll work the same as any other lora.

    ModerApr 21, 2023

    @_Envy_ Great! Thx for the fast answer! Can't wait to try it out :D

    _Envy_
    Author
    Apr 21, 2023· 1 reaction

    @Moder So as I test it on other networks, I'm discovering that it may be very specific to EnvyMix. I'm testing it on RevAnimated and Cetus at the moment, with EnvyMix is made from. I can tell you that it that I've tested it on Deliberate (which already does hands better than most), and it shifts the style badly and actually makes the hands worse there.

    This is all pretty unexplored territory. The ability to make hands may turn out to be fragile, which could mean I'll be training a number of these.

    Edit: RevAnimated 1.1 seems to benefit from it. In addition to it helping render hands, I'm seeing more interesting hand positions.

    zaadsatanApr 21, 2023
    CivitAI

    Very interesting, I will stay tune on the progress, good luck!

    catpawzApr 21, 2023
    CivitAI

    I keep getting errors when using this Lora. om 99% sure its in the right directory but I'm not sure what's causing it.

    ctivating extra network lora with arguments [<modules.extra_networks.ExtraNetworkParams object at 0x0000022E5BBD34C0>]: RuntimeError Traceback (most recent call last): File "C:\Users\xcatp\stable-diffusion-webui\modules\extra_networks.py", line 75, in activate extra_network.activate(p, extra_network_args) File "C:\Users\xcatp\stable-diffusion-webui\extensions-builtin\Lora\extra_networks_lora.py", line 23, in activate lora.load_loras(names, multipliers) File "C:\Users\xcatp\stable-diffusion-webui\extensions-builtin\Lora\lora.py", line 214, in load_loras lora = load_lora(name, lora_on_disk.filename) File "C:\Users\xcatp\stable-diffusion-webui\extensions-builtin\Lora\lora.py", line 176, in load_lora module.weight.copy_(weight) RuntimeError: output with shape [1, 320, 1, 1] doesn't match the broadcast shape [1, 320, 3, 3]

    _Envy_
    Author
    Apr 22, 2023· 2 reactions

    It's a LoCon, which has more layers than a regular lora. You need to install the lycoris extension on automatic1111 and it will load just like a regular lora.

    catpawzApr 22, 2023

    @_Envy_  ah, thanks!

    MejiApr 22, 2023
    CivitAI

    Found that "LoRA + (beautiful hands, perfect hands, detailed fingernails:1.4)" worked really well in my case. Thanks! :)

    victorc25744Apr 22, 2023· 1 reaction
    CivitAI

    500 Mb. It's a large boi

    _Envy_
    Author
    Apr 22, 2023· 1 reaction

    Yeah, it's a chonker.

    I'll release a pruned one once I'm happy with it (or once it stops responding to training, whichever comes first).

    nwc734673793960Apr 22, 2023· 1 reaction
    CivitAI

    如果成功,这将是丰功伟业啊

    _Envy_
    Author
    Apr 22, 2023

    祝我好运

    deng474231Apr 22, 2023
    CivitAI

    男人的手可以跑吗

    _Envy_
    Author
    Apr 22, 2023

    Yes! :)

    deng474231Apr 23, 2023

    @_Envy_ 真好!非常感谢您!

    canyayanApr 23, 2023
    CivitAI

    Will it affect the original style of painting?

    _Envy_
    Author
    Apr 23, 2023· 2 reactions

    Depends on your network, if you're using other LoRAs, etc. I don't think it changes RevAnimated much, but ones that are less related will probably change more.

    At any rate, if this proves to be possible, I imagine people will train similar things for other networks, or just integrate the training directly into their models.

    138759Apr 23, 2023· 1 reaction
    CivitAI

    .5 GB
    ????

    _Envy_
    Author
    Apr 23, 2023

    I'm training it with a large number of dimensions because I assume that will help it have a better chance to actually learn. I'll prune it down when the training is done. But in the meantime, if people provide feedback, I want feedback for the model I'm actually training.

    LoCon
    SD 1.5

    Details

    Downloads
    1,429
    Platform
    CivitAI
    Platform Status
    Available
    Created
    4/22/2023
    Updated
    6/19/2026
    Deleted
    -

    Files

    GoodHands-alpha2.safetensors

    Mirrors

    HuggingFace (1 mirrors)
    CivitAI (1 mirrors)