ProtoGen_X5.8 - Rebuilt - How to Build Protogen
By Downloading you agree to the following licenses
CreativeML Open RAIL-M
Dreamlike License
Seek Art Mega License
Model Weights thanks to reddit user u/jonesaid
Live Demo at Available on Hugging Face
Comprehensive guide to camera control
Dreamlike-PhotoReal V.2 is the core model, this cocktail version adds
5% modelshoot-1.0
20% roboDiffusion_v1
20% MoistMix
20% HASDX
Please click the link below to read the license before downloading, thank you!
This model is licensed under a modified CreativeML OpenRAIL-M license.
Description
FAQ
Comments (70)
Could you make the .ckpt version available?
If you have the AUTOMATIC1111 version you can use this version, idk about other types of stable diffusion
Then for the config file just copy your one from the base version and rename it
Uploading a .ckpt also
Thank you!
can you provide huggingface or google drive link also because it easy to load in colab
Use:
!wget https://civitai.com/api/download/models/<modelVersionId> --content-disposition
Thanks already done this works
The author of this model has shared on Huggingface as well: https://huggingface.co/darkstorm2150 Linking to Huggingface inside Colab would ensure a faster download
you can try https://huggingface.co/spaces/umair007/all_in_one_converter_modified this space made by me using aria2c and gives great speed boost
What's different about this from 5.3?
This one has a different core file, the 5.3 used F222's and hassanBlendAllVersion, this one uses DreamLike-PhotoReal V.2
Could you please add a pruned version for the GPU handicapped plebeians?
I have a 8GB GPU, your running lower than this ?
I can run this in my 4GB GPU
I don't know if there's any reason, but I was having the same issue with the .safetensors file. Downloading the .ckpt file seems to work fine for me now. (I have 8GB)
I have a 6gb GPU (3060 laptop) with xformers and medvram enabled, but try to reach resolution and details as high as possible (txtoimg, imgtoimg, outpainting etc...) before final upsizing
Apparently it assumed all dwarves are male with thick beards:
(Masterpiece) (Hasselblad photography) (full length portrait) of a (female dwarf:1.5) dressed in oiled leather armor
Still gave me male dwarves
its missing RPGv1, I am waiting on the RPGv3 to be released today
Also I release Protogen Dragon, which is made for pure DnD stuff
Female dwarves also have beards man. ;p
You could try dwarf with normal weight, and female with more weight, e.g.:
(Masterpiece) (Hasselblad photography) (full length portrait) of a (female:1.5) dwarf dressed in oiled leather armor
why is this model >7gb in size?
I am not sure, it runs on a 8gb gpu that I have currently..
It isn't pruned
RPG v3 just went live. Is it going to be in the next version of Protogen? It looks like a huge step up.
Its in testing as we speak, looks good from my end, just a few more prompts to make sure anything from x5.8 is still there
It would be extremely interesting to know how to install it. I don't understand it very well
Get AUTOMATIC 1111 stable diffusion, download this model, place in stable diffusion models folder, then start :)
Hi!, i tried to load this model in fast Dreamboth, but throw Conversion Error.
Anyone knows because that happen?
Do you know why when I try to merge this model as base model, it makes my image looks more crispy and I'm getting worse eyes?
Love Protogen but this one I'm not sure what's wrong with it.
Merging is a difficult process, if you have this as a base, make sure you use only 5% (its m 0.05) of a merge, anything higher and the model takes a hit in quality
Thank you for your response, I got some idea just from that.
In my personal opinion, the model may not have a clear understanding of the concept of "beauty", so I often need to use more related keywords to constrain it and make it generate more "beautiful" images. Using a suitable Hypernetwork also helps improve the results.
Can someone pl help in loading this on the FastBen Colab document? Getting a constant error.
Thank you for the help & this mindblowing model.
Try loading the fp16 model at hugging face, its more optimized
https://huggingface.co/darkstorm2150/Protogen_v5.8_Official_Release/tree/main
Thank you, infortunately it says Wrong link, check that the link is valid
to both the ckpt and safetensor
darkstorm2150/Protogen_x5.8_Official_Release . that worked
Cant load the model. A1111 simply stops. Other models load just fine. Any ideas?
nice model but please try to cut the seek and dreamlike portions out in the future. Thsoe licenses are ass. Who wants needless restrictions and bullshit involved
Please do not create models from models with restrictive licenses! Those restrictions are a virus that infects everything downstream. Say NO to Dreamlike.
If you can, please add real pruned models. "Pruning" does not mean to downgrade it to fp16. Only to remove the training dictionary from it. I had to use the Stable Diffusion Toolkit to get a real pruned version of this. Thank you for considering!
this is a great guide, thank you!
I get an error when I try to prune the file using the toolbox because the ckpt is missing the state_dict key:
Stable Diffusion ToolboxV1\scripts\prune_ckpt.py", line 47, in prune_it
sd = nsd['state_dict'].copy()
KeyError: 'state_dict'
How did you manage to prune this using the toolkit?
@techniker I didn't use this toolkit, I used a more simple commandline one
@darkstorm2150 we are currently debugging an issue with your pruned models over at nod-ai/SHARK as they cannot be converted to diffusers using the Huggingface toolset. Would you mind sharing your approach? There is an open issue for that if you don't want to post here: https://github.com/nod-ai/SHARK/issues/892
@techniker I think @robot1me was right, I might have been not able to prune it properly to begin with, just convert it to fp16 only, I used this github software
https://github.com/lopho/stable-diffusion-prune
I like this model but man it has a huge bias towards generating women. Even with ((((male)))) in the prompt and female, woman, girl, etc. in the negative prompt it will still draw women more times than not.
Experimenting more with it, it appears to be tied to the "modelshoot style" tag. If you start your prompt with that you are almost guaranteed to get a female character, even if you have specified a male one. If you place the tag further inwards in your prompt, it seems to greatly attenuate that unfortunate effect and it mostly renders as expected.
Hello, someone has a clue why I'm not taking the same images as shown, even using the exact same parameters? I tried with both ProtogenX58RebuiltScifi_10.ckpt or ProtogenX58RebuiltScifi_10.safetensor. There are another file to copy or configuration to do ? (I'm using WebUI from Automatic111 in windows 10). Thanks
I'm having the same issue. I thought it was just me because I'm using something other than Automatic1111. I'll enter the same exact prompt and settings and seeds and don't get what everyone else is getting.
@roxhoff --xformers was used, not sure if this will be the cause of it, also its different for different pc's
Detected: Trojan: Win32/Sirefef!cfg
Almost All that I downloaded
Use an offline version like “invoke Ai.” Or in a Virtual machine
Misunderstanding or not I am going on what I have seen.
from windows Defender after scan
Detected: Trojan: Win32/Sirefef!cfg
Status: Remove failed
This treat or app might not be completely remediated.
Date: 2023/01/21 12:38
Details: This program is dangerous executes commands from an attacker. “Severe”
@Pergetoryofdream use the safetensor version, the ckpt are there for anyone needed them, also the website marked it as safe. so its a false positive. (if it was really harmful the entire community would have flag it down days ago)
Windows Defender also slows down PCs worldwide, while people often claim "third party antivirus is snake oil". While in reality, performance is literally one selling point due to Windows Defender being so bad at it. You can be sure it's a false positive. Even when in doubt, on Windows you can use Sandboxie. No need for VMs.
Plus as Darkstorm said, safetensors is available too. It's preferable just for the lower RAM usage on loading.
safetensors / also virustotal.com for a second perspective
I tested your model with some anime embeddings, and sadly they mostly generate photo stuff on this model. Do you plan to make a model that is more cartoony/anime focused? (For example UnstableInkDream 5 gave me really great results with anime embeddings)
I'm thinking of adding the japanese anime dataset from hugging face in the near future, though at the moment im currently busy with protogen, adding quality of life stuff..and such
Can you give me a hint? I don't fully understand if the "Protogen x5.8" model is related to the "Protogen x5.3"? Is Protogen x5.8 a more complete version of "Protogen x5.3"? Or are they different models that are not related to each other?
each one has its own unique personalities, here is a weight card to tell you what is in what..
https://preview.redd.it/et9c6e3bsoda1.jpeg?width=1076&format=pjpg&auto=webp&v=enabled&s=aa2049832da52e4e650e847e023147629e7faf40
@darkstorm2150 Can use this model to train?
@zerocool22 yes! :)
@darkstorm2150 thanks for the chart, its still to technical 4 me... hehehe I didnt get it, but thanks
So far, this is the best model, I made insane stuff with it. I hope the dear author keeps making better ones always. prompting is not easy but when you make a good one you will have cool stuff, it even works with my face-embedded model and I am thrilled with the things I created
Is this the model with hash 13a6777c or was that an older version?
Just downloaded the model, though I can't get it to work. When I try to generate, I just get the error message - Could not load the stable-diffusion model! Reason: 'encoder.conv_in.weight'. I have no idea what this means or how to fix it, so any help would be appreciated.
Details
Files
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.