PONY CLIP 100k Finetune
JoyCLIP is a further advancement of this CLIP
Note this is still a great base to start a finetune of PONY CLIP as the gradient was 50 out. Starting with this model you will be in the 4-8 range.
100k is a full finetune of base pony CLIP-L and CLIP-G
100k can be used in any model base V6, Autism, Anime or Realistic (Even non-pony SDXL Models)
CLIP-G took 68GB and 30 hours to train.
Forge users, you will need to download Comfy UI as CLIP replacement is only supported for FLUX, this may apply to Auto 1111 also. Once a model is saved with replaced clip it can be used in Forge or Auto
Can be run in any UI (Forge, Auto1111, Comfy UI) the model will be downcast by default. These settings improve complexity but are not required. (Full FP32 is not recommended but FP32 CLIP is)
Comfy UI --fp32-text-enc OR --force-fp32
Forge/Auto1111 --clip-in-fp32 OR --all-in-fp32
Description
FAQ
Comments (13)
I see the checkpoint has vae and clip embedded. So I have to ask - Are they the FP32? How do you use the CLIPL and CLIPG if not? I've been fiddling and not seemed to get it to work.
And can these CLIPL/G's be used in say SD3.5? Or is it just Pony?
Everything in the checkpoint is FP32, the PONY CLIP's can be used with any PONY model, they would likely cause issue with SD3.5 but you could try them, Regular SDXL CLIP-G and CLIP-L work in SD 3.5 or the zero0int
Where I can move the clip files? I use comfyui
@megachina31687 If you're using this model you don't need to load the clip files, they are built into the model. You use a different checkpoint loader, that one has a Clip and VAE attachment.
Search for "Load Check point" and it's a comfy-core node.
If you're using a different Pony model, then you can use the CLIPs in those models. In fact you can technically load it with any Pony model even those with CLIP and VAE built in.
Everybody download at least the clips, it worth it.
You should make a comparison, not just one pic.
Thanx man.
This checkpoint i used to test the CLIP models has been bricked for me for a long while, I still get some bricks, but the results speak for themselves.
@PulenKompot I have talked to about this particular issue but if this gets integrated with their models I forsee a lot of issues getting fixed.
@Felldude Talking about this clip set being broken with forge update when I use it with other checkpoints or older ones when it worked wonderfully before.
@A_Friendly_Spider I still think the GPU slider code is causing the issue as the CLIP and VAE are loaded into VRAM ignoring all CPU commands
hard to get good images but
high CFG ~6 and 60steps it shows a bit
Pardon my ignorance, but for auto1111 where do the clip files go? Thank you for your contribution!
You don't need the separate files unless your loading a different PONY model, in which case they would be in the CLIP/VAE
@Felldude I thought Pony_100k_CLIP-G is the model, isn't it? And how can you use another model, when you select it as a model... Or is Pony_100k_CLIP-G a VAE?
@wd40th A checkpoint in SDXL case is SDXL UNET, two clip models, CLIP-G, and CLIP-L and a VAE
Details
Files
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.