V1 evaluation lora used to create a baseline.
Training settings were refined for the next versions;
V2 - ADAFACTOR, Rank 16, Alpha 1
V3 - Rank 32, Alpha 1
v3b - rank 32, alpha 8
v3c - rank 32, alpha 4
V4 - were all trained with ADAFACTOR using revised settings. Rank 64, Alpha 1
Round 2
V5 - Trained with ADAFACTOR with final settings, Rank 32, Alpha 1, reduced learning rate, LR 2e3
Switched to PRODIGY
V6-early = ADAFACTOR, Rank 32, Alpha 1
V6 = ADAFACTOR, Rank 32, Alpha 1
offset noise 0.06
V7-early = PRODIGY, Rank 64, Alpha 1
V7 = PRODIGY, Rank 64, Alpha 1
initialD 1e-06
V8-early = PRODIGY, Rank 64, Alpha 1
V8-mid = PRODIGY, Rank 64, Alpha 1
V8 = PRODIGY, Rank 64, Alpha 1
as shown in the video, early Epochs seem to perform better beyond txt2img.
Study presentation: https://www.figma.com/file/NM9dSIwcKoyZpOSYqi4pKs/OneTrainer-Stable-Cascade-(LR-adjustment)
Models: https://civarchive.com/models/320332 Dataset: https://github.com/MushroomFleet/assassinKahb-1024
Article: Training Stable Cascade with OneTrainer
OneTrainer: https://github.com/Nerogar/OneTrainer
my preset for OneTrainer: https://pastebin.com/tLri1HdU
.json file, place inside OneTrainer\training_presets
which are trained to compare the Rank setting.


test prompt:
AssassinKahb style a demonic looking skeleton holding a sword with red hair



At the time of posting the Lora implementation is incomplete in most webUI's You will be able to use this if you have updated your ComfyUI to the latest version.
Description
PRODIGY-64-1
raised initial D to 1e06
FAQ
Comments (5)
would you mind showing your lora-training .yaml file
in the video (linked from the article) includes a pastebin link. That is the .JSON preset file. just save that into the /presets/ folder in OneTrainer, or read the values there.
Thank you !
What do you mean by early Epochs? Like doing 1o instead of 30?
in the Study link, i show outputs for every epoch with same prompt/seed. There were early epoch's that converged well, so i named those "early" and kept them too. More info in the video explainer ;)
Details
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.



