Key details:
Lora strength: 0.8
Keywords: act1vate, King_Bloogenflarp_III
This is the third experiment for an automatic character lora workflow. The idea is to:
Have an ai write an empty character sheet with details about age, appearance, and a full backstory.
Have the ai fill out that template with a simple prompt of "fill out the sheet for King Bloogenflarp the third a gelatinous king of an alien world"
Generate an image using that character sheet as a prompt (I tried again using just one as this reduces waiting time during the processing of the script.)
Used that image with kling image to video. (Will be changing this step back to using my ltx looped workflow in the future, as its easier to automate in a python script using comfyui's api feature and is free.)
split the video in to frames grabbing and saving every 2nd frame from the video.
Changed the background with inpainting to see if I could get away with using one video but inpainting different backgrounds.
trained a flux lora off of the images. (I think I am overtraining and can probably get away with using a lower epoch for these in the future.)
Comments:
I tried again with a single video but this time using different backgrounds inpainted on to the split frames. I'm not happy with the result and am just going back to 4 images to videos and splitting for every 5th frame. I now plan to try automating this process if I can get the settings consistent, so will be using only locally run methods from this point on. This will make it easier to code and use local and free api calls with ollama, comfyui and fluxgym. I just need to get the settings correct before trying that.
The end goal is to try get it to a point where I can have a python script open and close the programmes as and when they are needed, save workflows and default training settings in the project folder to be sent via api calls and have a single ui with a character creation screen with a character sheet and display window that guides you through the steps of creating a character lora with this method.
If anyone reading this wishes to take this idea and run with it, please do and please link me what you achieve as I'm sure people with more skill than me can pull this off with much better results :D.
Character sheet used for this lora:
Full Name: King Bloogenflarp III
Nicknames / Aliases: The Gelatinous Majesty, The Ooze Lord, The Wobbling Sovereign
Physical Attributes
Age: Indeterminate, but has ruled for over 300 years
Gender: Ambiguous, referred to as "he" for simplicity
Height: 6 feet (varies depending on mood and hydration levels)
Weight / Build: Amorphous, shifting between a blob-like form and a vaguely humanoid shape
Skin Tone: Translucent green with shimmering gold specks
Eye Color & Shape: Three floating orbs that shift between deep purple and glowing yellow; shape varies (sometimes round, sometimes elongated)
Hair Color & Style: No hair, but his gelatinous form sometimes extends into tendrils that mimic elaborate hairstyles
Facial Features: No traditional facial structure—his face forms and reforms as needed, sometimes with a wide, expressive mouth and other times with no mouth at all
Distinguishing Marks: Occasionally glows in dim light; has ancient royal sigils embedded within his gelatinous mass that pulse when he speaks
Expression / Default Look: A regal, calm demeanor, but his facial features subtly shift and ripple to reflect emotion
Clothing & Style
Typical Outfit: A flowing, semi-transparent robe infused with cosmic energy, which drapes over his shifting form without actually touching him
Preferred Colors & Fabrics: Deep blues, purples, and golds, with shimmering, otherworldly silks that appear to move like liquid stardust
Accessories: A grand golden crown that seems to hover just above his head; an ornate scepter containing a swirling galaxy encased in crystal
Footwear: None—he glides rather than walks, leaving a faint, glowing trail
Body Language & Movement
Posture: Floating upright, with a regal and composed presence
Mannerisms / Gestures: Occasionally vibrates when excited, stretches an appendage dramatically when making a point, and absorbs small objects into his body when absentmindedly fidgeting
Walking Style: Does not walk—he levitates smoothly, with slow, deliberate movements unless agitated, in which case he ripples and bounces slightly