Q21 Version
Nothing has changed dramatically from the FK9 version to the Qwen 2.1 version. I've simplified the image inputs and the actual sampling subgraph since the Q21 encode node just works really well (not latent reference nodes which makes me happy). I've only tested it with character sheets and with a relatively simple character, but you can scale it up as much as you want. I do only one input because Q21 seems sensitive to the amount of inputs you give it. I've built a Character Sheet which you can use with this work flow to build out fairly robust datasets for lora training.
Q21 works WAY better than FK9 with regards to this. I've added in the ability to use a turbo lora but you really don't need to. 1mp 30 image datasets take about 8 minutes to make. There are ghosting issues which I don't know how to fix that other than to just weed them out after the fact.
Update:
I've replaced the version I uploaded this morning with a version that has prompts better optimized for Q21, along with settings that I've found that work well. Below is the prompt list:
Full-body shot of one person, entire figure visible from head to shoes, standing upright with arms relaxed at the sides, facing directly toward the camera.
Full-body shot of one person, entire figure visible from head to shoes, standing upright with arms relaxed at the sides, body rotated 45 degrees toward the left side of the frame, three-quarter view.
Full-body shot of one person, entire figure visible from head to shoes, standing upright with arms relaxed at the sides, body rotated 45 degrees toward the right side of the frame, three-quarter view.
Full-body shot of one person, entire figure visible from head to shoes, standing upright with arms relaxed at the sides, body rotated 90 degrees to face the left side of the frame, full side profile view.
Full-body shot of one person, entire figure visible from head to shoes, standing upright with arms relaxed at the sides, body rotated 90 degrees to face the right side of the frame, full side profile view.
Full-body shot of one person, entire figure visible from head to shoes, standing upright with arms relaxed at the sides, body rotated 135 degrees away from the camera toward the left side of the frame, three-quarter rear view, face only partly visible.
Full-body shot of one person, entire figure visible from head to shoes, standing upright with arms relaxed at the sides, body rotated 135 degrees away from the camera toward the right side of the frame, three-quarter rear view, face only partly visible.
Full-body shot of one person, entire figure visible from head to shoes, standing upright with arms relaxed at the sides, seen directly from behind, back fully toward the camera, face not visible.
Chest-up portrait of one person, framed from the mid-chest to just above the head, facing directly toward the camera.
Chest-up portrait of one person, framed from the mid-chest to just above the head, body rotated 45 degrees toward the left side of the frame, three-quarter view.
Chest-up portrait of one person, framed from the mid-chest to just above the head, body rotated 45 degrees toward the right side of the frame, three-quarter view.
Chest-up portrait of one person, framed from the mid-chest to just above the head, body rotated 90 degrees to face the left side of the frame, full side profile view.
Chest-up portrait of one person, framed from the mid-chest to just above the head, body rotated 90 degrees to face the right side of the frame, full side profile view.
Chest-up portrait of one person, framed from the mid-chest to just above the head, body rotated 135 degrees away from the camera toward the left side of the frame, three-quarter rear view, face only partly visible.
Chest-up portrait of one person, framed from the mid-chest to just above the head, body rotated 135 degrees away from the camera toward the right side of the frame, three-quarter rear view, face only partly visible.
Chest-up portrait of one person, framed from the mid-chest to just above the head, seen directly from behind, back fully toward the camera, face not visible.
Close-up headshot of one person, framed tightly on the head and shoulders, facing directly toward the camera, smooth, even skin texture.
Close-up headshot of one person, framed tightly on the head and shoulders, body rotated 45 degrees toward the left side of the frame, three-quarter view, smooth, even skin texture.
Close-up headshot of one person, framed tightly on the head and shoulders, body rotated 45 degrees toward the right side of the frame, three-quarter view, smooth, even skin texture.
Close-up headshot of one person, framed tightly on the head and shoulders, body rotated 90 degrees to face the left side of the frame, full side profile view, smooth, even skin texture.
Close-up headshot of one person, framed tightly on the head and shoulders, body rotated 90 degrees to face the right side of the frame, full side profile view, smooth, even skin texture.
Close-up headshot of one person, framed tightly on the head and shoulders, body rotated 135 degrees away from the camera toward the left side of the frame, three-quarter rear view, face only partly visible.
Close-up headshot of one person, framed tightly on the head and shoulders, body rotated 135 degrees away from the camera toward the right side of the frame, three-quarter rear view, face only partly visible.
Close-up headshot of one person, framed tightly on the head and shoulders, seen directly from behind, showing the back of the head and hair, face not visible.
Close-up headshot of one person, framed tightly on the head and shoulders, facing directly toward the camera, calm, neutral expression, relaxed face, smooth, even skin texture.
Close-up headshot of one person, framed tightly on the head and shoulders, facing directly toward the camera, warm, genuine smile, happy expression, slight crinkle at the outer corners of the eyes only, otherwise smooth, even skin on the forehead and cheeks.
Close-up headshot of one person, framed tightly on the head and shoulders, facing directly toward the camera, sad expression, eyes looking downward, corners of the mouth turned down, smooth, even skin texture.
Close-up headshot of one person, framed tightly on the head and shoulders, facing directly toward the camera, cute pouty expression, lips pushed forward in a soft pout, smooth, even skin texture.
Close-up headshot of one person, framed tightly on the head and shoulders, facing directly toward the camera, cringing expression, teeth clenched in an awkward grimace, eyes slightly squinted, only light creasing around the eyes.
Close-up headshot of one person, framed tightly on the head and shoulders, facing directly toward the camera, silly, playful expression, tongue sticking out, eyes wide and bright, smooth, even skin texture.Fk9 Version
Fairly straight forward. You can use this workflow to automate dataset creation. Default is set to 30 images but you can of course customize to your needs. Here are the directions:
Version 2 Update: The version 2 work flow now includes a wildcard node that will randomly change the background and the lighting of the image. Can add more or take some away if you wish. You can run it multiple times for more variety. I'd recommend doing it for alternate outfits.
Directions
Step 1 - Load 1 to 3 reference images. Adjust reference images if desired.
Step 2 - Adjust the "Ref Image #" panel accordingly on the FK9 run subgraph. This is scalable so if you want more than 3 (don't know why you would) it is possible.
Step 3 - Input the master prompt. This will guide basic details like style and lighting as well as letting you fine tune certain elements.
Step 4 - Adjust angle prompts if desired. I have 30 in there now. Each line will function as its own run so if you add more or remove some adjust your batch number.
Step 5 - Set output folder
Step 6 - Hit run
Best practices:
If possible I like to make a character reference sheet of three to four views at 4 megapixels, then a close up headshot. Those two work well as references.
You can adjust outfits and accessories in the Master Prompt, but I think you're better off making a new reference sheet with those changes instead of hoping all 30 outputs are consistent. Obviously adding in a third reference image with that adjustment will help.
In theory you could add different backgrounds and settings in the Angle Prompt section. I chose a more neutral approach because that has tended to work best for me when training character loras.
Full-body shot, standing pose, arms relaxed at their sides, facing directly toward the camera.
Full-body shot, standing pose, arms relaxed at their sides, body turned 45 degrees to the left in a three-quarter front view.
Full-body shot, standing pose, arms relaxed at their sides, body turned 45 degrees to the right in a three-quarter front view.
Full-body shot, standing pose, arms relaxed at their sides, body turned 90 degrees to the left in full profile view.
Full-body shot, standing pose, arms relaxed at their sides, body turned 90 degrees to the right in full profile view.
Full-body shot, standing pose, arms relaxed at their sides, body turned 135 degrees to the left in a three-quarter back view.
Full-body shot, standing pose, arms relaxed at their sides, body turned 135 degrees to the right in a three-quarter back view.
Full-body shot, standing pose, arms relaxed at their sides, viewed directly from behind, back facing the camera.
Chest-up shot, framed from the chest up, facing directly toward the camera.
Chest-up shot, framed from the chest up, body turned 45 degrees to the left in a three-quarter front view.
Chest-up shot, framed from the chest up, body turned 45 degrees to the right in a three-quarter front view.
Chest-up shot, framed from the chest up, body turned 90 degrees to the left in full profile view.
Chest-up shot, framed from the chest up, body turned 90 degrees to the right in full profile view.
Chest-up shot, framed from the chest up, body turned 135 degrees to the left in a three-quarter back view.
Chest-up shot, framed from the chest up, body turned 135 degrees to the right in a three-quarter back view.
Chest-up shot, framed from the chest up, viewed directly from behind, back facing the camera.
Close-up headshot, framed tightly on the face and shoulders, facing directly toward the camera.
Close-up headshot, framed tightly on the face and shoulders, body turned 45 degrees to the left in a three-quarter front view.
Close-up headshot, framed tightly on the face and shoulders, body turned 45 degrees to the right in a three-quarter front view.
Close-up headshot, framed tightly on the face and shoulders, body turned 90 degrees to the left in full profile view.
Close-up headshot, framed tightly on the face and shoulders, body turned 90 degrees to the right in full profile view.
Close-up headshot, framed tightly on the face and shoulders, body turned 135 degrees to the left in a three-quarter back view.
Close-up headshot, framed tightly on the face and shoulders, body turned 135 degrees to the right in a three-quarter back view.
Close-up headshot, framed tightly on the face and shoulders, viewed directly from behind, back facing the camera.
Close-up headshot, framed tightly on the face and shoulders, facing directly toward the camera, calm, neutral facial expression.
Close-up headshot, framed tightly on the face and shoulders, facing directly toward the camera, warm, genuine smile, happy expression, eyes slightly crinkled.
Close-up headshot, framed tightly on the face and shoulders, facing directly toward the camera, sad expression, eyes downcast, corners of the mouth turned down.
Close-up headshot, framed tightly on the face and shoulders, facing directly toward the camera, angry expression, brows furrowed, intense glare.
Close-up headshot, framed tightly on the face and shoulders, facing directly toward the camera, disgusted expression, nose wrinkled, upper lip curled.
Close-up headshot, framed tightly on the face and shoulders, facing directly toward the camera, silly, playful expression, tongue out, exaggerated grin.
Description
An adaption of my FK9 version to work with Q21