As request by people on my extreme handheld, here go.
prompt example: the viewer runs trought the battlefield filled with war and explosions, the hand shows throught camera
Description
FAQ
Comments (16)
Damn, just saw someone asking for it yesterday. When did you prepare the dataset and train the lora already
training on nvidia b200, on runpod, yeah that wild
@luisa_pinguin Nice! Did you receive my PM? Any plans to train the dataset I sent you or should I look into it myself if you have other plans?
Thanks so much! this is EXACTLY what we need for our current project.
Can we also have a T2V version?👍🏻
You did it! Wonderful!
"Hardcore Henry" style! thanks!
Awesome
Okay, I'm finding that this is starting to teach Wan an important concept. I haven't done enough tests to figure out how to fill out its knowledge, but it's already many better than without the lora. I didn't use your trigger. Instead, I use this as an overall POV tool. It understands what I mean when I use these phrases:
"The viewer moves toward ________"
"The viewer's hands grab ________"
"The viewer is [doing something]"
So this lora finally gives Wan an understanding of what "the viewer" is, and what "the viewer's hands" are. I'm loving working with this so far, but it's not at all consistent. Still, even that lack of consistency is worlds better than before, when Wan 2.2 NEVER understood what I was asking for.
Thank you so much for making this. I'm having a lot of fun, and this was so very needed.
One thing that might help v2:
Your trained trigger phrase is this:
"the viewer runs trought , the hand shows throught camera"
trought and throught are not valid words, so when training them, the model has to learn what they are from scratch. I'm not even sure what they are supposed to mean in this context. This is my guess:
"the viewer runs trought" is probably "The viewer runs through", meaning that the viewer is running through the scene. Maybe it's easier to say "the viewer is running"?
"the hand shows throught camera", this one is the most puzzling. The hand shows throughout the scene? The hand shows through the camera? Maybe it should be "the viewer's hand is in view."
To be clear, this comment isn't meant to criticize, but to help make v2 even better.
But yeah, that might help it connect the dots with the concept of the viewer and the viewer's hands.
I think this lora need a v2 amazing movement, worth to get a higher quality one IMO.
bodycam game was cool initially
I wonder what will happen if you mix it with the lore that follows the object, will there be a chase?
I didn't tested the particular lora you are mentioning but I used one where we also vaguely follow a person and yes it created a chase, very easy, so i guess it will do this as well
So, just to be clear... the trigger word is "trought"?
Or would it work with the normal variant...?
Yes, apparently it's required, I tried generating with "through" and it just had a person run through my scene or nothing at all, then I generated again and all i changed was "through" to "trought" and it appeared to trigger it properly, though there was no hand visible so I presume that has to be there on i2v or so
Details
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.