LTX Example Workflow
https://paaster.io/698559390a7a8c3988ee9e91#1NG7332gvq5L4A9yTnKw4INMZ00tgOFaCAEFqU8d-as
WTF?!
Why not ;)
I'm back again with a new experimental escapade that doesn't seem to be done commonly on here: a custom CogVideo Wan Video LTX-2 LoRA!
Training (LTX-2)
This LoRA was trained on a dataset of 143 clips with hand-revised captions.
These clips came from 54 unique source videos:
Real Life (42 clips => 74 clips, ~50%) mainly amateur clips from Reddit/RedGifs/Pornhub, and a couple studio-shot videos
Anime (7 clips => 14 clips, ~ 10%) drawn/3d animated clips
Furry (5 clips => 45 clips, ~40%) 3d animations
Around 80% of these clips had their own audio.
Trained for 4,000 steps (4.5 hours on a runpod H200 SXM) using the official training script: https://github.com/Lightricks/LTX-2/blob/main/packages/ltx-trainer/docs/quick-start.md
Rank 32
Training (Wan2.1 I2V [OLD])
This LoRA was trained with around 110 or so clips of up to 11s, some of real life amateur/porn videos, some of animations
990 steps (90 epochs)
Trained on 1 x A100 SXM4 using https://github.com/tdrussell/diffusion-pipe
Training (CogVideo [OLD])
This LoRA was trained with 19 videos of solo male masturbation, mainly amateur vids.
4,000 steps
Trained using H100 for around 18 hours or so, using https://github.com/a-r-r-o-w/cogvideox-factory
Description
One of the first Wan2.1 I2V 14B LoRAs in existence!
FAQ
Comments (5)
I just tried this lora, and it gives numerous errors saying the lora key isn't loaded.
Hi OP! Not sure if you have any fix for this but when I use this Lora with 2d images, it makes the characters talk a lot. An example is this https://civitai.com/images/71688819
Any recommendations?
Hey :)
Uhhh, I think it was just the training data to be honest. It was mostly IRL vids with fewer 2d animations since the IRL was way easier to source. I think most animated clips I included featured the characters talking, so that would make sense.
I'm planning on making another Wan LoRA somewhat related to this, but as for quick fixes, I'm not really sure -- maybe you could try to use OpenPose to control the facial movements?
But yeah, the 2d part of the dataset was pretty limited.
Any chance of a wan 2.2 i2v/t2v version of this? or release of the training data so we can retrain on the latest version?
Another W for MEN
Details
Files
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.

