This is an experimental alternate distillation LoRA based on JoyEcho DMD for LTX 2.3.
Tested settings:
Strength
0.4-1.0Works with:
1st passand2nd passand3rd pass8-12steps
Limited testing was done. Good luck! โ๏ธ
The Goal:
This LoRA recreates the distilled JoyEcho LTX 2.3 model changes on top of the original LTX 2.3 Dev checkpoint, so it keeps JoyEchoโs enhanced distilled behavior.
All standard model routes are included. Unlike an I2V CondSafe LoRA, nothing is intentionally removed.
V2
I raised the overall rank and did a selective SVD to get more quality.
Sound and artifacts are noticeable better on this one, from my testing.
The final audio-output route is blended: 20% of the JoyEcho change and 80% of the official LTX distilled LoRA change.
The LoRA is compressed dynamically to a maximum rank of 86 per layer while targeting 99% retained weight energy. And target 160 rank for Audio.
V1
The final audio-output route is blended: 25% of the JoyEcho change and 75% of the official LTX distilled LoRA change. This keeps the better distilled audio behavior from the official r384 while reducing the overly loud sound produced by the full JoyEcho output route.
The LoRA is compressed dynamically to a maximum rank of 72 per layer while targeting 96% retained weight energy. This makes it substantially smaller and more practical than a full checkpoint delta, while preserving the most important learned changes.
Description
V1
DMD x LTX blend
audio-output route is blended: 25% of the JoyEcho and 75% of the official LTX
FAQ
Comments (17)
Ohhhhh.... but we would have to use this with v3 because v4 has the distiller embedded, right?
Yes, it is for non-distilled checkpoints. Not limited to mine.
Not needed for "DragonLeap" v4
Thanks I was just wondering that
Tenstrip has something similar, A r256 reshaped model, but his is like +-4GB, what's the difference here/optimizations done to make it this small
@ThirenG187ย described right on the front page
Thanks for more LTX resources!
Hi, thanks for the great work!
I've been experimenting with a 12-sigma schedule (1.0, 0.99375, 0.9875, 0.98125, 0.9700, 0.9250, 0.8300, 0.7000, 0.5500, 0.4000, 0.2500, 0.1250, 0.0) and wanted to share some feedback.
When using just the DMD LoRA, the overall visual quality is fantastic, but I sometimes get blurred motion or deformed fingers.
On the other hand, when I use a standard Distill LoRA (specifically ltx-2.3-22b-distilled-lora-dynamic_fro09_avg_rank_105_bf16), the base quality is just okayish, but the motion handling is significantly better.
To get the best of both worlds, I tried combining them: your DMD LoRA at 0.4 strength + the Distill LoRA at 0.4 strength. This actually gave me the absolute best results regarding both quality and motion! However, I do occasionally get small square/grid artifacts in the background.
Do you think it would be possible to train or merge a LoRA that combines the methods and strengths of both approaches?
Besides that, really amazing job on this!
I just use linear_quadratic nothing special.
My workflow uses multi pass stages (1st 8 steps, 2nd 4steps, 3rd 2steps) atm.
@Darksidewalkerย What's the benefit of using three stages instead of one? Thanks
@suekapoย More quality.
@Darksidewalkerย You use linear_quadratic on all passes? Or only 1st pass
@ThirenG187ย all
I tried 0.4/0.4 and it works really well. Unexpectedly. Thanks.
is this the same as the one from the eros guy (tenstrip) extracted DMD?
No it's not the same, it's another approach
@Darksidewalkerย what is its purpose?
@loneillustratorย Low step distillation with improved quality and sound