Stop! These are LoRA specifically for use with AnimateDiff - they will not work for standard txt2img prompting!
These are Motion LoRA for the AnimateDiff extension, enabling camera motion controls! They were released by Guoyww, one of the AnimateDiff team.
Download them to the normal LoRA directory and call them in the prompt exactly as you would any other LoRA, while AnimateDiff is enabled. Note that they will only work with the v2 Motion Modules.
See https://education.civitai.com/beginners-guide-to-animatediff for further information!
Description
FAQ
Comments (25)
Honest question, what's the difference between yours and this one: https://civitai.com/models/151566/animatediff-motion-loras-zoom-pan-roll-tilt-bundle ?
Hey, good question - absolutely no difference, but these are linked on https://education.civitai.com, so for consistency I'd rather not link to a model upload we don't control. Just in case the uploader removes them in future, etc.
this show samples, the other does not
This is amazing
They are not working...:(
I've got them working. What's the issue? How are you using them?
if that helps, I was using Ciara's animatediff finetuned model and that didn't seem to work. Switching to an 1.4 or 1.5 model fixed it
@rihivo5563 Ah, that's in the description - they only work with the official v2 motion modules.
Shutterstock's lawyers would like a word
I'm new to this. Can someone confirm for me that without webui you can't animate your generations? Thanks I'm advance. 🙃
I don't know, I've only been doing it through the webui, need animateDiff + a motion module
You can animate your generations with Auto1111's WebUI, or with ComfyUI, and there are a few other options - https://education.civitai.com/beginners-guide-to-animatediff/
great project but needs to be retrained without the shutterstock watermarks. try sourcing clips from Pexels or just shoot clips on a phone
Amazing!
Can I use this LoRA to make the subject move towards the camera instead of the camera zooming into the subject? I would like to have the subject move closer to the camera at frame 30 and even closer at frame 60.
So I plug in the AnimateDiff LoRA Loader node to the motion_lora input of AnimateDiff Loader and use v2_Lora_PanLeft.ckpt + animatediffMotion_v15V2.ckpt and I don't see any difference.
Never played with motion lora, so my first attempt was to actually plug a Lora chaining the Checkpoint lol.
Also, do you know if there are any Motion Lora that works with AnimateDiff V3 now?
Hola! I love this... but it doesn't make any zoom after adding it to my propmt, I am using AnimateDiff and motion modul v1.5 v2
I added the word ZOOM IN
I want to make a very exagerated zoom
Any other adjustments I should do other than setting the number more than 0? Thanks!
Hi!
I'm getting errors no matter what I try! I saw one YouTube tutorial using them, followed the instructions and no....
Was trying to find the answer for the last 2 days but no luck.
So I try here, hopefully someone can help!
So this is the error message I'm getting:
...
loading network C:\Users\XY\stable-diffusion-webui\models\Lora\v2_lora_ZoomIn.ckpt: AssertionError
Traceback (most recent call last):
File "C:\Users\XY\stable-diffusion-webui\extensions-builtin\Lora\networks.py", line 321, in load_networks
net = load_network(name, network_on_disk)
File "C:\Users\XY\stable-diffusion-webui\extensions-builtin\Lora\networks.py", line 254, in load_network
raise AssertionError(f"Could not find a module type (out of {', '.join([x.class.name for x in module_types])}) that would accept those keys: {', '.join(weights.w)}")
AssertionError: Could not find a module type (out of ModuleTypeLora, ModuleTypeHada, ModuleTypeIa3, ModuleTypeLokr, ModuleTypeFull, ModuleTypeNorm, ModuleTypeGLora, ModuleTypeOFT) that would accept those keys: 0.motion_modules.0.temporal_transformer.transformer_blocks.0.attention_blocks.0.processor.to_q_lora.down.weight, 0.motion_modules.0.temporal_transformer.transformer_blocks.0.attention_blocks.0.processor.to_q_lora.up.weight, 0.motion_modules.0.temporal_transformer.transformer_blocks.0.attention_blocks.0.processor.to_k_lora.down.weight,
...
Thank you!!
Do you have any way of showing me the workflow that is giving you this error? Because just a shot in the dark it sounds like the LoRa is conflicting with the motion model, or that there is a number setting that is causing it to error coming from one of the motion settings blocks. Just shot in the dark though until I would see it.
I add loras and it does nothing, seems the download file is corrupted or absolutely nothing since there about 73mb each, would love to hear a response or a solution.
Adding this to the prompt does absolutely nothing? Even adding the trigger word the video is not affected in any way.
These are over a year old, I've no idea if they still work with current AnimateDiff tooling to be honest!
@theally Dont seem to , although I did manage to get one sort of working. Rest of the vids I tried, nothing :( ofc I could also be doing something horrendously wrong - which is equally likely.
@EZorg They do only work with the v2 Motion Modules, according to my notes which I don't even remember writing! They did work once upon a time - they're official models from the AnimateDiff team, after all.
@theally Yeah, using the V2 models. Oh well. I'll keep trying
Do i add these to my regular loras folder or the inside custom nodes - animate diff - motion loras folder?
Details
Files
v2_lora_PanRight.ckpt
Mirrors
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.1.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
v2_lora_PanRight.ckpt
Available On (1 platform)
Same model published on other platforms. May have additional downloads or version variants.