Comfy Workflow to Generate Videos super quick and reliable using the new Pyramid Flow, now with Miniflux!
Automatic Outpainting
Vertical/Orizontal switch
For 10-second video generation, we recommend using a guidance scale of 7 and a video guidance scale of 5.
Description
Added input image switch, to switch from orizontal to vertical images
workflow refinements
FAQ
Comments (12)
Hi! I am attempting to make a video from an image, and it seems to work great for the first second or so, then all of a sudden it collapses into a strange mess. For example, in a landscape scene it begins moving erratically and blending into each other, and with people their faces sort of melt away and it all gets meshed together. I've tried messing with so many of the settings to no avail. I'm wondering you have any insight as to why this may happen. Thank you!
is all about steps and cfg and luck.
more video steps equal more details, wich dont necessary means better results.
i suggest you to experiment a lot with short lenght videos so use few frames and change video steps to understand how it works
I am using pyramid flow installed via pinokio. I am getting better results than HaiperAI on my $1k laptop with a nVidia 4060. Maybe give the pinokio one a go. it worked right off the bat, only one setting and prompts for img2vid. Only horizontal, but i put vertical images on the horizontal neutral colored background and works great.
The 768 version of the miniflux model is out. Compared to the old version, it looks really good.
yeah it is! very different results but i guess depends on what you are looking for. for simple movements the smaller is good enough
@LatentDream I was impressed with what it can do well and at higher resolutions. For example 1024x1024. I liked the result very much.
Please, any tutorial for using this workflow?
Just load the image in the yellow square, load the models, write a prompt and it should work. There is nothing special there, only for the model 768 it is necessary to set the resolution not less than 768 by 768, otherwise the output will be garbage from artifacts. On a normal model you don't need to change the resolution settings, the best option is set there. Double-check the models, maybe you have loaded something wrong. Drag and drop the original workflow downloaded here, download the exact same models as they are set there, re-select them, and that's it.
This error "!!! Exception during processing !!! range() arg 3 must not be zero" in PyramidFlow VAE Decode
@midiaplaay https://github.com/kijai/ComfyUI-PyramidFlowWrapper/issues/46 Try to recreate the VAE node by right-clicking, at the bottom of the menu there will be an item (fix node recreate). Use Google, there's a lot there already.
@superuser111 thanks for help man. actually i was playing with thte 768 model yesterday, i must say that sometimes gives really different results and you are right, it require higher resolutions to work. but i'm ok with the smaller one cause is faster too 😛
@superuser111 I did! Thanks.