Discover the future of photo animation with mry workflow for ComfyUI!
This workflow is designed to radically transform the way you animate photos. By integrating AnimateDiff and Ipadapter into Stable Diffusion v1.5 LCM, I have created a solution that allows you to animate any photo without the need to write a single prompt.
Key Features:
Seamless integration with Stable Diffusion v1.5 LCM for exceptional image quality.
HD1080p upscaling: Every animation benefits from HD resolution, ensuring your creations are not only captivating but also impeccably clear.
Simplified usage: Simply drop your photo into ComfyUI. No complex settings or prompt input required.
For the video of the QR code monster, you can use black and white transition videos like these :
Description
FAQ
Comments (24)
load video path doesn't load my mp4
you can replace the Load Video (Path) node with a Load Video (Upload) node.
@jameSonder thanks I tried , but then it gives an error on the connected Image Crop node (red circle width & height )
use→Load Video(Upload)
I don't know what video I need to upload
Index 0 is out of bounds for dimension 0 with size 0 File "F:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "F:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "F:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "F:\ComfyUI_windows_portable\ComfyUI\nodes.py", line 1404, in save_images full_output_folder, filename, counter, subfolder, filename_prefix = folder_paths.get_save_image_path(filename_prefix, self.output_dir, images[0].shape[1], images[0].shape[0]) ~~~~~~^^^
!!! Exception during processing!!! GetImageSize.get_size() got an unexpected keyword argument 'images'
Traceback (most recent call last):
File "F:\ComfyUI_windows_portable\ComfyUI\execution.py", line 151, in recursive_execute
output_data, output_ui = get_output_data(obj, input_data_all)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "F:\ComfyUI_windows_portable\ComfyUI\execution.py", line 81, in get_output_data
return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True)
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
File "F:\ComfyUI_windows_portable\ComfyUI\execution.py", line 74, in map_node_over_list
results.append(getattr(obj, func)(**slice_dict(input_data_all, i)))
^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
TypeError: GetImageSize.get_size() got an unexpected keyword argument 'images'
You need qrcode video, like this https://civitai.com/posts/2011230 . TypeError: GetImageSize.get_size() got an unexpected keyword argument 'images in GetImageSize me too.
Doesn't work Upscale with model
Error occurred when executing GetImageSize: GetImageSize.get_size() got an unexpected keyword argument 'images' File "D:\ComfyUI\ComfyUI\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\ComfyUI\ComfyUI\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ File "D:\ComfyUI\ComfyUI\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
it's in the node GateImageSize
got same error. setted image and video at same size. same error
Delete these nodes which calculate the ratio, and add a float node and set it to 1.75. and it will upscale to 1080x1920
thank for sharing :) wich sort of video should i use in the load video path? some sort of movement or something?
You need qrcode video, like this https://civitai.com/posts/2011230 or https://www.youtube.com/watch?v=iEifGtVECs8
I get this error:
Error occurred when executing KSampler: Given groups=1, weight of size [320, 5, 3, 3], expected input[16, 4, 64, 36] to have 5 channels, but got 4 channels instead
Error occurred when executing KSampler: index 6 is out of bounds for dimension 0 with size 1
how can I install the color-match? I have an error.
I went into my root folder of comfyui with the cmd, and I typed in: pip install color-matcher
but it didn't work.
Oh no, you shouldn't do it that way. The "Color Match" node depends on "KJNodes for ComfyUI" available at this address: https://github.com/kijai/ComfyUI-KJNodes. You just need to follow the instructions in the repository.
Another solution, which I strongly recommend, is to install the custom node "ComfyUI Manager." With it, you can directly install all the "custom nodes" from the ComfyUI interface. It even allows you to install the missing nodes in a workflow with the "install missing custom nodes" option.
@zohac Thanks! :)
Error occurred when executing KSampler: 'NoneType' object has no attribute 'shape' File "E:\Ai\pinokio\api\comfyui.git\app\execution.py", line 151, in recursive_execute output_data, output_ui = get_output_data(obj, input_data_all) File "E:\Ai\pinokio\api\comfyui.git\app\execution.py", line 81, in get_output_data return_values = map_node_over_list(obj, input_data_all, obj.FUNCTION, allow_interrupt=True) File "E:\Ai\pinokio\api\comfyui.git\app\execution.py", line 74, in map_node_over_list results.append(getattr(obj, func)(**slice_dict(input_data_all, i))) File "E:\Ai\pinokio\api\comfyui.git\app\nodes.py", line 1344, in sample return common_ksampler(model, seed, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, denoise=denoise) File "E:\Ai\pinokio\api\comfyui.git\app\nodes.py", line 1314, in common_ksampler samples = comfy.sample.sample(model, noise, steps, cfg, sampler_name, scheduler, positive, negative, latent_image, File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI-Impact-Pack\modules\impact\sample_error_enhancer.py", line 9, in informative_sample return original_sample(*args, **kwargs) # This code helps interpret error messages that occur within exceptions but does not have any impact on other operations. File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 419, in motion_sample latents = orig_comfy_sample(model, noise, args, *kwargs) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control_reference.py", line 47, in refcn_sample return orig_comfy_sample(model, args, *kwargs) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\utils.py", line 111, in uncond_multiplier_check_cn_sample return orig_comfy_sample(model, args, *kwargs) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\sample.py", line 37, in sample samples = sampler.sample(noise, positive, negative, cfg=cfg, latent_image=latent_image, start_step=start_step, last_step=last_step, force_full_denoise=force_full_denoise, denoise_mask=noise_mask, sigmas=sigmas, callback=callback, disable_pbar=disable_pbar, seed=seed) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI_smZNodes\smZNodes.py", line 1446, in KSampler_sample return KSamplersample(*args, **kwargs) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\samplers.py", line 761, in sample return sample(self.model, noise, positive, negative, cfg, self.device, sampler, sigmas, self.model_options, latent_image=latent_image, denoise_mask=denoise_mask, callback=callback, disable_pbar=disable_pbar, seed=seed) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI_smZNodes\smZNodes.py", line 1469, in sample return sample(*args, kwargs) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\samplers.py", line 663, in sample return cfgguider.sample(noise, latent_image, sampler, sigmas, denoise_mask, callback, disable_pbar, seed) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\samplers.py", line 650, in sample output = self.inner_sample(noise, latent_image, device, sampler, sigmas, denoise_mask, callback, disable_pbar, seed) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\samplers.py", line 629, in inner_sample samples = sampler.sample(self, sigmas, extra_args, callback, noise, latent_image, denoise_mask, disable_pbar) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\samplers.py", line 534, in sample samples = self.sampler_function(model_k, noise, sigmas, extra_args=extra_args, callback=k_callback, disable=disable_pbar, self.extra_options) File "E:\Ai\pinokio\api\comfyui.git\app\env\lib\site-packages\torch\utils\_contextlib.py", line 115, in decorate_context return func(*args, **kwargs) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\k_diffusion\sampling.py", line 762, in sample_lcm denoised = model(x, sigmas[i] s_in, *extra_args) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\samplers.py", line 272, in call out = self.inner_model(x, sigma, model_options=model_options, seed=seed) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI_smZNodes\smZNodes.py", line 992, in call return self.predict_noise(*args, **kwargs) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI_smZNodes\smZNodes.py", line 1042, in predict_noise out = super().predict_noise(*args, **kwargs) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\samplers.py", line 619, in predict_noise return sampling_function(self.inner_model, x, timestep, self.conds.get("negative", None), self.conds.get("positive", None), self.cfg, model_options=model_options, seed=seed) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 456, in evolved_sampling_function cond_pred, uncond_pred = sliding_calc_conds_batch(model, [cond, uncond_], x, timestep, model_options) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 593, in sliding_calc_conds_batch sub_conds_out = calc_cond_uncond_batch_wrapper(model, sub_conds, sub_x, sub_timestep, model_options) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI-AnimateDiff-Evolved\animatediff\sampling.py", line 653, in calc_cond_uncond_batch_wrapper return comfy.samplers.calc_cond_batch(model, conds, x_in, timestep, model_options) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\samplers.py", line 192, in calc_cond_batch c['control'] = control.get_control(input_x, timestep_, c, len(cond_or_uncond)) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\utils.py", line 706, in get_control_inject return self.get_control_advanced(x_noisy, t, cond, batched_number) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control.py", line 34, in get_control_advanced return self.sliding_get_control(x_noisy, t, cond, batched_number) File "E:\Ai\pinokio\api\comfyui.git\app\custom_nodes\ComfyUI-Advanced-ControlNet\adv_control\control.py", line 83, in sliding_get_control control = self.control_model(x=x_noisy.to(dtype), hint=self.cond_hint, timesteps=timestep.float(), context=context.to(dtype), y=y) File "E:\Ai\pinokio\api\comfyui.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1532, in wrappedcall_impl return self._call_impl(*args, **kwargs) File "E:\Ai\pinokio\api\comfyui.git\app\env\lib\site-packages\torch\nn\modules\module.py", line 1541, in callimpl return forward_call(*args, **kwargs) File "E:\Ai\pinokio\api\comfyui.git\app\comfy\cldm\cldm.py", line 296, in forward assert y.shape[0] == x.shape[0]
Keep getting error: "Cannot execute because a node is missing the class_type property.: Node ID '#913'" and it appears to be an "unidentified" module in "Upscale with Model" section. But even when I try to bypass that section this module isn't disabled as other ones in this section. It's the one that has a and b for input and "B" for output. I can't figure out what node I'm missing...
I have the same problem. Did you solved it?
Did anyone manage to make this work? It's like I'm missing a bajillion nodes even after installing a lot of them...