This is direct convert from WAN 2.2 FP16 base checkpoint to NVFP4, using https://github.com/tritant/ComfyUI_Kitchen_nvfp4_Converter
About 2x speedup on Blackwell GPUs. No speedup on older generation gpus, but usable. With a lot of connected LORAs this checkpoint faster than Q4 GGUFs.
LATEST COMFY AND TORCH WITH CUDA 13.x SUPPORT REQUIRED. ON OLDER CUDA VERSIONS THIS MODEL MORE SLOWER THAN GGUFs AND MAY DEGRADE QUALITY OR GENERATES BLACK OUTPUTS.
Description
This is direct convert from WAN 2.2 FP16 base checkpoint (https://huggingface.co/Comfy-Org/Wan_2.2_ComfyUI_Repackaged/blob/main/split_files/diffusion_models/wan2.2_i2v_low_noise_14B_fp16.safetensors) to nvfp4 using https://github.com/tritant/ComfyUI_Kitchen_nvfp4_Converter
About 2x speedup on Blackwell GPUs. No speedup on older generation gpus, but usable. With a lot of connected LORAs this checkpoint faster than Q4 GGUFs.
(HIGHLY RECOMMENDED LATEST COMFY AND TORCH WITH CUDA 13.x SUPPORT, ON OLDER CUDA VERSIONS THIS MODEL MORE SLOWER THAN GGUFs)
FAQ
Comments (20)
I'm new to the WAN 2.2 world. As far as I remember, you need two models: High and Low. Is this model served up with some kind of special sauce?
nothing special inside this, i'm just in process of uploading second low-noise model
@DooFY87 Will I need Lightx Lora to use these models?
@DevourerOfSins yes, lightx lora needed for speed up generations. i not bake any loras inside this model, because nvfp4 checkpoint not receive any speed penalty with connected loras
witch Lightx is the best to use ?
@DooFY87 you're the best ! manythx
COOL ! many THX !!!
is it need some custom node ?
this model works with standard WAN 2.2 workflow from comfyui templates. dont forget about latest comfy and pytorch with cuda 13.x
@DooFY87 thx
definetly not for a noob like me, issues with dgxspark..
For some reason, the Lora files suggested by the author of this post are displaying strange messages and the image is blurry:
lora key not loaded: diffusion_model.blocks.0.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.0.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.0.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.0.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.0.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.0.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.0.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.1.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.1.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.1.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.1.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.10.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.10.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.10.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.10.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.11.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.11.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.11.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.11.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.12.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.12.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.12.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.12.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.13.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.13.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.13.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.13.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.14.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.14.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.14.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.14.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.15.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.15.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.15.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.15.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.16.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.16.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.16.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.16.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.17.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.17.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.17.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.17.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.18.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.18.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.18.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.18.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.19.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.19.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.19.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.19.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.2.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.2.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.2.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.2.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.20.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.20.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.20.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.20.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.21.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.21.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.21.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.21.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.22.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.22.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.22.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.22.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.23.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.23.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.23.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.23.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.24.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.24.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.24.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.24.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.25.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.25.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.25.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.25.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.26.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.26.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.26.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.26.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.27.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.27.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.27.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.27.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.28.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.28.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.28.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.28.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.29.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.29.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.29.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.29.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.3.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.3.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.3.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.3.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.30.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.30.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.30.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.30.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.31.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.31.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.31.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.31.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.32.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.32.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.32.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.32.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.33.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.33.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.33.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.33.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.34.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.34.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.34.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.34.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.35.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.35.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.35.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.35.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.36.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.36.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.36.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.36.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.37.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.37.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.37.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.37.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.38.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.38.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.38.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.38.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.39.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.39.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.39.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.39.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.4.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.4.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.4.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.4.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.5.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.5.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.5.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.5.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.6.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.6.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.6.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.6.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.7.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.7.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.7.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.7.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.8.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.8.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.8.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.8.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.k_img.diff_b
lora key not loaded: diffusion_model.blocks.9.cross_attn.k_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.k_img.lora_up.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.norm_k_img.diff
lora key not loaded: diffusion_model.blocks.9.cross_attn.v_img.diff_b
lora key not loaded: diffusion_model.blocks.9.cross_attn.v_img.lora_down.weight
lora key not loaded: diffusion_model.blocks.9.cross_attn.v_img.lora_up.weight
lora key not loaded: diffusion_model.img_emb.proj.0.diff
lora key not loaded: diffusion_model.img_emb.proj.0.diff_b
lora key not loaded: diffusion_model.img_emb.proj.1.diff_b
lora key not loaded: diffusion_model.img_emb.proj.1.lora_down.weight
lora key not loaded: diffusion_model.img_emb.proj.1.lora_up.weight
lora key not loaded: diffusion_model.img_emb.proj.3.diff_b
lora key not loaded: diffusion_model.img_emb.proj.3.lora_down.weight
lora key not loaded: diffusion_model.img_emb.proj.3.lora_up.weight
lora key not loaded: diffusion_model.img_emb.proj.4.diff
lora key not loaded: diffusion_model.img_emb.proj.4.diff_b
I've read that NVFP4 doesn't support LoRAs at all. This is basically dead on arrival because of no LightX2V. It's going to be slower than FP8 with LightX2V.
@aurelius This nvfp4 model works fine with LORAs, the problem is on the user's side, in his software or hardware
@DooFY87 Okay, then I was misinformed. I get a black square output, but I believe it's because of torch==2.9.0+cu128. I need to update my torch. The reason I've been holding off is SageAttention. Apparently there's a cu130 SageAttention wheel wheel now, so I'll go for it.
@DooFY87 Yeah, it works now. Was the old torch.
doesnt work, generation is still image
Works well on torch 2.9 + cuda 12.8