Source https://huggingface.co/mit-han-lab/svdquant-models from mit-han-lab
ComfyUI nodes. Original source Reddit. Thanks to @grannikji for noticing it ❤
Paper: https://arxiv.org/abs/2411.05007
Quantization Library: https://github.com/mit-han-lab/deepcompressor
Inference Engine: https://github.com/mit-han-lab/nunchaku
Website: https://hanlab.mit.edu/projects/svdquant
Demo: https://svdquant.mit.edu/
Blog: https://hanlab.mit.edu/blog/svdquant
☕ Buy me a coffee: https://ko-fi.com/ralfingerai
🍺 Join my discord: https://discord.com/invite/pAz4Bt3rqb
Description
FAQ
Comments (28)
🍅 NOT IMPLEMENTED YET FOR COMFY/FORGE etc. 🍆
do you know when it will available ?
@Nico53425342 I am monitoring the HF page daily, sadly no news so far!
Thank You.
But how to use this model in Forge?
Its not working with any UI yet, hopefully soon!
Anyone know why FLUXdev has been so terrible in quality lately? as of late Oct image generation via webuis (forge and comfyui) are bad, and dont reproduce older generations.
Use it now by generating free images from this url https://hanlab.mit.edu/projects/svdquant (demo space). Please post your images, so we know more about it
It works , 2X speed up. good job ! man!
Wating for its custom nodes of comfyui
any hints to handle it in swarmUI ?
I use SVDQuant with SwarmUI installed with StabilityMatrix. You can see an explanation in "About this Version" in https://civitai.com/models/646328?modelVersionId=1745667 to use the normal installation without Matrix
How to use it local?
ohh no! Not another comment asking about local! *gasp.
But seriously though really hoping to use this soon on Forge / Comfyui. Great work guys!
Our calls have been answered! This is not a drill!
(ComfyUI only currently. Now to push the same for Forge...)
how to install this model windows comfyui?
S it doesn't works with windows unless you mess with WSL?-.-
SVDQuantFluxDiTLloader node not found.
Where can I download it?
Is there a node that uses the safetensors file alone, not the folder?
You have to install this custom node pack to use this model:
https://github.com/mit-han-lab/ComfyUI-nunchaku
They have packed the folder contents into a single safetensors file in their latest updates. So, you can download that as well, though I haven't tried that yet.
Doesn't work for me in comfyUI: NunchakuFluxDiTLoader: 'NoneType' object is not subscriptable
try use the latest nunchaku model instead of this deprecated version
https://huggingface.co/mit-han-lab/nunchaku-flux.1-dev/blob/main/svdq-int4_r32-flux.1-dev.safetensors
Latest Nunchaku 0.3.3 gives error:
NunchakuFluxDiTLoader: 'NoneType' object is not subscriptable
Using Nunchaku FLUX DiT Loader
Both dev and schnell versions of this are broken