<h2 id="krea-2-turbo-activation-aware-svdquant-w4a4-for-comfyui">Krea 2 Turbo — Activation-Aware SVDQuant W4A4 for ComfyUI</h2>Activation-aware INT4 quantization + SVDQuant low-rank correction for Krea 2 Turbo — ~2.4x faster than BF16, about a third the file size of the usual FP8 setup, no calibration dataset needed. Built for GPUs without FP8 tensor cores (Turing/Ampere, RTX 20/30-series), where the standard FP8 advice actually runs slower than plain BF16.Speed (RTX 3090, 1024x1024, 8 steps, warm):<ul><li>BF16 (reference): 18.80 s — 1.00x</li><li>W4A4, no low-rank branch: 6.49 s — 2.90x</li><li>SVDQuant rank 64: 7.16 s — 2.63x</li><li>SVDQuant rank 256 / rank 256 actaware: 7.77 s — 2.42x</li></ul>The low-rank branch (the accuracy correction) costs ~9-10% of step time and barely varies with rank — going from rank 16 to rank 256 is only ~4% slower.Fidelity, measured, not guessed: LPIPS against a BF16 reference, 16 prompts x 2 seeds, paired stats. The activation-aware objective (branch fit against real per-channel activation energy instead of assuming it's uniform) is the biggest single accuracy win in the whole project and costs nothing at inference — same shapes, same kernels, only different numbers inside the branch.Links: 🔧 Custom nodes (GitHub): <a target="_blank" rel="ugc" href="https://github.com/alperktt/Krea-2-SVDQuant-ComfyUI">https://github.com/alperktt/Krea-2-SVDQuant-ComfyUI</a> 📦 Checkpoints + full benchmarks + example images (Hugging Face): <a target="_blank" rel="ugc" href="https://huggingface.co/AlperKTS/Krea-2-SVDQuant-ComfyUI">https://huggingface.co/AlperKTS/Krea-2-SVDQuant-ComfyUI</a>Setup:<ol><li>Clone the custom nodes: git clone <a target="_blank" rel="ugc" href="https://github.com/alperktt/Krea-2-SVDQuant-ComfyUI">https://github.com/alperktt/Krea-2-SVDQuant-ComfyUI</a> custom_nodes/krea2-svdquant Restart ComfyUI.</li><li>Download a checkpoint from Hugging Face into ComfyUI/models/diffusion_models/. Start with rank256-actaware — closest to BF16 of anything in the sweep, same speed as plain rank 256. rank64 if you want the smaller file and never load a LoRA. W4A4-noLowRank for max speed/min size with no branch at all.</li><li>Grab the text encoder (qwen3vl_4b_fp8_scaled.safetensors) and VAE (qwen_image_vae.safetensors) — standard for any Krea 2 Turbo workflow.</li><li>Load this workflow, select your checkpoint in the loader node, generate.</li></ol>Loader node by checkpoint:<ul><li>W4A4-noLowRank → stock UNETLoader</li><li>SVDQuant-W4A4-rank* (16/64/128/256/actaware) → Krea2 SVDQuant W4A4 Loader (this repo)</li></ul>Using LoRAs? Use Krea2 SVDQuant LoRA Loader. On a quantized checkpoint the stock loader would have to dequantize the weight, add the LoRA, and requantize it — losing the 4-bit format and requantizing the LoRA delta along with it. This repo's node applies the LoRA as a parallel branch instead, so the quantized weight is never touched. If you load LoRAs, use rank 256 — rank 64 loses most of its accuracy advantage under one.Tested on: RTX 3090 (Ampere) — works on any GPU with INT8/W4A4 tensor cores (Turing and up). Experimental, from-scratch project on ComfyUI's native comfy_kitchen backend. Benchmark reports from other GPUs welcome — open a discussion on the repo.

Krea 2 Turbo — SVDQuant

Native W4A4 (activation-aware INT4) quantization + SVDQuant low-rank correction for Krea 2 Turbo, built from scratch on ComfyUI's own <code>comfy_kitchen</code> backend (not Nunchaku — no Krea 2 support there).Why activation-aware INT4: Weight-only 4-bit quantization (W4A16) doesn't actually speed anything up — if activations stay 16-bit, the matmul still runs on bf16 tensor cores at bf16 speed. The real gain comes from quantizing activations too, down to 4-bit, onto hardware that has native INT8/W4A4 tensor cores (Turing/RTX 20-series and up — much wider support than FP8, which only helps on Ada/Hopper/Blackwell). The <code>convrot</code> (Hadamard rotation) step handles the outliers that 4-bit activations create, and the SVDQuant low-rank branch claws back additional accuracy on top of that — no calibration dataset needed for any of it.What's included:<ul><li>4 checkpoints: <code>W4A4-noLowRank</code> (7.50 GB, fastest) and 3 activation-aware SVDQuant-W4A4 variants at rank 16/64/128 (7.60–8.30 GB) — higher rank = larger correction branch = generally closer to BF16, though not strictly monotonic at a single seed.</li><li>2 custom nodes: <code>Krea2 SVDQuant W4A4 Loader</code> (reads the extra low-rank tensors the stock UNETLoader can't) and <code>Krea2 SVDQuant LoRA Loader</code> (stock LoRA loader silently skips all 224 quantized transformer layers on these models — matches only ~32/256 with no warning; this one patches correctly via a parallel low-rank branch).</li><li><code>quantize_krea2.py</code>: reproducible script, regenerates any of these from a BF16 source in under two minutes, plus lets you produce ranks not included here (32, 256) or the INT8 (non-activation-aware-4-bit) variant if you want the higher-accuracy/lower-compression tradeoff instead.</li></ul>Speed (RTX 3090, 1024x1024, 8-step Euler, warm run):formatwarm runvs. BF16BF1621.3s1.0xFP8 (emulated on Ampere)19.2s1.1xActivation-aware W4A4 (no low-rank)10.1s2.1xActivation-aware SVDQuant W4A4 (any rank)10.1–10.2s2.1xAccuracy notes: Rank 128 was the closest SVDQuant variant to BF16 in my qualitative text-rendering tests, which is why it's included alongside rank 16 (smallest) and rank 64 (middle ground). If your use case is dense small text (menus, labels, documents), the low-rank branch narrows the gap but doesn't fully close it — large text and general composition hold up fine across every checkpoint here, including the no-low-rank file.

Files with SHA256: a41808a78bf094979460071a2a5e7b25d344e8cc5e7aee0b84c4f1114edf0766