ComfyUI-nunchaku

By mit-han-labView on GitHub →

Nunchaku ComfyUI Node. Nunchaku is the inference that supports SVDQuant. SVDQuant is a new post-training training quantization paradigm for diffusion models, which quantize both the weights and activations of FLUX.1 to 4 bits, achieving 3.5× memory and 8.7× latency reduction on a 16GB laptop 4090 GPU. See more details: https://github.com/mit-han-lab/nunchaku

How much VRAM does ComfyUI-nunchaku require?

Direct Answer: The ComfyUI node ComfyUI-nunchaku requires a minimum base VRAM of 12288MB and is optimized for GPUs with at least 24GB of VRAM. Low VRAM mode is not supported for this node.

Extreme (>8GB)
Base VRAM:
12288MB (12.0GB)
Recommended GPU:
24GB+ VRAM
Low VRAM Mode:
✗ Not supported
Estimation Confidence:
HIGH

Interactive VRAM Compatibility Estimator

Estimated Total VRAM: 3.00 GBTarget: 8 GB
✅ Comfortable Fit

Your GPU has plenty of headroom. You can run this node safely with your active configurations!

Deploy on High-Performance GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance GPUs on Vast.ai instantly.

🚀 Deploy on Vast.ai

Deploy on Cloud GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance cloud GPUs on RunPod instantly.

🚀 Deploy on RunPod

What Python packages are required for ComfyUI-nunchaku?

Direct Answer: Running ComfyUI-nunchaku requires installing the following Python package dependencies: accelerate>=1.10, diffusers>=0.35, facexlib, huggingface_hub>=0.34, insightface, onnxruntime, opencv-python, peft>=0.17, protobuf, sentencepiece, timm, tomli, transformers>=4.54. Ensure your ComfyUI environment has these packages active before launching.

requirements.txt
accelerate>=1.10
diffusers>=0.35
facexlib
huggingface_hub>=0.34
insightface
onnxruntime
opencv-python
peft>=0.17
protobuf
sentencepiece
timm
tomli
transformers>=4.54

Interactive Setup & Dependency Resolver

Operating System:
Environment Type:
Run this terminal command in your ComfyUI root folder:
# Loading command...

Compatible Foundations

This node is verified to support or optimize workflows for the following foundation model families:

Frequently Asked Questions

How much VRAM does ComfyUI-nunchaku require?

ComfyUI-nunchaku requires a minimum of 12288MB (12.0GB) of VRAM for base operation. For optimal performance, a GPU with at least 24GB of VRAM is recommended. Low VRAM mode is not supported for this node.

Can I run ComfyUI-nunchaku on an RTX 3060, RTX 4070, or RTX 4090?

❌ RTX 3060 (12GB): Insufficient VRAM (needs 12.0GB minimum). ❌ RTX 4070 (12GB): Insufficient VRAM (needs 12.0GB minimum). ⚠️ RTX 4070 Ti (16GB): Can run, but may experience performance issues or require low VRAM mode. ✅ RTX 4090 (24GB): Yes, fully compatible with 9.6GB headroom

What Python packages are required for ComfyUI-nunchaku?

To run ComfyUI-nunchaku, you need to install: accelerate>=1.10, diffusers>=0.35, facexlib, huggingface_hub>=0.34, insightface, onnxruntime, opencv-python, peft>=0.17, protobuf, sentencepiece, timm, tomli, transformers>=4.54. You can install these using pip or add them to your requirements.txt file.

How do I install ComfyUI-nunchaku in ComfyUI?

To install ComfyUI-nunchaku: (1) Navigate to your ComfyUI/custom_nodes directory, (2) Clone the repository: git clone https://github.com/nunchaku-tech/ComfyUI-nunchaku, (3) Install dependencies: pip install -r requirements.txt (if present), (4) Restart ComfyUI. Alternatively, use ComfyUI Manager for one-click installation.