ComfyUI-ModelQuantizer
This is a node to converts models into Fp8, bf16, fp16.
How much VRAM does ComfyUI-ModelQuantizer require?
Direct Answer: The ComfyUI node ComfyUI-ModelQuantizer requires a minimum base VRAM of 128MB and is optimized for GPUs with at least 4GB of VRAM. Low VRAM mode is fully supported for resource-constrained setups.
- Base VRAM:
- 128MB (0.1GB)
- Recommended GPU:
- 4GB+ VRAM
- Low VRAM Mode:
- ✓ Supported
- Estimation Confidence:
- MEDIUM
Interactive VRAM Compatibility Estimator
Your GPU has plenty of headroom. You can run this node safely with your active configurations!
Deploy on High-Performance GPUs
Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance GPUs on Vast.ai instantly.
Deploy on Cloud GPUs
Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance cloud GPUs on RunPod instantly.
What Python packages are required for ComfyUI-ModelQuantizer?
Direct Answer: Running ComfyUI-ModelQuantizer requires installing the following Python package dependencies: huggingface_hub>=0.16.0, numpy>=1.17.0, requests>=2.28.0, safetensors>=0.3.1, tensorflow>=2.13.0, tensorflow-model-optimization>=0.7.0, torch>=2.0.0, tqdm>=4.65.0. This node specifically requires PyTorch version 2.0.0 or newer.
huggingface_hub>=0.16.0
numpy>=1.17.0
requests>=2.28.0
safetensors>=0.3.1
tensorflow>=2.13.0
tensorflow-model-optimization>=0.7.0
torch>=2.0.0
tqdm>=4.65.0Interactive Setup & Dependency Resolver
# Loading command...Special Environment Requirements:
Requires PyTorch version 2.0.0+.
# Loading PyTorch command...Frequently Asked Questions
How much VRAM does ComfyUI-ModelQuantizer require?
ComfyUI-ModelQuantizer requires a minimum of 128MB (0.1GB) of VRAM for base operation. For optimal performance, a GPU with at least 4GB of VRAM is recommended. This node supports low VRAM mode for resource-constrained setups.
Can I run ComfyUI-ModelQuantizer on an RTX 3060, RTX 4070, or RTX 4090?
✅ RTX 3060 (12GB): Yes, fully compatible with 10.7GB headroom. ✅ RTX 4070 (12GB): Yes, fully compatible with 10.7GB headroom. ✅ RTX 4070 Ti (16GB): Yes, fully compatible with 14.3GB headroom. ✅ RTX 4090 (24GB): Yes, fully compatible with 21.5GB headroom
What PyTorch version does ComfyUI-ModelQuantizer need?
ComfyUI-ModelQuantizer requires the following PyTorch-related packages: torch>=2.0.0. Ensure your ComfyUI environment has these installed. Ensure your PyTorch installation matches your CUDA version (use torch.version.cuda to check).
What Python packages are required for ComfyUI-ModelQuantizer?
To run ComfyUI-ModelQuantizer, you need to install: huggingface_hub>=0.16.0, numpy>=1.17.0, requests>=2.28.0, safetensors>=0.3.1, tensorflow>=2.13.0, tensorflow-model-optimization>=0.7.0, torch>=2.0.0, tqdm>=4.65.0. You can install these using pip or add them to your requirements.txt file.
How can I reduce VRAM usage when running ComfyUI-ModelQuantizer?
ComfyUI-ModelQuantizer supports low VRAM mode. To reduce memory usage: (1) Enable --lowvram or --medvram flags in ComfyUI, (2) Reduce batch size to 1, (3) Use fp16 or fp8 precision if supported, (4) Close other GPU applications.
How do I install ComfyUI-ModelQuantizer in ComfyUI?
To install ComfyUI-ModelQuantizer: (1) Navigate to your ComfyUI/custom_nodes directory, (2) Clone the repository: git clone https://github.com/lum3on/ComfyUI-ModelQuantizer, (3) Install dependencies: pip install -r requirements.txt (if present), (4) Restart ComfyUI. Alternatively, use ComfyUI Manager for one-click installation.