Model and Checkpoint Loaders for NF4 and FP4

Name: Model and Checkpoint Loaders for NF4 and FP4
Author: silveroxides

Nodes for loading both Checkpoints and UNET/Diffussion models quantized to bitsandbytes NF4 or FP4 format. Still under development and some limitations such as using LoRA might apply still.

VRAM Requirements

Direct Answer: The ComfyUI node Model and Checkpoint Loaders for NF4 and FP4 requires a minimum base VRAM of 128MB and is optimized for GPUs with at least 4GB of VRAM. Low VRAM mode is fully supported for resource-constrained setups.

High (2-4GB)

Base VRAM:: 128MB (0.1GB)
Recommended GPU:: 4GB+ VRAM
Low VRAM Mode:: ✓ Supported
Estimation Confidence:: MEDIUM

🧮 Interactive VRAM Compatibility Estimator

1. Your GPU VRAM:

2. Base Model Weight:

3. Target Resolution:

4. ComfyUI Optimization launch argument:

Estimated Total VRAM: 3.00 GBTarget: 8 GB

✅ Comfortable Fit

Your GPU has plenty of headroom. You can run this node safely with your active configurations!

Deploy on High-Performance GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance GPUs on Vast.ai instantly.

🚀 Deploy on Vast.ai

Deploy on Cloud GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance cloud GPUs on RunPod instantly.

🚀 Deploy on RunPod

Python Dependencies

Direct Answer: Running Model and Checkpoint Loaders for NF4 and FP4 requires installing the following Python package dependencies: bitsandbytes>=0.43.0. Ensure your ComfyUI environment has these packages active before launching.

requirements.txt

bitsandbytes>=0.43.0

🛠️ Interactive Setup & Dependency Resolver

Operating System:

Environment Type:

Run this terminal command in your ComfyUI root folder:

# Loading command...