ComfyUI-Ovis-U1

By neverbiasuView on GitHub →

This repository adds ComfyUI custom nodes that wrap the Ovis-U1 multimodal model, exposing three primary workflows inside the ComfyUI editor.

How much VRAM does ComfyUI-Ovis-U1 require?

Direct Answer: The ComfyUI node ComfyUI-Ovis-U1 requires a minimum base VRAM of 128MB and is optimized for GPUs with at least 4GB of VRAM. Low VRAM mode is fully supported for resource-constrained setups.

High (2-4GB)
Base VRAM:
128MB (0.1GB)
Recommended GPU:
4GB+ VRAM
Low VRAM Mode:
✓ Supported
Estimation Confidence:
MEDIUM

Interactive VRAM Compatibility Estimator

Estimated Total VRAM: 3.00 GBTarget: 8 GB
✅ Comfortable Fit

Your GPU has plenty of headroom. You can run this node safely with your active configurations!

Deploy on High-Performance GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance GPUs on Vast.ai instantly.

🚀 Deploy on Vast.ai

Deploy on Cloud GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance cloud GPUs on RunPod instantly.

🚀 Deploy on RunPod

What Python packages are required for ComfyUI-Ovis-U1?

Direct Answer: Running ComfyUI-Ovis-U1 requires installing the following Python package dependencies: accelerate~=1.1.0, deepspeed~=0.15.4, diffusers~=0.31.0, fastapi~=0.112.4, httpx, markdown2, moviepy~=1.0.3, pandas, pyarrow~=18.0.0, pydantic~=2.8.2, pysubs2~=1.7.2, requests, scikit-learn~=1.2.2, tiktoken, timm~=1.0.11, transformers_stream_generator~=0.0.4, trl~=0.12.1, uvicorn. Ensure your ComfyUI environment has these packages active before launching.

requirements.txt
accelerate~=1.1.0
deepspeed~=0.15.4
diffusers~=0.31.0
fastapi~=0.112.4
httpx
markdown2
moviepy~=1.0.3
pandas
pyarrow~=18.0.0
pydantic~=2.8.2
pysubs2~=1.7.2
requests
scikit-learn~=1.2.2
tiktoken
timm~=1.0.11
transformers_stream_generator~=0.0.4
trl~=0.12.1
uvicorn

Interactive Setup & Dependency Resolver

Operating System:
Environment Type:
Run this terminal command in your ComfyUI root folder:
# Loading command...

Related Custom Nodes

The following custom nodes run in the same PyTorch / CUDA environment and share similar categories or workflows:

AAA Metadata System
by EricRollei128MB VRAM
Animatediff MotionLoRA Trainer
by kijai4.0GB VRAM
Arc2Face ComfyUI Node Library
by caleboleary128MB VRAM
Arthemy Live Tuner - SDXL
by aledelpho8.0GB VRAM
BokehDiffusionComfyUI
by jrabek256MB VRAM

Frequently Asked Questions

How much VRAM does ComfyUI-Ovis-U1 require?

ComfyUI-Ovis-U1 requires a minimum of 128MB (0.1GB) of VRAM for base operation. For optimal performance, a GPU with at least 4GB of VRAM is recommended. This node supports low VRAM mode for resource-constrained setups.

Can I run ComfyUI-Ovis-U1 on an RTX 3060, RTX 4070, or RTX 4090?

✅ RTX 3060 (12GB): Yes, fully compatible with 10.7GB headroom. ✅ RTX 4070 (12GB): Yes, fully compatible with 10.7GB headroom. ✅ RTX 4070 Ti (16GB): Yes, fully compatible with 14.3GB headroom. ✅ RTX 4090 (24GB): Yes, fully compatible with 21.5GB headroom

What Python packages are required for ComfyUI-Ovis-U1?

To run ComfyUI-Ovis-U1, you need to install: accelerate~=1.1.0, deepspeed~=0.15.4, diffusers~=0.31.0, fastapi~=0.112.4, httpx, markdown2, moviepy~=1.0.3, pandas, pyarrow~=18.0.0, pydantic~=2.8.2, pysubs2~=1.7.2, requests, scikit-learn~=1.2.2, tiktoken, timm~=1.0.11, transformers_stream_generator~=0.0.4, trl~=0.12.1, uvicorn. You can install these using pip or add them to your requirements.txt file.

How can I reduce VRAM usage when running ComfyUI-Ovis-U1?

ComfyUI-Ovis-U1 supports low VRAM mode. To reduce memory usage: (1) Enable --lowvram or --medvram flags in ComfyUI, (2) Reduce batch size to 1, (3) Use fp16 or fp8 precision if supported, (4) Close other GPU applications.

How do I install ComfyUI-Ovis-U1 in ComfyUI?

To install ComfyUI-Ovis-U1: (1) Navigate to your ComfyUI/custom_nodes directory, (2) Clone the repository: git clone https://github.com/neverbiasu/ComfyUI-Ovis-U1, (3) Install dependencies: pip install -r requirements.txt (if present), (4) Restart ComfyUI. Alternatively, use ComfyUI Manager for one-click installation.