ComfyUI-OpenSoraPlan
Another comfy implementation for the short video generation project PKU-YuanGroup/Open-Sora-Plan, supporting latest 1.3.0 and 1.2.0 and image to video feature, etc.
How much VRAM does ComfyUI-OpenSoraPlan require?
Direct Answer: The ComfyUI node ComfyUI-OpenSoraPlan requires a minimum base VRAM of 4096MB and is optimized for GPUs with at least 8GB of VRAM. Low VRAM mode is not supported for this node.
- Base VRAM:
- 4096MB (4.0GB)
- Recommended GPU:
- 8GB+ VRAM
- Low VRAM Mode:
- ✗ Not supported
- Estimation Confidence:
- MEDIUM
Interactive VRAM Compatibility Estimator
Your GPU has plenty of headroom. You can run this node safely with your active configurations!
Deploy on High-Performance GPUs
Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance GPUs on Vast.ai instantly.
Deploy on Cloud GPUs
Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance cloud GPUs on RunPod instantly.
What Python packages are required for ComfyUI-OpenSoraPlan?
Direct Answer: Running ComfyUI-OpenSoraPlan requires installing the following Python package dependencies: accelerate, albumentations, av, beautifulsoup4, decord, diffusers, einops, ftfy, gdown, h5py, huggingface-hub, idna, imageio, imageio-ffmpeg, matplotlib, moviepy, omegaconf, opencv-python, opencv-python-headless, pandas, pillow, pydub, pytorch-lightning, pytorchvideo, pyyaml, regex, requests, scikit-learn, scikit-video, scipy, sentencepiece, six, tensorboard, test-tube, timm, torchdiffeq, torchmetrics, tqdm, urllib3, uvicorn, wandb. Ensure your ComfyUI environment has these packages active before launching.
accelerate
albumentations
av
beautifulsoup4
decord
diffusers
einops
ftfy
gdown
h5py
huggingface-hub
idna
imageio
imageio-ffmpeg
matplotlib
moviepy
omegaconf
opencv-python
opencv-python-headless
pandas
pillow
pydub
pytorch-lightning
pytorchvideo
pyyaml
regex
requests
scikit-learn
scikit-video
scipy
sentencepiece
six
tensorboard
test-tube
timm
torchdiffeq
torchmetrics
tqdm
urllib3
uvicorn
wandbInteractive Setup & Dependency Resolver
# Loading command...Frequently Asked Questions
How much VRAM does ComfyUI-OpenSoraPlan require?
ComfyUI-OpenSoraPlan requires a minimum of 4096MB (4.0GB) of VRAM for base operation. For optimal performance, a GPU with at least 8GB of VRAM is recommended. Low VRAM mode is not supported for this node.
Can I run ComfyUI-OpenSoraPlan on an RTX 3060, RTX 4070, or RTX 4090?
✅ RTX 3060 (12GB): Yes, fully compatible with 6.8GB headroom. ✅ RTX 4070 (12GB): Yes, fully compatible with 6.8GB headroom. ✅ RTX 4070 Ti (16GB): Yes, fully compatible with 10.4GB headroom. ✅ RTX 4090 (24GB): Yes, fully compatible with 17.6GB headroom
What PyTorch version does ComfyUI-OpenSoraPlan need?
ComfyUI-OpenSoraPlan requires the following PyTorch-related packages: pytorch-lightning, pytorchvideo, torchdiffeq, torchmetrics. Ensure your ComfyUI environment has these installed. Ensure your PyTorch installation matches your CUDA version (use torch.version.cuda to check).
What Python packages are required for ComfyUI-OpenSoraPlan?
To run ComfyUI-OpenSoraPlan, you need to install: accelerate, albumentations, av, beautifulsoup4, decord, diffusers, einops, ftfy, gdown, h5py, huggingface-hub, idna, imageio, imageio-ffmpeg, matplotlib, moviepy, omegaconf, opencv-python, opencv-python-headless, pandas, pillow, pydub, pytorch-lightning, pytorchvideo, pyyaml, regex, requests, scikit-learn, scikit-video, scipy, sentencepiece, six, tensorboard, test-tube, timm, torchdiffeq, torchmetrics, tqdm, urllib3, uvicorn, wandb. You can install these using pip or add them to your requirements.txt file.
How do I install ComfyUI-OpenSoraPlan in ComfyUI?
To install ComfyUI-OpenSoraPlan: (1) Navigate to your ComfyUI/custom_nodes directory, (2) Clone the repository: git clone https://github.com/bombax-xiaoice/ComfyUI-OpenSoraPlan, (3) Install dependencies: pip install -r requirements.txt (if present), (4) Restart ComfyUI. Alternatively, use ComfyUI Manager for one-click installation.