ComfyUI-MotionCtrl

By chaojieView on GitHub →

Nodes: Download the weights of MotionCtrl [a/motionctrl.pth](https://huggingface.co/TencentARC/MotionCtrl/blob/main/motionctrl.pth) and put it to ComfyUI/models/checkpoints

How much VRAM does ComfyUI-MotionCtrl require?

Direct Answer: The ComfyUI node ComfyUI-MotionCtrl requires a minimum base VRAM of 4096MB and is optimized for GPUs with at least 8GB of VRAM. Low VRAM mode is not supported for this node.

Very High (4-8GB)
Base VRAM:
4096MB (4.0GB)
Recommended GPU:
8GB+ VRAM
Low VRAM Mode:
✗ Not supported
Estimation Confidence:
MEDIUM

Interactive VRAM Compatibility Estimator

Estimated Total VRAM: 3.00 GBTarget: 8 GB
✅ Comfortable Fit

Your GPU has plenty of headroom. You can run this node safely with your active configurations!

Deploy on High-Performance GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance GPUs on Vast.ai instantly.

🚀 Deploy on Vast.ai

Deploy on Cloud GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance cloud GPUs on RunPod instantly.

🚀 Deploy on RunPod

What Python packages are required for ComfyUI-MotionCtrl?

Direct Answer: Running ComfyUI-MotionCtrl requires installing the following Python package dependencies: annotated-types==0.5.0, av, decord, einops, fairscale, gradio==3.37.0, imageio==2.14.1, imageio-ffmpeg==0.4.7, kornia, moviepy, omegaconf, open_clip_torch, opencv-python==4.8.0.74, pandas, pandas, pillow, plotly, psutil==5.9.5, pytorch-lightning==1.9.0, scikit-learn, taming-transformers-rom1504, timm, tqdm, transformers. Ensure your ComfyUI environment has these packages active before launching.

requirements.txt
annotated-types==0.5.0
av
decord
einops
fairscale
gradio==3.37.0
imageio==2.14.1
imageio-ffmpeg==0.4.7
kornia
moviepy
omegaconf
open_clip_torch
opencv-python==4.8.0.74
pandas
pandas
pillow
plotly
psutil==5.9.5
pytorch-lightning==1.9.0
scikit-learn
taming-transformers-rom1504
timm
tqdm
transformers

Interactive Setup & Dependency Resolver

Operating System:
Environment Type:
Run this terminal command in your ComfyUI root folder:
# Loading command...

Related Custom Nodes

The following custom nodes run in the same PyTorch / CUDA environment and share similar categories or workflows:

ComfyUI-DragNUWA
by chaojie256MB VRAM
ComfyUI-LaVIT
by chaojie4.0GB VRAM
ComfyUI-MotionCtrl-SVD
by chaojie4.0GB VRAM
AnimateDiff Evolved
by Kosinkadink4.0GB VRAM

Frequently Asked Questions

How much VRAM does ComfyUI-MotionCtrl require?

ComfyUI-MotionCtrl requires a minimum of 4096MB (4.0GB) of VRAM for base operation. For optimal performance, a GPU with at least 8GB of VRAM is recommended. Low VRAM mode is not supported for this node.

Can I run ComfyUI-MotionCtrl on an RTX 3060, RTX 4070, or RTX 4090?

✅ RTX 3060 (12GB): Yes, fully compatible with 6.8GB headroom. ✅ RTX 4070 (12GB): Yes, fully compatible with 6.8GB headroom. ✅ RTX 4070 Ti (16GB): Yes, fully compatible with 10.4GB headroom. ✅ RTX 4090 (24GB): Yes, fully compatible with 17.6GB headroom

What PyTorch version does ComfyUI-MotionCtrl need?

ComfyUI-MotionCtrl requires the following PyTorch-related packages: open_clip_torch, pytorch-lightning==1.9.0. Ensure your ComfyUI environment has these installed. Ensure your PyTorch installation matches your CUDA version (use torch.version.cuda to check).

What Python packages are required for ComfyUI-MotionCtrl?

To run ComfyUI-MotionCtrl, you need to install: annotated-types==0.5.0, av, decord, einops, fairscale, gradio==3.37.0, imageio==2.14.1, imageio-ffmpeg==0.4.7, kornia, moviepy, omegaconf, open_clip_torch, opencv-python==4.8.0.74, pandas, pandas, pillow, plotly, psutil==5.9.5, pytorch-lightning==1.9.0, scikit-learn, taming-transformers-rom1504, timm, tqdm, transformers. You can install these using pip or add them to your requirements.txt file.

How do I install ComfyUI-MotionCtrl in ComfyUI?

To install ComfyUI-MotionCtrl: (1) Navigate to your ComfyUI/custom_nodes directory, (2) Clone the repository: git clone https://github.com/chaojie/ComfyUI-MotionCtrl, (3) Install dependencies: pip install -r requirements.txt (if present), (4) Restart ComfyUI. Alternatively, use ComfyUI Manager for one-click installation.