ComfyUI_video-image-motion-transfer
Introduces a node that tries to approximate the entire video using it's first frame (that we stylize) by warping it using optical flow extracted from the video. First we do image-to-image using the reference video's first frame and a depth controlnet. The generated object doesn't have to closely resemble the reference like on the demo. Then the generated image and the video frames are fed into the node and it returns a warped video. No ai models are used by the node. The example workflow uses SDXL but you can get it to work with any arch if you manage i2i.
VRAM Requirements
Direct Answer: The ComfyUI node ComfyUI_video-image-motion-transfer requires a minimum base VRAM of 8192MB and is optimized for GPUs with at least 12GB of VRAM. Low VRAM mode is not supported for this node.
- Base VRAM:
- 8192MB (8.0GB)
- Recommended GPU:
- 12GB+ VRAM
- Low VRAM Mode:
- ✗ Not supported
- Estimation Confidence:
- HIGH
🧮 Interactive VRAM Compatibility Estimator
Your GPU has plenty of headroom. You can run this node safely with your active configurations!
Deploy on High-Performance GPUs
Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance GPUs on Vast.ai instantly.
Deploy on Cloud GPUs
Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance cloud GPUs on RunPod instantly.
Python Dependencies
Direct Answer: Running ComfyUI_video-image-motion-transfer requires installing the following Python package dependencies: cv2opencv-contrib-python, numpy, opencv-python, torch, tqdm. Ensure your ComfyUI environment has these packages active before launching.
cv2opencv-contrib-python
numpy
opencv-python
torch
tqdm🛠️ Interactive Setup & Dependency Resolver
# Loading command...Compatible Foundations
This node is verified to support or optimize workflows for the following foundation model families: