GLM-4V Image Descriptor on 24GB GPU

linjian-ufo image_generationtext 128MB VRAM

Compatible with 24GB GPU

This node will run on RTX 3090, RTX 4090, A5000 and similar GPUs with 24GB VRAM.

Optimized Settings for 24GB

VRAM Utilization

1%

You're using 1% of your 24GB VRAM, leaving 23.9GB headroom.

Recommended Batch Size

23

Start with batch size of 23 for optimal performance.

Suggested Resolution

1024x1024 or higher

Best balance of quality and performance for 24GB.

Performance Tips

  • Close other GPU-intensive applications
  • Low VRAM mode available
  • Monitor GPU usage with nvidia-smi

🚀 Deploy ComfyUI on Vast.ai

Need low-cost, high-performance cloud GPUs to run ComfyUI and this custom node? Rent instantly on Vast.ai starting at pennies per hour.

Deploy on Vast.ai

🚀 Deploy ComfyUI on RunPod

Need high-performance cloud GPUs to run ComfyUI and this custom node? Rent instantly on RunPod starting at just a few cents per hour.

Deploy on RunPod

VRAM Requirements

Base VRAM Requirement:
128MB (0.13GB)
Your GPU (24GB):
24576MB (24GB) - RTX 3090, RTX 4090, A5000
VRAM Utilization:
1%
Available Headroom:
23.88GB
Low VRAM Mode:
✓ Supported
Estimation Confidence:
MEDIUM

Python Dependencies

  • accelerate>=0.21.0 # 模型加速库 / Model acceleration library
  • bitsandbytes>=0.41.0 # 量化支持库 / Quantization support library
  • csv# CSV处理库(Python内置) / CSV processing library (built-in Python)
  • glob# 文件名模式匹配(Python内置) / Filename pattern matching (built-in Python)
  • json# JSON处理库(Python内置) / JSON processing library (built-in Python)
  • numpy>=1.21.0 # 数值计算库 / Numerical computing library
  • os# 操作系统接口(Python内置) / OS interface (built-in Python)
  • pathlib# 路径处理库(Python 3.4+内置) / Path handling library (built-in Python 3.4+)
  • pillow>=9.0.0 # Python图像处理库 / Python Image Library
  • protobuf>=3.20.0 # Protocol Buffers支持 / Protocol Buffers support

+ 6 more dependencies

View for Different GPU