Searge-LLM for ComfyUI v1.0

By SeargeDPView on GitHub →

A prompt-generator or prompt-improvement node for ComfyUI, utilizing the power of a language model to turn a provided text-to-image prompt into a more detailed and improved prompt.

How much VRAM does Searge-LLM for ComfyUI v1.0 require?

Direct Answer: The ComfyUI node Searge-LLM for ComfyUI v1.0 requires a minimum base VRAM of 256MB and is optimized for GPUs with at least 4GB of VRAM. Low VRAM mode is fully supported for resource-constrained setups.

High (2-4GB)
Base VRAM:
256MB (0.3GB)
Recommended GPU:
4GB+ VRAM
Low VRAM Mode:
✓ Supported
Estimation Confidence:
HIGH

Interactive VRAM Compatibility Estimator

Estimated Total VRAM: 3.00 GBTarget: 8 GB
✅ Comfortable Fit

Your GPU has plenty of headroom. You can run this node safely with your active configurations!

Deploy on High-Performance GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance GPUs on Vast.ai instantly.

🚀 Deploy on Vast.ai

Deploy on Cloud GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance cloud GPUs on RunPod instantly.

🚀 Deploy on RunPod

What Python packages are required for Searge-LLM for ComfyUI v1.0?

Direct Answer: Running Searge-LLM for ComfyUI v1.0 requires installing the following Python package dependencies: accelerate, llama-cpp-python, torch>=1.7.1, transformers>=4.0.0. This node specifically requires PyTorch version 1.7.1 or newer.

requirements.txt
accelerate
llama-cpp-python
torch>=1.7.1
transformers>=4.0.0

Interactive Setup & Dependency Resolver

Operating System:
Environment Type:
Run this terminal command in your ComfyUI root folder:
# Loading command...

Special Environment Requirements:

Requires PyTorch version 1.7.1+.

To update PyTorch for your selected setup, run:
# Loading PyTorch command...

Related Custom Nodes

The following custom nodes run in the same PyTorch / CUDA environment and share similar categories or workflows:

LLM Node for ComfyUI
by Big Idea Technology256MB VRAM
AITocha Vision
by aitocha128MB VRAM
AI_Text_Comfyui
by Zch6111256MB VRAM
AK XZ Axis (XY for any KSampler)
by akawana256MB VRAM

Frequently Asked Questions

How much VRAM does Searge-LLM for ComfyUI v1.0 require?

Searge-LLM for ComfyUI v1.0 requires a minimum of 256MB (0.3GB) of VRAM for base operation. For optimal performance, a GPU with at least 4GB of VRAM is recommended. This node supports low VRAM mode for resource-constrained setups.

Can I run Searge-LLM for ComfyUI v1.0 on an RTX 3060, RTX 4070, or RTX 4090?

✅ RTX 3060 (12GB): Yes, fully compatible with 10.6GB headroom. ✅ RTX 4070 (12GB): Yes, fully compatible with 10.6GB headroom. ✅ RTX 4070 Ti (16GB): Yes, fully compatible with 14.2GB headroom. ✅ RTX 4090 (24GB): Yes, fully compatible with 21.4GB headroom

What PyTorch version does Searge-LLM for ComfyUI v1.0 need?

Searge-LLM for ComfyUI v1.0 requires the following PyTorch-related packages: torch>=1.7.1. Ensure your ComfyUI environment has these installed. Ensure your PyTorch installation matches your CUDA version (use torch.version.cuda to check).

What Python packages are required for Searge-LLM for ComfyUI v1.0?

To run Searge-LLM for ComfyUI v1.0, you need to install: accelerate, llama-cpp-python, torch>=1.7.1, transformers>=4.0.0. You can install these using pip or add them to your requirements.txt file.

How can I reduce VRAM usage when running Searge-LLM for ComfyUI v1.0?

Searge-LLM for ComfyUI v1.0 supports low VRAM mode. To reduce memory usage: (1) Enable --lowvram or --medvram flags in ComfyUI, (2) Reduce batch size to 1, (3) Use fp16 or fp8 precision if supported, (4) Close other GPU applications.

How do I install Searge-LLM for ComfyUI v1.0 in ComfyUI?

To install Searge-LLM for ComfyUI v1.0: (1) Navigate to your ComfyUI/custom_nodes directory, (2) Clone the repository: git clone https://github.com/SeargeDP/ComfyUI_Searge_LLM, (3) Install dependencies: pip install -r requirements.txt (if present), (4) Restart ComfyUI. Alternatively, use ComfyUI Manager for one-click installation.