comfyui-lopi999-llm

By LaVie024View on GitHub →

LLM nodes for ComfyUI including a Canary-Qwen-2.5B audio transcription node. (Description by CC)

How much VRAM does comfyui-lopi999-llm require?

Direct Answer: The ComfyUI node comfyui-lopi999-llm requires a minimum base VRAM of 1536MB and is optimized for GPUs with at least 6GB of VRAM. Low VRAM mode is fully supported for resource-constrained setups.

High (2-4GB)
Base VRAM:
1536MB (1.5GB)
Recommended GPU:
6GB+ VRAM
Low VRAM Mode:
✓ Supported
Estimation Confidence:
MEDIUM

Interactive VRAM Compatibility Estimator

Estimated Total VRAM: 3.00 GBTarget: 8 GB
✅ Comfortable Fit

Your GPU has plenty of headroom. You can run this node safely with your active configurations!

Deploy on High-Performance GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance GPUs on Vast.ai instantly.

🚀 Deploy on Vast.ai

Deploy on Cloud GPUs

Need more VRAM to run ComfyUI with this node? Rent low-cost, high-performance cloud GPUs on RunPod instantly.

🚀 Deploy on RunPod

What Python packages are required for comfyui-lopi999-llm?

Direct Answer: Running comfyui-lopi999-llm requires installing the following Python package dependencies: llama-cpp-python, nemo_toolkit[asr,tts] @ git+https://github.com/NVIDIA/NeMo.git, sacrebleu. Ensure your ComfyUI environment has these packages active before launching.

requirements.txt
llama-cpp-python
nemo_toolkit[asr,tts] @ git+https://github.com/NVIDIA/NeMo.git
sacrebleu

Interactive Setup & Dependency Resolver

Operating System:
Environment Type:
Run this terminal command in your ComfyUI root folder:
# Loading command...

Related Custom Nodes

The following custom nodes run in the same PyTorch / CUDA environment and share similar categories or workflows:

APZmedia Qwen TTS Nodes
by APZmedia128MB VRAM
ComfyUI Comic Creator
by ketle-man256MB VRAM
ComfyUI Gemini Pro Node
by penposs4.0GB VRAM

Frequently Asked Questions

How much VRAM does comfyui-lopi999-llm require?

comfyui-lopi999-llm requires a minimum of 1536MB (1.5GB) of VRAM for base operation. For optimal performance, a GPU with at least 6GB of VRAM is recommended. This node supports low VRAM mode for resource-constrained setups.

Can I run comfyui-lopi999-llm on an RTX 3060, RTX 4070, or RTX 4090?

✅ RTX 3060 (12GB): Yes, fully compatible with 9.3GB headroom. ✅ RTX 4070 (12GB): Yes, fully compatible with 9.3GB headroom. ✅ RTX 4070 Ti (16GB): Yes, fully compatible with 12.9GB headroom. ✅ RTX 4090 (24GB): Yes, fully compatible with 20.1GB headroom

What Python packages are required for comfyui-lopi999-llm?

To run comfyui-lopi999-llm, you need to install: llama-cpp-python, nemo_toolkit[asr,tts] @ git+https://github.com/NVIDIA/NeMo.git, sacrebleu. You can install these using pip or add them to your requirements.txt file.

How can I reduce VRAM usage when running comfyui-lopi999-llm?

comfyui-lopi999-llm supports low VRAM mode. To reduce memory usage: (1) Enable --lowvram or --medvram flags in ComfyUI, (2) Reduce batch size to 1, (3) Use fp16 or fp8 precision if supported, (4) Close other GPU applications.

How do I install comfyui-lopi999-llm in ComfyUI?

To install comfyui-lopi999-llm: (1) Navigate to your ComfyUI/custom_nodes directory, (2) Clone the repository: git clone https://github.com/LaVie024/comfyui-lopi999-llm, (3) Install dependencies: pip install -r requirements.txt (if present), (4) Restart ComfyUI. Alternatively, use ComfyUI Manager for one-click installation.