AnyNode for ComfyUI

Overview

AnyNode is a flexible and powerful extension for ComfyUI that leverages Large Language Models (LLMs) to process inputs and generate various types of outputs. It includes a series of customizable nodes that enable users to perform complex tasks through simple setups. Whether you're utilizing OpenAI, Google Gemini, or local LLM solutions, AnyNode facilitates a wide range of capabilities within ComfyUI workflows.

Installation

To install AnyNode, follow these steps:

1. Clone the repository into your comfy/custom_nodes directory in ComfyUI, or search for AnyNode in the ComfyUI Manager.

2. Select your desired LLM service and follow the specific instructions:

   • OpenAI: Ensure the openai Python module is installed by running pip install openai. Add your OPENAI_API_KEY as an environment variable.

   • Gemini: Obtain a GOOGLE_API_KEY and add it as an environment variable. No additional Python modules are required.

   • Local LLMs: Ensure your local LLM server (such as Ollama) is running. AnyNode's local LLM nodes are compatible with various OpenAI-like services.

3. Restart ComfyUI.

4. Within ComfyUI, double-click to open the node search and find AnyNode in Nodes > utils.

Repository Purpose

This repository is intended to augment ComfyUI with advanced node functionalities that are powered by LLMs. The nodes provide the ability to automate and enhance workflows by generating code dynamically based on the user's input and configuration.

Node Offerings

The repository provides a comprehensive set of nodes, each catering to different LLM environments and needs:

• AnyNode: Standard node for using OpenAI's latest models.
• AnyNodeGemini: Uses Google Gemini for tasks, currently in testing.
• AnyNodeLocal: For utilizing local LLM servers or hosted services.
• AnyNodeAnthropic: Facilitates interactions with Anthropic's capabilities.
• AnyNodeCodeViewer: Allows users to view the generated code.
• AnyNodeExport: For exporting node configurations and code.

Special Features and Capabilities

• Code Generation and Execution: AnyNode can generate Python functions based on user requests, dynamically creating nodes that perform specific tasks.

• Security Features: Includes a code sanitizer that scrutinizes LLM-generated code to prevent the execution of unsafe operations. Restricted from performing internet access or file manipulations for enhanced security.

• Flexible Integration: Supports a variety of LLM services, including OpenAI, Gemini, and compliant local servers like Ollama, enabling diverse use cases and setups.

• Dynamic Capabilities: Users can request complex operations or transformations, such as image filters or text processing, by instructing AnyNode with natural language prompts.

• Error Handling and Correction: If errors occur in code generation, users can easily modify prompts to refine outcomes or attempt corrections by re-queuing prompts.

• Sandboxed Imports: Only specific Python libraries are allowable in generated code, ensuring that function execution remains within defined constraints.

Usefulness in ComfyUI Workflows

AnyNode significantly enhances ComfyUI workflows by enabling:

• Custom Node Creation: Easily generate powerful, task-specific nodes tailored to unique requirements.

• Creative Flexibility: Users can direct nodes to perform a vast array of complex transformations and processes through simple, intuitive prompts.

• Enhanced Productivity: Automate repetitive or intricate tasks to streamline workflow processes, leveraging the latest advancements in AI and LLM technology.

• Innovative Experimentation: Encourages the exploration of new functionalities and creative possibilities within ComfyUI through versatile LLM-powered nodes.

With these capabilities, AnyNode empowers users to leverage AI-driven solutions to expand the potential of their digital environments in ComfyUI.