ComfyUI-InstantID

Overview

ComfyUI-InstantID is an unofficial implementation of InstantID tailored for use with ComfyUI. It focuses on enhancing visual workflows by integrating various nodes capable of handling ID-based processes and styles. This package is particularly useful for users looking to incorporate style and pose reference capabilities into their ComfyUI environments, supporting both local and huggingface hub models.

Installation

Recommended Method

It is recommended to install ComfyUI-InstantID using the ComfyUI Manager for a straightforward setup process. This feature is mentioned to be upcoming ("On the Way").

Manual Installation

1. Navigate to the custom_nodes directory in your ComfyUI installation:

   cd custom_nodes
   

2. Clone the repository:

   git clone https://github.com/ZHO-ZHO-ZHO/ComfyUI-InstantID.git
   

3. Navigate to the cloned directory:

   cd custom_nodes/ComfyUI-InstantID
   

4. Install the required dependencies:

   pip install -r requirements.txt
   

5. Restart ComfyUI to apply the changes.

Node Descriptions

This repository provides several custom nodes. Each node is implemented in InstantIDNode.py:

• InsightFaceLoader_Zho: Handles InsightFace model loading, compatible with both CUDA and CPU.
• IDControlNetLoader: Loads ID ControlNet models using a specified controlnet path.
• IDBaseModelLoader_fromhub: Downloads and loads base models from Huggingface Hub.
• IDBaseModelLoader_local: Loads local base models, requiring SDXL-compatible models.
• Ipadapter_instantidLoader: Loads Ipadapter_instantid models from a specified path.
• ID_Prompt_Styler: Handles integration with various prompts and styles, supporting up to eight different styles.
• IDGenerationNode: Facilitates InstantID generation with capabilities such as facial image reference, pose image integration, and enhanced face region options.

Features and Capabilities

• Base Model Loading: Supports both Hub-based and local model loading, giving users flexibility depending on their setup.
• InsightFace and ControlNet Integration: Facilitates the loading of InsightFace and ControlNet models with support for both CUDA and CPU.
• Styles Support: Compatible with a range of styles, including Watercolor, Film Noir, Neon, Jungle, Mars, Vibrant Color, Snow, and Line art.
• Pose Reference: Enables pose reference integration, allowing for more precise and style-specific ID generation.
• Enhanced GUI: Aids in the interactive generation and manipulation of IDs in ComfyUI workflows.

Use Cases in ComfyUI Workflows

ComfyUI-InstantID can significantly enhance your ComfyUI workflows by:

• Allowing for the quick and efficient management of model resources via Huggingface Hub integration.
• Supporting advanced styling options for visual customization of IDs with ease.
• Providing enhanced facial recognition and integration capabilities via InsightFace and ControlNet.
• Enabling more accurate pose-based ID generation which can be crucial for nuanced design tasks.

By incorporating these custom nodes into your workflow, you can achieve a more customized and comprehensive ID generation and styling process in ComfyUI.