ComfyUI_InstantID

# ComfyUI InstantID Custom Nodes

## Overview

The ComfyUI InstantID repository provides a set of custom nodes that enable native support for the InstantID system within the ComfyUI platform. This extension offers a unique integration as it doesn't rely on diffusers but directly implements InstantID functionalities. It is designed to work seamlessly within ComfyUI to offer advanced identification and styling capabilities, especially useful for projects involving image generation and manipulation.

## Installation

To install the ComfyUI InstantID custom nodes, follow these steps:

1. Ensure ComfyUI is updated to the latest version.

2. Clone the ComfyUI InstantID repository into the `ComfyUI/custom_nodes/` directory or use the Node Manager in ComfyUI:

   ```sh
   git clone https://github.com/cubiq/ComfyUI_InstantID.git

3. Install the necessary libraries:

   • insightface
   • onnxruntime
   • onnxruntime-gpu

4. Download the required InsightFace models and place them in the specified directory:

   • Model: antelopev2
   • Directory: ComfyUI/models/insightface/models/antelopev2

5. Download and place the main InstantID model:

   • Model: Available here
   • Directory: ComfyUI/models/instantid

6. Ensure the ControlNet model is in place:

   • Model: Available here
   • Place it in the ComfyUI controlnet directory

Note: This setup is only compatible with SDXL.

Node Overview

The following nodes are implemented in this repository, providing varied functionality for InstantID integration:

• InstantIDModelLoader: Loads the InstantID model.
• InstantIDFaceAnalysis: Performs face analysis using InstantID.
• ApplyInstantID: Applies InstantID to the input.
• ApplyInstantIDAdvanced: An advanced version that supports additional functionalities like noise injection.
• FaceKeypointsPreprocessor: Preprocesses face keypoints for inputs.
• InstantIDAttentionPatch: Handles attention mechanisms related to InstantID.
• ApplyInstantIDControlNet: Applies the InstantID model together with ControlNet.

Special Features

• Native Integration: Unlike many other solutions, this implementation integrates InstantID natively, avoiding reliance on external diffusers.

• Noise Injection: The application of noise in the negative embeds helps reduce the "burn" effect and enhances the likeness to the reference image. This feature can be fine-tuned using the ApplyInstantIDAdvanced node.

• Styling and Multi-ID Support: Offers capabilities for styling via IPAdapter and supports Multi-ID workflows, albeit with some complexity.

Benefits in ComfyUI Workflows

• Enhanced Image Processing: By integrating InstantID natively, workflows can achieve more accurate and faster image manipulation and generation, focusing on identity preservation.

• Customization and Flexibility: Advanced node options such as noise injection and separate weight settings for controlnets enable greater control over outputs.

• Community and Support: The repository is supported by a community of sponsors, making it a sustainable option with ongoing enhancements and updates.

Using the ComfyUI InstantID nodes can significantly enhance your ComfyUI projects, especially those requiring advanced identity manipulation and high-quality image generation.