← See All Custom Node Packs

BrushNet

944
By nullquant
Updated about 1 year ago
View on GitHub →See Common Issues →

Run ComfyUI Easily with InstaSD

Skip the complex setup. InstaSD helps creative professionals build workflows and deploy them to the world:

  • One-click deployment
  • Any model, any node
  • Powerful GPUs for rapid iteration
Get Started

These are custom nodes for ComfyUI native implementation of BrushNet, PowerPaint and RAUNet models

Available Nodes

Repository Overview

BrushNetLoader

ComfyUI-BrushNet: BrushNetLoader Node Documentation

Overview

The BrushNetLoader is a custom node in the ComfyUI-BrushNet project designed to facilitate the loading of BrushNet models into the ComfyUI environment. BrushNet is a versatile image inpainting model that can work with masks to modify or reconstruct parts of images. This can be especially useful for tasks such as removing unwanted objects, filling in missing parts of an image, or enhancing specific image attributes.

Functionality

What This Node Does

The BrushNetLoader node's primary function is to load and configure the BrushNet model for use within a ComfyUI workflow. This node sets up the necessary environment to integrate BrushNet with other image processing nodes and operations in ComfyUI.

Inputs

Parameters

  • dtype: This parameter determines the data type used for model computations. By default, it is set to torch.float16, which is suitable for most modern GPUs and provides a good balance between performance and precision. Users with older GPUs or those experiencing compatibility issues can switch to torch.float32 to ensure proper functionality.

Outputs

The BrushNetLoader node does not produce direct outputs like images or values. Instead, it prepares the BrushNet model, making it available for subsequent nodes in the workflow that perform inpainting or other image manipulations.

Usage in ComfyUI Workflows

The BrushNetLoader node is an integral part of workflows that utilize the BrushNet model for image inpainting tasks. When setting up a workflow:

  1. Integration: Start by placing the BrushNetLoader node at the beginning of your inpainting workflow. This ensures the BrushNet model is loaded and ready for use by the time it is needed.

  2. Compatibility: Ensure that any subsequent nodes that require the BrushNet model have access to the prepared model instance from the BrushNetLoader. This can include nodes for image inpainting, blending, or enhancement tasks.

  3. Configuration: Adjust the dtype parameter based on your hardware capabilities for optimal performance and compatibility.

Special Features and Considerations

  • GPU Compatibility: The node offers flexibility in data type selection, allowing users to adapt to different GPU specifications. This ensures broader compatibility across various system configurations.

  • Seamless Integration: As part of the ComfyUI-BrushNet project, the BrushNetLoader node integrates smoothly with other custom nodes like BrushNet, BlendInpaint, and PowerPaint, facilitating complex, tailored workflows for image manipulation.

  • Workflow Examples: The project's repository includes multiple workflow examples demonstrating the use of BrushNetLoader alongside other nodes for tasks such as outpainting, object removal, and scaling. These examples can serve as a guide to setting up effective workflows.

Incorporating the BrushNetLoader node into your ComfyUI workflows allows for powerful image inpainting capabilities leveraging the latest advancements in BrushNet-based image processing.