ComfyUI AnimateDiff Custom Nodes

Repository URL: ComfyUI-AniamteDiff

Table of Contents

• Introduction
• Installation Guide
• Repository Purpose
• Available Nodes
• Special Features and Capabilities
• Utility in ComfyUI Workflows

Introduction

This repository provides custom nodes for integrating the AnimateDiff framework into ComfyUI, a user-friendly platform for animation workflows. It leverages concepts from the original AnimateDiff repository and its adaptation in sd-webui-animatediff.

Installation Guide

To install and use the ComfyUI AnimateDiff nodes, follow these steps:

1. Clone the repository into your custom_nodes folder in the ComfyUI directory.

   git clone https://github.com/SipherAGI/comfyui-animatediff.git custom_nodes/comfyui-animatediff
   

2. Download the motion modules required for operation. These modules can be found on multiple platforms:

   • Google Drive
   • HuggingFace
   • CivitAI
   • Baidu NetDisk

   Place the downloaded motion modules in comfyui-animatediff/models/.

3. For additional functionality like Motion LoRA, download specific modules from HuggingFace and save them in comfyui-animatediff/loras/.

Repository Purpose

The repository serves to equip users of ComfyUI with advanced animation capabilities by integrating the AnimateDiff framework, allowing users to create sophisticated animations, gifs, and videos by leveraging a combination of available modules.

Available Nodes

This repository includes a range of custom nodes, each with a specific function in the animation workflow:

• AnimateDiffModuleLoader
• AnimateDiffLoraLoader
• AnimateDiffCombine
• AnimateDiffSampler
• AnimateDiffSlidingWindowOptions
• LoadVideo
• ImageSizeAndBatchSize

Special Features and Capabilities

• Motion LoRA Support: Enhances movement in animations via LoRA models, provided they are used with the AnimateDiff v2 module.
• Sliding Window Functionality: Allows the generation of GIFs without size constraints by processing frames in small, overlapping batches.
• Video Output Formats: Support for GIF, WEBP, WEBM, and MP4 using FFmpeg, providing multiple options for animation compression and storage.
• Long Duration Animations: Create longer animations by utilizing automatic features for handling large frame numbers.

Utility in ComfyUI Workflows

The nodes provided in this repository are instrumental in creating advanced animation workflows within ComfyUI. Users can easily:

• Generate simple text-to-GIF animations with AnimateDiffSampler.
• Combine frames into various formats using AnimateDiffCombine.
• Apply complex ControlNet operations using GIFs as input or managing animations that start and end with specific frames.
• Leverage the SlidingWindowOptions for handling long-duration animations efficiently.

With these robust features, this repository extends ComfyUI's abilities, making it suitable for both simple animations and complex, high-quality video productions.