ComfyUI AnimatedDiff

This repository integrates AnimatedDiff with ComfyUI, providing custom nodes to enhance the animation generation capabilities of ComfyUI. It's adapted from the sd-webui-animatediff repository and allows users to utilize motion modules within the ComfyUI environment.

Installation

To start using this repository, follow these steps:

1. Clone the repository into the custom_nodes folder of your ComfyUI setup.
2. Download the necessary motion modules and save them in the comfyui-animatediff/models/ directory. You can get these modules from several sources:
   • Google Drive
   • HuggingFace
   • CivitAI
   • Baidu NetDisk
3. For additional features like Motion LoRAs, download the required files from the HuggingFace motion LoRAs page and place them in the comfyui-animatediff/loras/ folder.

Purpose

This repository provides custom nodes that expand ComfyUI's capabilities for generating and working with animations. By integrating AnimateDiff's features, users can create more complex and refined animations using ComfyUI.

Node Descriptions

This repository houses several crucial nodes tailored for animation tasks:

• AnimateDiffModuleLoader: Loads the motion modules for use within workflows.
• AnimateDiffLoraLoader: Loads Motion LoRAs to enhance animation results.
• AnimateDiffCombine: Combines GIF frames to generate animation. Offers multiple formats and custom frame rate options.
• AnimateDiffSampler: Samples frames for animation. Includes options for frame count and latent image input.
• AnimateDiffSlidingWindowOptions: Provides options for the sliding window technique to generate longer GIFs without length limits.
• LoadVideo: Loads GIFs or video files as image sequences, useful for integrating external animations into ControlNet workflows.
• ImageSizeAndBatchSize: Handles sizing and batching of images for processing.

Special Features and Capabilities

Motion LoRA Support

Users can now utilize Motion LoRAs to enhance animations further. This feature is particularly beneficial when using AnimateDiff v2.

Sliding Window Technique

The sliding window functionality allows for generating GIFs beyond the usual frame length limit by processing frames in overlapping batches. It's activated automatically for animations exceeding 16 frames, and users can customize settings with the AnimateDiffSlidingWindowOptions node.

Flexible Output Formats

With the AnimateDiffCombine node, users can export animations in various formats, including GIF, WEBP, and several video formats. This versatility caters to multiple use cases and preferences.

Integration with ControlNet

The repository supports advanced workflows, such as using GIFs as ControlNet inputs or animating starting and ending images via ControlNet, providing enhanced control over the animation generation process.

Utility in ComfyUI Workflows

ComfyUI AnimatedDiff greatly expands the animation capabilities within the ComfyUI platform. By providing powerful nodes for motion handling, frame sampling, and format conversion, users can integrate sophisticated animation workflows with ease. This makes it an invaluable tool for creators looking to maximize their animation generation potential through ComfyUI.