ComfyUI-AnimateDiff-Evolved

Overview

The ComfyUI-AnimateDiff-Evolved repository provides an enhanced integration of AnimateDiff, aimed at improving animation creation within the ComfyUI framework. It not only offers advanced sampling options known as Evolved Sampling but also extends capabilities to other areas of animation and image generation. This repository is highly beneficial for users looking to generate animations with complex motion and sampling techniques.

Installation

Using ComfyUI Manager

1. Search for AnimateDiff Evolved within the ComfyUI Manager.
2. Ensure that the author is Kosinkadink before installing.

Manual Installation

1. Clone the repository into the custom_nodes folder in your ComfyUI directory:

   git clone https://github.com/Kosinkadink/ComfyUI-AnimateDiff-Evolved.git ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved
   

Model Setup

1. Download Motion Modules:

   • Obtain motion modules necessary for generating different animation results from platforms like HuggingFace, Google Drive, or CivitAI.

2. Place Modules:

   • Store the models in either:
     • ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved/models
     • ComfyUI/models/animatediff_models

3. Optional - Motion LoRAs:

   • Motion LoRAs can be downloaded from Google Drive or HuggingFace and placed in:
     • ComfyUI/custom_nodes/ComfyUI-AnimateDiff-Evolved/motion_lora
     • ComfyUI/models/animatediff_motion_lora

4. Custom Paths:

   • Modify the extra_model_paths.yaml file in ComfyUI to set custom paths for models and motion loras.

Features

• Evolved Sampling: Integrates advanced sampling options usable outside AnimateDiff.
• Compatibility: Works with vanilla/custom KSampler nodes, ControlNet, SparseCtrl, and IPAdapter.
• Infinite Animation Support: Using sliding context windows and View Options.
• Motion LoRA Support: Influence movement with Mixable Motion LoRAs.
• Scheduling Options: Prompts and other attributes can be scheduled over time.
• Advanced Interface [Nodes]: Over 100 custom nodes for various purposes, including settings, context options, and special effects.

Nodes Provided

This repository provides a plethora of nodes, some of which are:

• ADE_AnimateDiffLoRALoader
• ADE_AnimateDiffSamplingSettings
• ADE_AnimateDiffKeyframe
• ADE_MultivalDynamic
• ADE_MultivalScaledMask

...and many more, detailed for specific applications and features. Each node is carefully crafted to handle specific tasks within the animation generation workflow.

Special Features and Capabilities

1. HotshotXL Support: Includes support for SDXL motion modules, allowing for comprehensive control over animation designs.
2. FP8 Support: Reduces VRAM usage while maintaining animation quality.
3. Mac M1/M2/M3 Support: Engineered to work seamlessly on Mac systems.
4. Image Injection & Context Techniques: Facilitates mid-sampling image injection and promotes cross-context consistency.
5. Integration with External Tools: Supports models like AnimateDiff-SDXL, CameraCtrl, AnimateLCM, providing a wide range of animation capabilities.

Applications in ComfyUI Workflows

The nodes and features of ComfyUI-AnimateDiff-Evolved can drastically enhance ComfyUI workflows. Users can create longer, more dynamic animations with precise control over every aspect of motion and sampling. Integration with various ControlNet and Adaptive modules allows for complex scene building and fine-tuned animation outputs, making it an indispensable tool for advanced ComfyUI users seeking robust animation solutions.