ComfyUI-DynamiCrafterWrapper Documentation

Table of Contents

• Installation
• Repository Purpose
• Provided Nodes
• Special Features
• Usefulness in ComfyUI Workflows

Installation

To install the ComfyUI-DynamiCrafterWrapper, follow these steps:

1. Clone the repository:

   • Either use a manager to install from the git URL: https://github.com/kijai/ComfyUI-DynamiCrafterWrapper
   • Or clone the repository into your custom_nodes directory in ComfyUI.

2. Install Python dependencies:

   • Run the following command to install necessary Python packages:

     pip install -r requirements.txt
     

   • If using a portable version, execute the command from the ComfyUI_windows_portable folder:

     python_embeded\python.exe -m pip install -r ComfyUI\custom_nodes\ComfyUI-DynamiCrafterWrapper\requirements.txt
     

3. Install xformers (recommended for reduced memory usage):

   • For standard installation:

     pip install xformers --no-deps
     

   • For portable version:

     python_embeded\python.exe -m pip install xformers --no-deps
     

4. Model Checkpoints:

   • Convert models to bf16 and .safetensors format available at: Hugging Face
   • Move models to ComfyUI/models/checkpoints.

Repository Purpose

The ComfyUI-DynamiCrafterWrapper facilitates the integration of DynamiCrafter into ComfyUI. DynamiCrafter is designed to animate open-domain still images using text prompts by leveraging pre-trained video diffusion priors. The wrapper nodes simplify using DynamiCrafter functionalities within ComfyUI's workflow environment.

Provided Nodes

This repository includes a variety of nodes that extend ComfyUI with specialized functionalities:

• DynamiCrafterI2V
• DynamiCrafterModelLoader
• DynamiCrafterBatchInterpolation
• ToonCrafterInterpolation
• ToonCrafterDecode
• DownloadAndLoadDynamiCrafterModel
• DownloadAndLoadCLIPModel
• DownloadAndLoadCLIPVisionModel
• DynamiCrafterLoadInitNoise
• DownloadAndLoadDynamiCrafterCNModel
• DynamiCrafterControlnetApply
• DynamiCrafterCNLoader

Special Features

• Efficient VRAM Usage: Nodes such as ToonCrafter manage high-resolution tasks like 512x320 under limited VRAM conditions effectively, especially when used with xformers.
• Flexibility with Resolutions: Supports various resolutions and configurations to optimize rendering quality versus resource consumption.
• Model Conversion: Provides access to models converted to bf16 and .safetensors for efficient loading and setup.

Usefulness in ComfyUI Workflows

The ComfyUI-DynamiCrafterWrapper nodes are invaluable for users looking to:

• Animate open-domain images into engaging videos using structured workflows within ComfyUI.
• Leverage the strengths of DynamiCrafter's video diffusion priors to enrich creative visual projects.
• Efficiently manage VRAM in resource-constrained environments by using nodes like ToonCrafter and DynamiCrafter interpolation features.
• Experiment with advanced video creation capabilities such as generative frame interpolation and text-prompted video generation, tailored through streamlined ComfyUI interfaces.

Overall, this integration enhances ComfyUI with potent video creation tools, enabling more dynamic and adaptive media outcomes.