LoadVideo Node Documentation

Overview

The LoadVideo node in the ComfyUI-animatediff repository is designed to facilitate the process of loading GIFs or videos and converting them into individual frame images. This node is particularly useful when you want to use a video or GIF as an input for other nodes within a workflow, such as ControlNet.

Node Functionality

The primary function of the LoadVideo node is to import video or GIF files and break them down into their constituent frames. These frames can then be processed or utilized in various ways within the ComfyUI environment.

Inputs

The LoadVideo node accepts the following inputs:

1. Video: This is the file path to the video or GIF you wish to load. The node currently supports multiple video file formats, including .gif, .webp, .mp4, .mov, .avi, and .webm. The selection of the file occurs within the ComfyUI interface, where the files can be uploaded.

2. Frame Start (Optional): This integer value indicates the starting frame number from which the extraction should begin. The default is set to 0, meaning it starts from the very first frame.

3. Frame Limit (Optional): This integer value specifies the number of frames to extract from the video, starting from the indicated frame. The default limit is set to 16.

Outputs

The LoadVideo node produces the following outputs:

1. Frames: A sequence of images extracted from the video starting from the specified frame. Each image corresponds to a frame in the video, converted into a tensor format that can be processed further in workflows.

2. Frame Count: This integer output indicates the number of frames successfully extracted from the video or GIF file.

Usage in ComfyUI Workflows

In ComfyUI workflows, the LoadVideo node plays a crucial role in scenarios that require video data to be processed frame by frame. Here are some potential use cases:

• ControlNet Input: Use the frames extracted by the LoadVideo node as an input to ControlNet nodes for tasks involving motion analysis or animation synthesis.

• Animation Evaluation: Analyze or modify animated sequences by applying various processing nodes to the frames output.

• Generative Processing: Use frame sequences to experiment with generative models or techniques, possibly leveraging nodes like AnimateDiffSampler for enhanced sampling strategies.

Special Features and Considerations

• Supported File Formats: The node supports multiple popular video formats and GIFs, making it versatile for different types of visual content.

• Frame Extraction Control: With the ability to specify a start frame and limit the number of frames extracted, users have fine-grained control over how much of the video content they want to process.

• Utility for Other Nodes: By converting video sequences into a format usable by other nodes, LoadVideo acts as a bridge between raw video data and the varied functionalities offered by the ComfyUI framework.

By understanding the detailed functionality, inputs, outputs, and useful contexts for the LoadVideo node, users can effectively incorporate it into their workflows to enhance the capability of their ComfyUI-driven animations and video processes.