ImageTransformByNormalizedAmplitude Node Documentation

Overview

The ImageTransformByNormalizedAmplitude node is a feature within the ComfyUI-KJNodes repository that integrates with AudioScheduler nodes for image manipulation based on sound input. This node modifies images according to the normalized amplitude values of audio, allowing users to create dynamic visual effects that correlate with audio properties. It has particular use for users who work with audio-visual synchronization, such as in multimedia projects and installations.

Functionality

What This Node Does

The ImageTransformByNormalizedAmplitude node transforms images by zooming and shifting them based on the amplitudes derived from audio input. It processes each frame of an image batch by applying transformations that correspond proportionally to the audio's normalized amplitude.

Inputs

• normalized_amp: This input represents the normalized amplitude of audio. It is an array of values ranging between 0 and 1, denoting the intensity of audio signals.
• zoom_scale: A floating-point value that specifies the scale by which the image will be zoomed in or out. The amplitude from the audio modifies how much zoom is applied.
• x_offset: An integer indicating the x-axis pixel offset applied to the image from its original position.
• y_offset: An integer indicating the y-axis pixel offset applied to the image from its original position.
• cumulative: A boolean option that, when enabled, allows for the cumulative addition of amplitude values for progressive zoom scaling.
• image: The base image or batch of images to be transformed. The node accepts image tensors in the format expected by ComfyUI.

Outputs

• Transformed Image: The node outputs images that have been zoomed and offset according to the normalized amplitude data. This output maintains the original format but includes the visual transformations influenced by the input audio.

Use in Workflows

The ImageTransformByNormalizedAmplitude node is highly versatile and can be integrated into a variety of ComfyUI workflows focused on audio-visual interactions. Here's how it might be used:

1. Dynamic Visual Effects: Users can employ this node to generate dynamic and engaging visual effects that respond to audio input, especially useful in multimedia installations or live performances.
2. Video Production: It can be used in video editing pipelines where visual transformations need to be driven by an audio track, adding an interactive layer to visual storytelling.
3. Artistic Installations: Artists can leverage the audio-reactive nature of this node to create immersive environments where visuals change based on sound, perfect for installations or concerts.

Special Features or Considerations

• Integration with AudioScheduler: Designed to work in conjunction with the AudioScheduler nodes found at https://github.com/a1lazydog/ComfyUI-AudioScheduler, which allows for seamless transition of audio signals into visual data transformations.
• Cumulative Transformation: The ability to apply cumulative transformations offers users a way to simulate progressive or evolving changes in response to audio over time.
• Performance Considerations: Users should be aware that intensive computation might be involved when processing large batches of images or applying high-frequency transformations, and this could impact performance.

By understanding and leveraging the capabilities of the ImageTransformByNormalizedAmplitude node, users can enhance their ComfyUI projects with sophisticated audio-visual transformations that respond fluidly to sound.