Adobe is unveiling a new set of Firefly features for film producers and content creators. The company’s AI tools are evolving rapidly. Among the most renowned toolkits is Adobe Firefly and its latest addition, the Generate Sound Effects tool. This AI feature can generate high-quality sound effects from voice recordings.
This new AI tool will help creators translate raw vocal cues, combined with text prompts, into adept immersive audio for their projects.
Generate Sound Effects, now in beta on the Firefly application, can be applied to recorded video as well as AI-generated video. One can sync sounds by mimicking effects. For example, users themselves can record rain falling on rooftops with some soft tapping sounds called “pit pat” and write down a description such as “raindrops on metal.”
Adobe AI then helps create four different sound effects that can match the footage. The Adobe tool offers more control and precision than competitors like Google’s Veo 3.
By focusing on Adobe's Project Super Sonic, the tool does not support speech generation but certainly creates many impacts and ambient effects, including:
Dry twigs snapping
Footsteps
Zippers
Nature ambiance
City soundscape
This Adobe Generative AI model recognizes vocalized cues and generates appropriate sound effects, helping creators to enhance scenes without searching for sounds or recording actual sounds.
With these new controls, Firefly AI creates even better text-to-video. Composition Reference lets humans guide AI through an uploaded video. Other new features:
Keyframe Cropping: Frame-based visual guidance
Style Presets: Includes anime, vector art, and claymation
Current functionality is within Adobe's own AI filmmaking tools, but in time, support for third-party models is expected to expand soon.
Adobe AI tools are transforming the traditional approach of filmmakers and designers in sound and video production. Firefly AI and Adobe Firefly's Generate Sound Effects Tool offer creators effective and simple systems for real-time editing. Adobe Generative AI is providing an interesting and impactful step in combining creativity and automation as it evolves.
Not only is Adobe Generative AI changing the content creation landscape, but it also continues to push forward AI creative capabilities.