Adobe Firefly Revolutionizes Video Creation with Voice-Generated Sound Effects and AI Model Integrations

On July 17, Adobe rolled out several significant updates for Firefly, which might revolutionize video creation methods. The most noteworthy development is the ability to generate custom sound effects simply by speaking into a microphone.

By saying phrases like «rumbling thunder» or «the sound of breaking glass,» Firefly can produce sound effects with accurate timing and intensity. Moreover, Adobe is integrating artificial intelligence models from its competitors, including Runway’s Gen-4 and Google’s Veo3, directly into the Firefly application.

The sound effects feature is truly groundbreaking. Users can record their own rendition of a sound effect, and Firefly will utilize their voice to determine the timing, volume, and intensity of the generated sound. This provides creators with far more options than merely typing «explosion sound» and hoping for the best.

Adobe’s strategy is well thought out: instead of trying to outdo every rival, they’re consolidating the best tools into one platform. Recently, they incorporated Runway Gen-4’s video generator and audio capabilities from Google’s Veo3 into Firefly Boards. They also mentioned that Firefly Boards will soon feature image and video enhancement tools from Topaz and Marey from Moonvalley. This means users can experiment with various AI models and tools without the hassle of switching between different applications and workflows.

Additionally, new video controls aimed at professional creators have been added. The Composition Reference feature allows users to upload a reference video and create new content that matches the original structure. With preset styles, users can instantly give videos the look of clay animation or anime. The Keyframe Cropping feature lets users upload the first and last frames to create videos that match their desired format precisely.

Adobe continues to prioritize commercial security, which is its biggest advantage. While competitors like OpenAI’s Sora face questions regarding training data, Adobe’s Firefly models are trained solely on content for which Adobe has obtained permission. This is crucial for companies concerned about copyright issues.

The company is also launching a Text to Avatar feature, which converts scripts into videos using avatars. Users can choose from a variety of avatars, customize backgrounds, and select accents, making it suitable for educational videos, social media content, or idea presentations.

For video creators, this update transforms Firefly into a versatile tool for AI-based video production. It offers commercially safe models from Adobe while providing access to cutting-edge solutions from competitors along with professional management.

The realm of AI-enhanced video is rapidly evolving, and Adobe is striving to keep pace by integrating both its own technologies and the best innovations from others.

Delegate some of your routine tasks with BotHub! No VPN is required to access the service, and you can use a Russian card. Follow this link to receive 100,000 free tokens for your initial tasks and start working with neural networks right now!

This is a translation; the source of the news can be found here.