Adobe to Launch Generative AI Video and Integrate Third-party AI Models

Adobe has previewed a series of exciting new generative AI features that will be launched later this year in Adobe Premiere Pro. These features are powered by Adobe's Firefly AI model and integrate third-party models, promising to completely transform the workflow of video creation and production.

Adobe has been actively developing text-based video AI models, which is well-known. The company even invited creators to submit video clips for model training. Now, Adobe has shared a preview of these features in the upcoming version of Premiere Pro video editing application.

In addition to its own AI models, Adobe is also exploring how to directly integrate third-party generative AI models such as Sora, Runway, and Pika into Premiere Pro. The generative AI workflow previewed in Premiere Pro includes the following features:

• Generative extension: Seamlessly add frames to extend clips, making it easier for editors to make adjustments and add smooth transitions. This technology solves common problems faced by professional editors, allowing them to create additional media assets for fine-tuning edits, lingering shots, or better transitions.

• Object addition and removal: Simply select and track objects to replace them. Whether it's removing unnecessary items, changing actors' costumes, or quickly adding props like paintings on a table or realistic flowers, it's effortless.

• Text-to-video: Generate brand new video assets directly in Premiere Pro. Simply enter text or upload reference images in the prompt box to generate clips for storyboarding or enhancing live-action footage.

Ashley Still, Senior Vice President of Adobe's Creative Cloud Products, said, "Adobe is reshaping every aspect of the video creation and production workflow, providing creators with new power and flexibility to realize their creative vision. By deeply integrating generative AI innovations into the core workflow of Premiere Pro, we address the practical problems that video editors face daily while providing them with greater creative space."

The company also emphasizes that any assets generated within the application will be accompanied by content credentials to provide transparency about the AI models used for content creation and manipulation.

In addition to generative AI video tools, Adobe has also announced the general availability of AI-driven audio workflows in Premiere Pro. These features include interactive fade handles, AI-based audio categorization tags, effect badges, and a redesigned waveform, which will be available to customers in May.