Adobe has announced plans to expand Adobe Firefly, its family of creative generative AI models, to its creative cloud video and audio applications, empowering creators to produce and dramatically enhance video and audio content while streamlining workflows.
Adobe also unveiled new AI innovations in the lightroom ecosystem – lightroom, lightroom classic, lightroom mobile and web – that make it easy to edit photos professionally. New Adobe sensei AI-powered features empower intuitive editing and seamless workflows.
Expanded adaptive presets and masking categories for select people make it easy to adjust fine details from the colour of the sky to the texture of a person’s beard with a single click. Additionally, new features including denoise and curves in masking help creatives do more with less to save time.
Firefly’s addition to creative cloud video and audio applications will unlock a wide range of new capabilities, giving creators the power to automatically generate hundreds of content variations needed for film and TV marketing.
Key concepts for Firefly in creative cloud video and audio applications include:
Text to colour enhancements
Creators will be able to change the colour schemes, time of day, or even the season in already-recorded videos, altering the mood and setting to evoke a specific tone and feel. Text-to-video prompts will enable a simple prompt such as “make this scene feel warm and exciting” to bring a creator’s visions to life.
Advanced music and sound effects
Using only text prompts, users will be able to generate custom sounds and music to fit a specific mood and scene, either as temporary or final tracks. This also includes language generation to localise videos.
Animated fonts, graphics and logos
In a matter of minutes, subtitles, logos and title cards can be generated with custom animations based on the creator’s preferences, expressed with simple words.
Powerful script and B-roll capabilities
Firefly will dramatically accelerate pre-production, production and post-production workflows, using AI analysis of script text to automatically create storyboards and previsualizations, as well as recommending b-roll clips for rough or final cuts.
Creative guide capabilities
Assisted by generative AI-powered personalised “how-to” guides, users will be able to master new skills and accelerate processes from initial vision to creation and editing.