Adobe earlier released its generative AI tool FireflyMajor Updates, greatly expanding AI capabilities from original image generation to film generation, music generation, voice generation, and even the complete film editing process, covering almost every aspect of image post-production.
Although the full embrace of AI may cause concerns among some creators, Adobe still emphasizes that Firefly is "a tool to assist human creativity, not a replacement."
New Firefly video editor: web version, multi-track, AI generation integration
The biggest highlight of this update is Adobe's first launch of the "Firefly video editor", which has now entered the private beta stage.
• Web page format:This is a web-based multi-track timeline editor with an interface concept similar to Adobe Premiere Pro.
• Core functions:It allows users to create, organize, trim and arrange video clips, and provides tools such as adding voiceovers, soundtracks and titles.
• AI Integration:Users can not only import existing Firefly-generated content or self-shot footage, but also generate new AI video clips directly within the editor using prompts (supporting preset styles such as clay animation, anime, and 2D).
• Editing method:Supports frame-by-frame editing or editing via built-in transcript.
Generate soundtrack (open beta): AI automatically generates and synchronizes music
In addition to creating videos, Firefly can now also create music. The new "Generate Soundtrack" feature has entered public beta and is powered by the Firefly Audio model, an AI music generator:
• Operation method: Users can choose a preset music style or directly upload a video clip and let AI automatically analyze and generate a matching soundtrack.
• Smart Sync: The generated score is automatically and precisely synchronized and time-aligned with the film footage.
Generate narration: AI generates multi-language, emotionally adjustable narration
Similar to the soundtrack, Generate Speech applies AI to narration generation:
• Model selection:Adobe's own Firefly Speech model or the model of its partner ElevenLabs are available for selection.
• Features:It can generate "lifelike speech" in multiple languages and allows users to fine-tune emotion, pacing and emphasis to achieve natural and expressive results.
Creative Production (Private Beta): AI Batch Image Editing
Adobe has also integrated access to its "Firefly Creative Production" tool directly into the Firefly app, initially maintaining a private beta. This is a complete AI-driven batch image editing system:
• Features:It allows creators to batch process images through a prompt-driven, code-free interface, including automatic background replacement, application of unified color grading, cropping, and more.
Firefly Boards and Prompt to Edit: Enhance Ideation and Image Editing
• Firefly Boards: An AI-powered ideation surface helps users brainstorm new concepts. It includes a "Rotate Object" feature that converts 2D images into 3D, allowing for adjustments to the pose and perspective of objects or characters. It also allows users to export PDF files or download images in batches.
• Prompt to Edit (available now): A conversational image editing interface that allows users to describe the changes they want to make to an image in natural language (similar to the text-to-image concept of tools like Midjourney, but for editing). This feature is based on the latest Firefly Image Model 5 AI and integrates partner models from Black Forest Labs, Google, and OpenAI.
AI's full involvement in production processes has sparked concerns about "AI Slop" and cost considerations.
With Firefly's AI capabilities encompassing nearly every aspect of the process, from generation to editing, concerns are growing about whether this will lead to a flood of low-quality AI-generated content, often referred to as "AI slop," flooding platforms like YouTube. Adobe's answer is a resounding "maybe," but emphasizes that this comes at a cost.
Subscription plan
The prices for standalone Firefly subscription plans are:
• Basic plan:$10 per month (for 20 5-second videos)
• Pro Plan:$20 per month (for 40 5-second videos)
• Premium Plan:$199 per month (unlimited video creation)
However, as a promotion, Adobe announced that from now until December 1, all Firefly and Creative Cloud Pro subscribers will be able to use the image and video generation functions for free (with certain restrictions).
All of these new tools are now available via Firefly updates, with some in either public or private beta.
