How to use the Higgsfield DaVinci Resolve plugin for AI-powered video editing
AI video tools are moving fast, and one of the most impressive new options for editors is the Higgsfield plugin for DaVinci Resolve. Instead of jumping between websites, downloading clips, and re-importing them, this plugin brings powerful AI video editing directly into your Resolve workflow.
What the Higgsfield DaVinci Resolve plugin does
The Higgsfield plugin integrates directly into DaVinci Resolve and lets you send clips to Higgsfield’s AI models, then bring the results straight back into your timeline. You can:
• Add objects like cars or props into a scene
• Insert crowds or extra people into the background
• Change a character’s outfit using simple drawing and prompts
• Replace entire environments (for example, turning a beach into Tokyo)
• Generate multiple camera angles from a single shot
• Generate new AI videos and images from scratch
• Apply tools like LUTs, reframing, background removal, and upscaling
All of this happens without leaving Resolve, which makes it a powerful companion to the new AI features already built into the latest version of the editor. If you’re exploring Resolve’s native AI tools as well, it pairs nicely with the upgrades covered in what’s new in DaVinci Resolve 21.
How to install and open the plugin in DaVinci Resolve
Getting started is straightforward:
1. Go to the Higgsfield website and open the Plugins section.
2. Download the DaVinci Resolve version of the plugin and install it on your computer.
3. Open DaVinci Resolve (the example uses Resolve Studio 21.1).
4. In the top menu, go to Workspace > Workflow Integration > Higgsfield.
This opens a dedicated Higgsfield window inside Resolve where you can access all the AI tools and manage your generations.
Working with clips directly in the timeline
One of the biggest advantages of this plugin is that you don’t need to download media from the web and then import it manually. Instead, you can:
• Import your footage into Resolve as usual
• Drop it onto the timeline
• Select the clip and send it to Higgsfield’s tools from the plugin window
Once the AI finishes processing, the new versions of your clip appear right inside the plugin panel, ready to be imported back into your project with a click.
Using AI to add objects to your scene
The plugin’s Edit Video feature lets you modify a clip using text prompts. For example, if you have a shot of a person walking toward the camera and want to make the scene more cinematic, you can:
1. Select the clip in the timeline and open the Higgsfield panel.
2. Choose Edit Video.
3. Pause the clip at the moment you want to reference.
4. Pick a model variant such as Seedance 2.0 (other options include Fast and Kling).
5. Type a short prompt like: “Add a sleek luxury sports car parked in the background.”
6. Confirm the generation and let the tool process.
The result is a new version of your clip with a realistic sports car added to the scene, matching the lighting and perspective of the original shot.
Adding crowds and extra people with AI
The same Edit Video workflow can be used to populate your scene with more people. For example, you can:
1. Open the clip in the Higgsfield panel again.
2. Choose Edit Video and pause on the desired frame.
3. Enter a prompt like: “Add a small crowd in the background.”
4. Generate a new version.
The AI will insert additional people into the shot, creating a busier, more dynamic environment without the need for extra extras on set.
Changing outfits with draw-to-video
For more targeted changes, the plugin includes a Draw to Video tool. This lets you roughly paint over parts of your frame and tell the AI what you want that area to become. For example, to change a character’s clothing:
1. Open the clip in the Higgsfield panel and select Draw to Video.
2. Zoom in on the subject so you can see the outfit clearly.
3. Use the brush to paint over just the clothing area.
4. Add a prompt such as: “Change her outfit to a military uniform.”
5. Generate the new clip.
The AI replaces only the painted area, keeping the person’s face and body consistent while updating the outfit. In testing, the plugin produced detailed uniforms with realistic folds and creases, while maintaining the subject’s likeness surprisingly well—even in wider shots, which are usually difficult for AI.
Swapping entire locations with a prompt
If you want a more dramatic transformation, you can use Edit Video to change the entire environment. For example, you can turn a beach scene into a city shot:
1. Open the clip and choose Edit Video.
2. Pause on a representative frame.
3. Enter a prompt like: “Change the location from the beach to Tokyo, Japan.”
4. Generate the new version.
The AI rebuilds the background to match the new location while keeping the subject and motion intact. The result is a completely different setting without reshooting or complex compositing.
Creating multi-angle shots from a single camera angle
One of the most impressive features shown off with this plugin is the ability to generate multiple camera angles from a single original shot. This is done with prompts that tell the AI to create alternative views of the same action.
In practice, prompt wording matters. For example:
• A prompt like “Create a multi-shot from two different camera angles” may not always work as expected.
• A simpler prompt such as “Create multiple angle shots” can produce better results.
When it works, the AI can generate:
• A lower angle focusing on the subject’s feet
• A side-tracking shot following the same motion
• Other variations that feel like they were captured with additional cameras
This is especially useful for solo shooters or small teams who want more coverage from limited setups, and it pairs well with modern AI-assisted workflows in Resolve described in guides to DaVinci Resolve 21’s AI tools.
Generating images and videos inside the plugin
Beyond editing existing footage, the Higgsfield panel also includes full AI generation tools:
• Image generation: Access models like GPT-2-based systems, Higgsfield’s own models, and other “big hitters” for creating still images directly inside Resolve.
• Video generation: Use options like Grok Imagine (including a 1.5 preview model) to create AI videos from prompts without leaving the editor.
These features make the plugin a kind of mini AI studio inside Resolve, where you can generate assets, then immediately cut and grade them in the same project.
Importing AI results back into your project
Once your generations are finished, they appear in the Higgsfield panel as thumbnails. From there you can:
• Preview each result in a larger view
• Import the selected clip directly into your Resolve media pool or timeline
• Mix and match different versions (for example, one with a car, one with a crowd, one with a new location)
One current limitation is that the UI only shows a few clips at a time, even in full-screen mode, which can make it harder to manage many generations. Expanding this view would make browsing results smoother, but it doesn’t stop the core workflow from being usable.
Why this plugin is a big deal for editors
The Higgsfield DaVinci Resolve plugin is notable because it brings advanced AI capabilities right into a professional NLE, instead of forcing editors to juggle separate tools and manual imports. With it, you can:
• Quickly experiment with creative ideas—new outfits, props, or locations—without reshoots
• Enhance simple or “boring” shots by adding depth and detail
• Generate extra coverage and alternative angles from a single take
• Combine AI-generated assets with traditional editing, grading, and sound design in one place
For creators who already use DaVinci Resolve, this plugin offers a powerful way to test what AI video editing can do in real workflows, not just in isolated demos. As the models improve, tools like this are likely to become a standard part of modern post-production.
Comments
No comments yet. Be the first to share your thoughts!