How AI Is Transforming How Movies Are Made

Artificial intelligence isn’t just changing how we edit videos or generate images anymore. It’s starting to reshape how entire movies and TV shows are made—from the way scenes are shot to how visual effects are created and how fast productions can move from idea to final cut.

One of the most ambitious examples of this shift is a new approach called “real-time hybrid filmmaking,” which blends performance capture, virtual production, and generative AI into a single, tightly integrated workflow. The goal: make big, cinematic stories faster, cheaper, and more flexible than traditional Hollywood methods.

What Is Real-Time Hybrid Filmmaking?

Real-time hybrid filmmaking combines three major pieces of technology into one continuous process:

1. Performance capture. This is the technique used in films like Avatar, where actors’ movements and expressions are captured and then mapped onto digital characters. Instead of waiting months for post-production, performance capture data can now be fed directly into AI-enhanced pipelines.

2. Virtual production. Popularized by shows like The Mandalorian, virtual production uses massive LED walls to display digital environments in real time. Actors perform on a soundstage in front of these walls, but on camera it looks like they’re standing in a desert, a palace, or a fantasy forest.

3. Generative AI. AI tools are used at every stage: designing worlds, testing different visual styles, mapping captured performances onto digital assets, and accelerating visual effects. Instead of just “prompting” a model and hoping for the best, filmmakers are fusing AI into a structured production pipeline.

When these three elements work together, a director can capture an actor’s performance in the morning, visualize them as a fairy in a fantasy world by lunchtime, and start editing those scenes the same day. What once took weeks or months can now happen in hours.

Inside the New AI-Powered Virtual Soundstage

A new production company, Innovative Dreams, is building this workflow into a full-scale operation on a virtual soundstage in Manhattan Beach, California. Backed by Amazon Web Services (AWS) and AI company Luma, the studio is designed from the ground up to support AI-heavy, virtual-first productions.

Their process looks something like this:

Step 1: Capture performances. Actors perform on a soundstage equipped with cameras, LED walls, and performance capture systems. Their movements, facial expressions, and dialogue are recorded just like a traditional shoot—but with more data and more flexibility.

Step 2: Design worlds in real time. Using Luma’s AI tools—specifically its Luma Agents feature—filmmakers can load style guides, scripts, and character breakdowns into a collaborative workspace. From there, they can quickly explore what characters and locations should look like, swapping styles and environments on the fly.

Step 3: Map actors into digital environments. The captured performances are then mapped onto digital assets and AI-generated worlds. Instead of building every environment by hand, AI assists with generating, refining, and integrating backgrounds and visual effects.

Step 4: Edit the same day. Because so much of the visual work is happening in real time, editors and directors can start cutting scenes almost immediately. In some cases, a team can create a world, film in it, and assemble a rough cut in a single day.

This is a major shift from the traditional model where location scouting, travel, set building, and months of post-production all add time and cost to every project. For readers interested in hands-on workflows, this approach shares some principles with modern AI-first pipelines for creators, like those covered in step-by-step guides to making cinematic AI videos.

The Tools Powering This New Workflow

Behind the scenes, several key technologies make this hybrid model possible.

Cloud and AI Infrastructure from AWS

AI video generation and real-time virtual production require enormous computing power. That’s where Amazon Web Services comes in. As both investor and infrastructure partner, AWS provides the cloud, storage, and AI services that power the virtual production tools on set.

AWS acts as the backbone for:

• Running generative AI models at scale
• Storing and streaming massive volumes of video and 3D data
• Coordinating real-time collaboration between departments
• Accelerating rendering and visual effects

The idea is to let filmmakers work in ways that would have been technically or financially impossible just a few years ago—producing content faster, cheaper, and with more creative iteration.

Generative AI from Luma and Others

Luma, valued at over $4 billion, is the other major partner. Its Luma Agents tool brings multiple AI generation capabilities into a single collaborative environment. Filmmakers can feed in scripts, character notes, and style references, then use AI to help visualize scenes and worlds.

Innovative Dreams also taps into other AI tools, including Google’s Nano Banana and Bytedance’s Seedream, to generate and enhance environments and visual effects. By working directly with these AI companies as an investor-backed partner, Innovative Dreams can help shape the tools to better fit real production needs.

For creators experimenting at a smaller scale, this trend mirrors how individual artists are using AI image and video tools together—for example, turning still AI images into cinematic sequences, as explored in guides like turning GPT Image generations into cinematic videos.

Real Projects: From House of David to Moses

This isn’t just a tech demo. Innovative Dreams grew out of Wonder Project, a production studio focused on faith-based content with its own streaming platform on Amazon Prime Video. Their flagship series, House of David, became a testbed for this new way of working.

Across multiple projects, they evolved their use of AI and virtual production:

• Season 1 of House of David: AI was used mainly for pre-visualization—planning shots, testing looks, and exploring scenes before filming.
• Season 2: The team pushed deeper into virtual production and reworked their entire visual effects pipeline to lean more on AI and real-time tools.
• Feature film Washington: They moved into what they call “digital principal photography,” using live visual effects on set instead of waiting for post-production.

The first full project using the new hybrid workflow end-to-end is The Old Stories: Moses, a three-part series starring Ben Kingsley. It was shot entirely on a virtual stage and is set to debut in partnership with Amazon.

Instead of traveling to more than 40 physical locations, the production used an LED wall backdrop, motion capture, and AI tools like Luma, Nano Banana, and Seedream to create a wide range of environments on a single stage.

The impact on time and cost was dramatic:

• The entire series was shot in about a week.
• Traditional location-based shooting would likely have taken 5–6 weeks, not counting travel time.
• According to the team, this workflow can be 3–4 times faster at roughly 30% of the traditional cost.

Lowering costs to that level makes it easier for studios and streamers to greenlight ambitious projects that might otherwise be considered too risky or expensive.

Can AI Help Bring Production Back to Los Angeles?

All of this is happening against a tough backdrop for Hollywood. Since 2022, Los Angeles County has lost more than 40,000 industry jobs. Production activity has dropped to its lowest level since 1995, driven by:

• Post-pandemic slowdowns
• Consolidation and cost-cutting at major studios
• Reduced content spending from streamers
• Long actors’ and writers’ strikes in 2023
• Productions fleeing to other regions with aggressive tax incentives

Innovative Dreams is betting that AI-powered virtual production can make shooting in Los Angeles financially viable again. If you can create large-scale, visually rich stories on a single soundstage at a fraction of the cost, you don’t need to chase subsidies in Atlanta, Eastern Europe, or the U.K. to make the numbers work.

However, not everyone is convinced. AI can cut costs whether a production is based in L.A. or elsewhere. Even if AI makes filmmaking cheaper overall, that doesn’t automatically mean jobs or projects will return to Hollywood.

The Big Question: What Happens to Jobs?

AI is highly controversial in Hollywood, and for good reason. As studios look to cut costs, writers, actors, and crew are worried about how much of their work could be automated or replaced.

Some of the key concerns include:

• Background actors and voice actors fear their likenesses or voices could be scanned once and reused by AI indefinitely.
• Entry-level roles—the traditional “apprentice” jobs where people learn the craft—are often the first to be automated away.
• Creative control could shift if studios lean too heavily on AI-generated content instead of human-driven storytelling.

These issues were central to the recent writers’ and actors’ strikes, and they continue to shape ongoing union negotiations. Both sides are trying to strike a balance: using AI as a tool to improve efficiency without erasing the human heart of filmmaking.

On the other side, proponents of AI-driven workflows argue that these tools can actually create more jobs in aggregate by making more projects financially feasible. Wonder Project, for example, says it employed over 1,000 crew members worldwide in a single year, including 600 people on House of David, in part because AI-enabled efficiencies made those productions possible.

The logic is simple: if you can make more shows and films for the same budget, you can hire more people overall—even if specific roles change or shrink.

Why Traditional Filmmakers Still Matter in an AI World

One of the most interesting trends emerging from this shift is who becomes most valuable in an AI-enhanced pipeline. According to Innovative Dreams, the best AI artists are often people who already understand filmmaking deeply—editors, cinematographers, assistant directors, directors, and costume designers.

These professionals:

• Understand the language and grammar of film
• Know what makes a shot, scene, or performance work emotionally
• Can translate creative intent into prompts, parameters, and visual direction for AI tools

In other words, AI doesn’t replace their taste or experience—it amplifies it. Those willing to adapt, learn new tools, and rethink their workflows are likely to stay in high demand.

The hybrid model also changes how departments collaborate. Instead of working in isolated phases separated by weeks or months—pre-production, principal photography, post-production—many of these steps now happen in the same space, on the same day. That can make the process feel more intuitive and creatively fluid, but it also demands new skills and tighter coordination.

The Future of AI-Driven Filmmaking

AI is not a passing trend in entertainment—it’s becoming part of the foundation of how stories are made. Real-time hybrid filmmaking is still new, but it points toward a future where:

• Directors and producers can iterate visually in real time instead of waiting for post-production.
• Large-scale, epic stories can be produced on tighter budgets.
• Cloud and AI infrastructure become as essential as cameras and lights.
• Traditional film skills—storytelling, cinematography, editing—remain crucial, but are expressed through new tools.

Whether this shift ultimately brings more work back to Los Angeles or simply changes where and how productions operate globally, one thing is clear: filmmakers who learn to work alongside AI, rather than ignore it, will be better positioned for whatever comes next.