Aug. 10, 2023
Virtual production is the use and incorporation of visual effects (VFX) and technology throughout the production life cycle. This process isn’t exactly new; however, there are trends accelerating Hollywood’s increased interest and adoption of the process. By: Toh Yan Yun
Virtual production has emerged as a revolutionary technique in the creation of films, harnessing the combination of both virtual and physical worlds to produce immersive cinematic experiences. This cutting-edge filmmaking method falls under the wide umbrella of Extended Reality (XR), which consists of Virtual Reality (VR), Augmented Reality (AR), and Mixed Reality (MR). Virtual production specifically utilises real-time computer graphics to create live-action scenes on a virtual set.
The process of shooting movie action before a green screen or high-resolution LED screens is crucial to virtual production. The green-screen images are then processed by virtual production and visual artists using computer software to transform them into lifelike locations and sets with stunning visual effects (VFX). The equipment key to the success of this procedure includes LED display walls to allow the display of real-time rendered virtual sets, unreal engines for photorealistic rendering and ray-tracing in real time, and motion-tracking cameras. These cameras are critical for enabling proper parallax on the scene, reading in which physical point the camera is located on and translating this information into a 3D camera that feeds into Unreal.
Virtual production is gaining momentum
With its numerous benefits, the new technology is becoming a hot favourite among producers and studios. According to forecasts by Grandview research, virtual production is projected to grow at a compounded rate of 18% per year until 2030. The use of this technology not only reduces costs but also saves time in the filmmaking process. A movie that previously requires a budget of $100 million can now be scaled down using virtual tools to just $25 million. Furthermore, TV spots created with virtual production cost an estimated 30% to 40% less than traditional methods. Additionally, Williams and VFX producer David Conley, also shares that virtual production reduces air travel for shoots and enables directors to make subtle changes late into a film’s production, like the colour of a character’s hair in an animated feature.
Unlocking creative vision
One of the most iconic examples of virtual production’s success is James Cameron’s 2009 Avatar. Despite the film’s staggering budget of $237 million, its use of real-time performance capturing, facial rigging, 3D animation, and compositing resulted in a massive worldwide box office revenue of $2.74 billion, making it the highest-grossing film of all time (before being surpassed by 2019 Avengers: Endgame). Its newly released sequel Avatar: The Way of Water has once again collaborated with visual effects company Wētā FX in New Zealand to revolutionise underwater cinematography.
Australia has become a significant player in virtual production with the recent unveiling of a 40-foot high, 6000-screen facility. Gary Marshall, vice-president of virtual production for NantStudios, which has built and will manage the facility at Docklands Studios Melbourne, has shared that, “It’s twice as big. It’s the world’s largest stage for virtual production that exists.” The facility utilises an LED volume, a vast array of interconnected LED screens driven by gaming software, allowing seamless integration of pre-shot footage and digital assets in the background while actors perform in the foreground. Housing a large water tank for seascape shots, this facility aims to attract big-budget Hollywood productions, including the anticipated $188 million series Metropolis by Sam Esmail.
“It’s the next generation of screen production,” remarks Matt Vitins, chief operating officer of Matchbox Pictures, who was a driving force in bringing the facility to Australia. “Not many other places can do it.” Indeed, as XR technology and production techniques continue to evolve, virtual production is expected to play a pivotal role in shaping the next stage of the filmmaking process, offering filmmakers new possibilities and audiences unforgettable cinematic experiences.
To never miss a story — sign up for Viral Weekly free newsletter to stay up-to-date with compelling TV and Film news and views.