[BSC Expo 2023] Virtual production - Sony

Sony Unveils New Virtual Production Technology at BSC Expo 2023
At the BSC Expo 2023 in London, Sony showcased their new virtual production technology which aims to revolutionize the filmmaking industry. The technology involves a Sony Crystal LED that generates a game engine complete with tracking, allowing for virtual production that offers filmmakers the ability to be anywhere in the world while being in a studio just around the corner.
According to Will Newman, a Sony representative present at the event, this technology is crucial because it provides filmmakers with the ability to get parallax, a unique feature that enables the camera to move while the environment moves as well. This feature adds depth to the production, making it more realistic as opposed to a normal 2D plate that lacks depth change and camera movement.
Camera tracking with the camera and the position of the virtual camera is essential because it allows the Unreal Engine or any other game engine being used to interpret the back wall and LED volume based on what the camera is seeing. This technique is not new, as it dates back a century ago when 2D rear projection was used. However, the technology has advanced, and filmmakers can now do it in a better way, not just limited to 2D projection or illumination but also change the camera’s position in virtual space.
Sony’s new virtual production technology will undoubtedly change the filmmaking industry, providing filmmakers with more flexibility and opportunities to create more realistic productions.Generated by OpenAI

My name is Will Newman, I’m here on the Sony set of BSC 2023 in BSC London.
Right now, I’m sitting on the virtual production LED set that we have.

We have a Sony Crystal LED behind me here which we are generating a game engine complete with tracking to allow for virtual production which is the main thing people are talking about right now.

It’s really crucial because it allows you to be anywhere in the world but in reality, you could be in a studio just round the corner.

The camera in the virtual world will allow you to get Parallax so as the camera moves, so does the environment, which is unique as opposed to a normal 2D plate,

where you get no sense of actual camera movement, no depth change, things like that.

Having camera tracking with the camera and the position of the virtual camera is so important because that way the Unreal Engine or whatever game engine you’re using knows exactly where the camera is in Virtual space.  

When it knows that it knows exactly how to interpret the back wall, the LED volume, based on what the camera is actually seeing,

which is absolutely crucial and this technique essentially 100 years old when they were doing 2D rear projection.

but all they’ve done is the technology is advanced so now we can do it in a better way not just 2D projection or illumination,

but also we can change where the camera actually is in the virtual space.