Date of video: April 18, 2022
“In the sixth and final part of the Virtual Production Innovation series, Dimension Studios explains how 360 photospheres work, focusing on the benefits in enabling reality to be projected onto the background, without having to build it in a 3D engine; the drawbacks – it’s essentially a 2D image, so a perspective shift won’t be reflected in the background – and an interesting virtual production use case, creating city/mountain landscapes.
“Using photography means you are capturing images of the real-world with all the complexity and frame of real lighting. So you get reality without having to build everything from scratch inside the 3D engine”
The Virtual Production Innovation Series was led by Paul Franklin at DNEG. He said: “Photospheres and photographic panoramas are great because you get the detail and lighting taken directly from the real world but without the need for a complex – and computationally heavy – build. In a photosphere, you can capture a complex environment such as a cityscape in a quick and efficient manner without having to go to the trouble of building everything in the computer.
“They are relatively lightweight to manipulate, which is great too. The downside of the approach is that, in the final analysis, they’re just 2D images, albeit mapped onto the inside of a 3D sphere, so there’s no parallax to be had within the image. As a consequence, you have to be careful with how you move things around within the realtime engine – you can’t really do much more than pan and tilt around the central nodal point from which the image was originally shot. If you move off that nodal point you’ll quickly start seeing unwanted distortions and warping within the image.
“My feeling is that photospheres are best suited to occasions where you want to recreate the real world, which I guess seems obvious given that the photography has come from the real world. You also have the option of doing additional paintwork/compositing with the image before it’s used on set, but you’ll need to do extensive testing to ensure that it’s doing what you expected.” Click for more
Dimension Studios: https://www.dimensionstudio.co/