Articles

What are the best software for real-time Virtual Production?

When going for real-time on set compositing and especially when aiming for final pixels there could be a good reason to buy into an already existing system. This list contains some of the best software(that I know of) that can incorporate Unreal Projects or have a tight integration.

Richard Frantzen

November 7, 2021

First and foremost the indie-version of doing real time compositing is internally in Unreal Engine with the help of composure.

But very soon you’re going to hit a wall and realize the reason why the software below is worth every penny of their pretty steep cost.

Real Time compositing is a pretty complex task and if you’re going to build everything yourself inside Unreal it’s going to be a headache – but totally doable.

ZeroDensity

The system that’s probably the most adapted in the world of broadcasting. Features as Hyper-realistic rendering and compositing in Unreal Engine, produce in one-system, real-time Native 4K/UHD/SDI production, lens calibration & talent
tracking

More info: https://www.zerodensity.tv/

Brainstorm Infinity Set

Infinity Set is a complete system that integrates natively in Unreal Engine. It has all the bells and whistles for example ray-tracing and internal keyer. But what I find most interesting with it is an tool called “3D Presenter” which converts the talent into a 3D object on the fly by generating a true 3d representation from a video feed. This in turn makes it easy to cast real shadows and reflections and also add or change lighting on the talent. Really cool stuff

More info: https://www.brainstorm3d.com/products/infinityset/

Aximmetry

Aximmetry is an all-in-one virtual studio and 3D graphics software for the broadcast and entertainment industry. They also have more subscription-solutions that better suite indie-producers. The software is very intuitive to use and is a node-based system that makes it easy to build your own setup. The keyer is great and has a lot of built in tools such as light wrapping and more. Of course a tight integration with Unreal Engine, even though their own 3D-Renderer is excellent.

More info: https://aximmetry.com/

Pixotope

Pixotope is probably the sleekest looking software of them all. And my impression of the software is that it could be the most userfriendly of them all. Built to enhance the fast turnarounds and changes on air.

More info: www.pixotope.com

These were some of the software that I know of. If you think I missed something shoot me an email and I’ll add them in.