SMPTE ST 2110 Virtual Production Cookbook

Live media production continues to embrace software-defined SMPTE ST 2110-based workflows built upon Commercial-Off-The-Shelf (COTS) based hardware systems that combine the Input/Output capabilities of Network Interface Controllers (NICs) with the media processing power of one or more Graphics Processing Units (GPUs). One such application is in-camera visual effects (ICVFX) in virtual production, the technique of capturing GPU-rendered visual effects composited with live action in-camera within an LED volume as shown in Figure 1. This paper outlines the hardware and software required to build a virtual production stage today and how these technologies work together to make virtual production possible.