AES Fall Convention 2023

During the past few years, Spatial Audio has become part of the listening experience for millions of people, but only a few of these experiences allow you to fully appreciate all the advantages of Spatial Audio due to the lack of head tracking. Some of the challenges around achieving full head-tracked audio include the need for a sensor that accurately tracks your head pose, and the technology's sensitivity to latency. Given the necessity for a non-invasive and low-cost method to integrate head tracking data into binaural renderers, cameras appear to be the ideal sensor as they already exist in most of the devices we use to consume multichannel audio experiences. In this presentation, we will discuss the challenges and advantages of using camera-based head-tracked audio for multichannel experiences.