Tech Papers 2021: This paper presents a cloud-based machine learning approach for automatic audio recognition and mixing in the 5G Edge-XR project, enabling real-time, personalized, immersive audio experiences for live events like boxing and in-stadium broadcasts.
Abstract
In this paper we focus on the machine learning approach we have developed for automatic audio source recognition and mixing for the UK DCMS funded collaborative project called 5G Edge-XR. Leveraging GPU acceleration, we deployed innovative algorithms in the cloud so that content can be automatically mixed on-the-fly for a personalised, immersive and interactive experience for audiences. In particular we will describe the algorithms involved, the system architecture and how it has been implemented for immersive live boxing and also how we are using it to enhance a live in-stadium experience.
Exclusive Content
This article is available with a Technical Paper Pass
Opportunities for emerging 5G and wifi 6E technology in modern wireless production
This paper examines the changing regulatory framework and the complex technical choices now available to broadcasters for modern wireless IP production.
Leveraging AI to reduce technical expertise in media production and optimise workflows
Tech Papers 2025: This paper presents a series of PoCs that leverage AI to streamline broadcasting gallery operations, facilitate remote collaboration and enhance media production workflows.
Automatic quality control of broadcast audio
Tech Papers 2025: This paper describes work undertaken as part of the AQUA project funded by InnovateUK to address shortfalls in automated audio QC processes with an automated software solution for both production and distribution of audio content on premises or in the cloud.
Demonstration of AI-based fancam production for the Kohaku Uta Gassen using 8K cameras and VVERTIGO post-production pipeline
Tech Papers 2025: This paper details a successful demonstration of an AI-based fancam production pipeline that uses 8K cameras and the VVERTIGO post-production system to automatically generate personalized video content for the Kohaku Uta Gassen.
EBU Neo - a sophisticated multilingual chatbot for a trusted news ecosystem exploration
Tech Papers 2025: The paper introduces NEO, a sophisticated multilingual chatbot designed to support a trusted news ecosystem.
