Tech Papers 2021: This paper presents a cloud-based machine learning approach for automatic audio recognition and mixing in the 5G Edge-XR project, enabling real-time, personalized, immersive audio experiences for live events like boxing and in-stadium broadcasts.
Abstract
In this paper we focus on the machine learning approach we have developed for automatic audio source recognition and mixing for the UK DCMS funded collaborative project called 5G Edge-XR. Leveraging GPU acceleration, we deployed innovative algorithms in the cloud so that content can be automatically mixed on-the-fly for a personalised, immersive and interactive experience for audiences. In particular we will describe the algorithms involved, the system architecture and how it has been implemented for immersive live boxing and also how we are using it to enhance a live in-stadium experience.
Exclusive Content
This article is available with a Technical Paper Pass
.jpg)
Dynamic power control for sustainable broadcast transmitter networks
Tech Papers 2026: This paper proposes an approach that uses predictive modelling in combination with real-time interference monitoring to optimise transmitter powers dynamically, with minimal impact on the consumer.
.jpg)
AI-driven anonymisation that preserves human performance
Tech Papers 2026: This paper presents two AI-driven workflows designed to preserve emotional nuance while ensuring anonymity.
.jpg)
Search first, inspect visually when needed: A multi-agent architecture for semantic video archival retrieval
Tech Papers 2026: This paper introduces Smart Chat, a multi-agent video question-answering system that searches indexed video moments, localizes candidate evidence, and inspects a short clip only when visual verification is needed.
.jpg)
A standardised framework for C2PA provenance in media workflows
Tech Papers 2026: This paper presents the first standardised framework for implementing C2PA for media provenance across newsrooms of varying sizes and operational contexts.
Dynamic streaming content packaging with C2PA
Tech Papers 2026: This paper presents an implementation of the approach adopted by C2PA for live video to dynamic packaging.
Registered users only: Login