EXP Engine

When managing events with multiple simultaneous audio, video, and data feeds, the NativeWaves EXP engine takes care of timekeeping and content orchestration. This functionality is seamlessly integrated within the client application, allowing us to handle differently delayed streams and maintain robust performance.

In traditional streaming setups, handling a single video stream and multiple audio streams is straightforward for media players. However, as we increase the number of feeds, the complexity grows, necessitating an automated system. Our system efficiently manages this complexity by creating a virtual timeline for each event. This timeline includes tagged moments and sections, enabling instant replay and providing the ability to view content from various perspectives.

This becomes particularly significant when combining video feeds with different data feeds, as it allows us to precisely synchronize information across multiple video feeds or support advanced audio use cases. We structure audio into two distinct use cases: global audio and local audio. Global audio caters to scenarios such as commentary feeds in different languages, which remain the same across all video feeds. On the other hand, when a viewer desires alternate audio tracks for specific video streams, such as hearing team radios or motor sounds while watching a driver from linked front, rear, or 360° cameras, NativeWaves EXP can effortlessly handle these preferences.

The system is robust enough to handle scenarios where content feeds are temporarily unavailable, either planned or due to a distribution problem, and full content redundancy is also supported where the system can automatically fall back to a separate redundant content track.

The timeline management also facilitates synchronization of content across multiple devices, enabling connected live experiences similar to "watch together" scenarios, as well as synced second screen experiences by using our patented audio sync technology. By utilizing a global clock, we can ensure synchronized playout time across all devices, even in the presence of distribution latencies.

The EXP engine also allows for multiple interfaces to plugin custom logic, for example: