System and method for streaming video in real-time via virtual reality headset using a camera network
View Patent ↗The invention disclosed herein offers a system that allows users to virtually navigate between multiple, simultaneous live events occurring in disparate geographic locations. The system organizes a network of cameras into distinct groups, each tasked with capturing video streams of a specific event at a unique venue, such as a sports stadium. These video streams are captured from various angles, providing a multi-dimensional viewing experience. Users have the flexibility to manually or automatically switch between these events, thereby crafting a unique and personalized viewing experience.
1. A method of streaming video in real-time via virtual reality (VR) headset using a camera network, comprising:
receiving real-time audio and visual streams from a plurality of cameras positioned at distinct live events occurring simultaneously;
applying artificial intelligence (AI) and computer vision algorithms configured to differentiate and synchronize the received audio and visual data streams from the distinct live events;
employing a machine learning model to predict and pre-emptively select optimal viewing angles and corresponding audio streams based on a combination of event dynamics, user preference, and historical data trends, which are not predetermined or static recommendations; and
streaming the synchronized audio and visual data streams according to each user's preferences and, enabling each user to switch between cameras, viewing angles, and audio streams.
2. The method according to claim 1 , wherein the AI algorithms are configured to recognize and interpret significant visual cues from each distinct live event for real-time stream selection.
3. The method according to claim 1 , wherein applying the AI and computer vision algorithms are configured to analyze the streaming data to predict situations/actions of interest that are about to be developed/occurred during the live event.
4. The method according to claim 1 , wherein applying the AI and computer vision algorithms are configured to automatically change the viewing angle streamed to the VR headset according to the predicted situation, and determine from which camera said situation could be best viewed.
5. The method according to claim 1 , wherein the AI and computer vision algorithms are configured to learn individual user viewing preferences and accordingly suggest optimal viewing angle, or automatically switch to said suggested viewing angle.
6. The method according to claim 1 , further comprising enabling users to manually switch between cameras located at the same or different geographic locations, wherein each geographic location is associated with a different event.
7. The method according to claim 1 , further comprising analyzing audio streams to identify key auditory events indicative of high engagement moments within the live events, thereby facilitating optimized audio stream selection.
8. The method of claim 1 , wherein the AI algorithms are configured to analyze commentary and crowd noise to enhance the selection of audio streams correlating to user-preferred moments.
9. The method of claim 1 , further comprising providing a user interface within the VR environment enabling users to provide real-time feedback, which is utilized by the machine learning model to refine future predictions of optimal viewing angles and corresponding audio streams.
10. The method of claim 1 , wherein the synchronized audio and visual data streams are adapted to be streamed to a range of devices including VR headsets, mobile phones, PCs, tablets, and TVs.
11. A system for streaming video in real-time via virtual reality (VR) headset from one or more live events simultaneously, comprising:
a network of cameras positioned at distinct geographic locations capturing audio and visual data streams of respective live events;
a processing unit comprising artificial intelligence (AI) and computer vision algorithms configured to differentiate, analyze, and synchronize audio and visual data streams from the distinct live events;
a machine learning module configured to dynamically select and preemptively adjust optimal viewing angles and corresponding audio streams based on event dynamics, individual user preference, and historical viewer interactions; and
a streaming server configured to transmit the synchronized audio and visual data streams to the VR headset, enabling seamless user-directed or automated switching between cameras, viewing angles, and audio streams, delivering adaptive, real-time experience distinct from pre-scripted audio-visual content.
12. A system according to claim 11 , wherein at least some of the cameras are adapted to be carried by moveable objects, including selected persons and portable equipment, enhancing real-time immersive viewing experiences.
13. The system of claim 11 , further comprising a user interface module integrated within the VR environment for collecting user feedback, which the machine learning module utilizes said feedback to refine the predictions and selections of viewing angles and audio streams.