IP Library Granted Patent US 11,490,132
Granted Patent B2
US 11,490,132 · App. 17/337,313 · Granted Nov 1, 2022

Dynamic viewpoints of live event

Inventors: Fabián Bustamante (Evanston, IL); Stefan Birrer (Chicago, IL)
Assignee: Phenix Real Time Solutions, Inc.
H04N21/2187G06F3/012H04L67/131H04N21/21805H04N21/2396H04N21/242H04N21/6587H04N21/816
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,490,132
App. No.
17/337,313
Granted
Nov 1, 2022
Kind
B2
Abstract

A method includes communicatively coupling a first client device to a platform that distributes live streams over a network to client devices. The live streams provide a live broadcast of a live event from multiple viewpoints captured by source devices including a second client device. An indication is received of a selection of a first viewpoint from the first client device and, in response, a first live stream is provided to the first client device. The first client device is caused to display a second viewpoint with a different vantage point by rendering a second live stream of a second source device. The second live stream is delayed for rendering until a beginning of a next scene of the first live stream.

Claims (48)

1. A method comprising:

synchronizing at least some of a plurality of live streams relative to a point in time of a live broadcast of a live event;

defining a synchronized group of live streams to include any synchronized live streams and preclude any live streams that are not synchronized to the point in time;

limiting access by any of a plurality of client devices to the synchronized group of live streams;

removing a desynchronized live stream from the synchronized group of live streams upon determining the desynchronized live stream has a first round-trip time (RTT) that exceeds a threshold value;

communicatively coupling a first client device of the plurality of client devices to a platform that distributes the plurality of live streams over a network to the plurality of client devices, the plurality of live streams providing the live broadcast of the live event from a plurality of viewpoints captured by a plurality of source devices located at the live event including a second client device of the plurality of client devices,

wherein each viewpoint of the plurality of viewpoints includes a view of the live event captured from a vantage point of the live event;

receiving an indication of a selection of a first viewpoint of the plurality of viewpoints from the first client device;

communicating a first live stream of the plurality of live streams to the first client device, the first live stream being captured by a first source device of the plurality of source devices and, when rendering by the first client device, causes display of the first viewpoint on the first client device; and

causing the first client device to display a second viewpoint with a different vantage point of the live event from the first viewpoint of the plurality of viewpoints by rendering a second live stream of a second source device, the rendering of the second live stream being delayed until a beginning of a next scene of the first live stream.

2. The method of claim 1 further comprising:

selecting content based on a user preference or contextual information; and

causing the first client device to display the selected content.

3. The method of claim 2 , wherein the user preference is included in a user profile set by a user of the first client device.

4. The method of claim 2 , wherein the user preference is determined by analyzing, using a machine learning algorithm, interactions between the first client device and the platform or interactions between the first client device and the plurality of client devices.

5. The method of claim 2 , wherein the contextual information includes at least one of: a current time of day, a location of the first client device, demographic information of a user associated with the first client device, or information relating to the live event.

6. The method of claim 2 , wherein the selected content is augmented on the display of the second viewpoint.

7. The method of claim 2 , wherein the selected content is a third live stream of a third source device, the method further comprising:

causing the first client device to stop display of the second viewpoint and to display a third viewpoint by rendering the third live stream.

8. The method of claim 1 , wherein the threshold value is based at least on a second round-trip time of another live stream of the synchronized group.

9. The method of claim 1 , wherein the first client device is remotely located from the live event such that the first client device simulates a local experience of the live event.

10. The method of claim 1 , wherein the first client device and the first source device are handheld mobile devices.

11. The method of claim 1 , wherein the first client device is located at the live event and the first source device is the second client device, the method further comprising:

hosting a virtual interaction between the first client device and the second client device, the virtual interaction simulating a local interaction at the live event.

12. The method of claim 1 , wherein the first live stream and the second live stream are temporally offset from each other based on a first position of the first source device and a second position of the second source device.

13. The method of claim 1 , wherein the second client device is the second source device, the method further comprising:

implementing an access restriction indicated by the second client device to limit access to the second viewpoint of the second client device to only some of the plurality of client devices.

14. The method of claim 1 further comprising:

associating a privacy level with each live stream, the privacy level including a public level that grants unrestricted access by each client device and a private level that limits access to only some of the plurality of client devices.

15. At least one computer-readable storage medium, excluding transitory signals and carrying instructions, which, when executed by at least one data processor of a system, cause the system to:

synchronize at least some of a plurality of live streams relative to a point in time of a live broadcast of a live event;

define a synchronized group of live streams to include any synchronized live streams and preclude any live streams that are not synchronized to the point in time;

limit access by any of a plurality of client devices to the synchronized group of live streams;

remove a desynchronized live stream from the synchronized group of live streams upon determining the desynchronized live stream has a first round-trip time (RTT) that exceeds a threshold value;

communicatively couple a first client device of the plurality of client devices to a platform that distributes the plurality of live streams over a network to the plurality of client devices, the plurality of live streams providing a live broadcast of the live event from a plurality of viewpoints captured by a plurality of source devices located at the live event including a second client device of the plurality of client devices,

wherein each viewpoint of the plurality of viewpoints includes a view of the live event captured from a vantage point of the live event;

receive an indication of a selection of a first viewpoint of the plurality of viewpoints from the first client device;

communicate a first live stream of the plurality of live streams to the first client device, the first live stream being captured by a first source device of the plurality of source devices and, when rendering by the first client device, causes display of the first viewpoint on the first client device;

cause the first client device to display a second viewpoint with a different vantage point of the live event from the first viewpoint of the plurality of viewpoints by rendering a second live stream of a second source device, the rendering of the second live stream being delayed until a beginning of a next scene of the first live stream;

select content based on contextual information related to the live event;

transmit the selected content to the first client device; and

cause display of the selected content on the first client device, wherein the selected content is joined to the live stream of the live event.

16. The at least one computer-readable storage medium of claim 15 , wherein the selected content is augmented reality (AR) content.

17. The at least one computer-readable storage medium of claim 15 , wherein:

the content includes a time window for displaying the content,

the content begins display at a start time of a next scene of the live stream, and

the start time is within the time window.

18. The at least one computer-readable storage medium of claim 15 , wherein the content is selected further based on demographic information or profile information of a user associated with the first client device.

Assignments (6)
SECURITY INTEREST Recorded Apr 14, 2026
From: STATS LLC
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 075390/0491 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2025
From: PHENIX REAL TIME SOLUTIONS, INC.
To: KB PARTNERS, LLC
Reel/Frame 072432/0568 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 1, 2025
From: KB PARTNERS, LLC
To: STATS LLC
Reel/Frame 072432/0642 →
RELEASE OF SECURITY INTEREST Recorded Sep 8, 2025
From: KB PARTNERS, LLC
To: STATS, LLC
Reel/Frame 072184/0541 →
SECURITY INTEREST Recorded May 21, 2025
From: PHENIX REAL TIME SOLUTIONS, INC.
To: KB PARTNERS, LLC
Reel/Frame 071182/0630 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2021
From: BUSTAMANTE, FABIÁN E.; BIRRER, STEFAN
To: PHENIX REAL TIME SOLUTIONS, INC.
Reel/Frame 057576/0755 →
Continuity (3)
Continuation 16269478 · Feb 6, 2019
Provisional Application 62627126 · Feb 6, 2018
Related Publication 20210289236A1 · Sep 16, 2021
Cited By (4)
US 12,256,119 US 12,273,601 US 12,389,080 US 12,598,241