Granted Patent B2

US 12,327,408 · App. 17/651,955 · Granted Jun 10, 2025

Inventors: Christian Marko (Graz, AT); Zsolt Biro (Graz, AT); Karl Ferk (Graz, AT)

Assignee: STATS LLC

G06V20/42G06V20/44G06V20/70

Abstract

Claims (62)

1. A method for delivering interactive video to a user, comprising:

identifying, by a computing system, video contents corresponding to a sporting event, wherein the video contents comprise a plurality of video frames;

annotating, by the computing system, each video frame of the plurality of video frames to uniquely identify a corresponding video frame and contents included within the corresponding video frame;

receiving, by the computing system from a plurality of prediction models, a plurality of data inputs corresponding to one or more agents and one or more actions captured in each video frame of the plurality of video frames, wherein the plurality of data inputs includes a win probability at a moment in time represented by a respective video frame and at least one of: one or more sporting event statistics, team or squad data, sporting event data, a player location within at least one of the plurality of video frames, a player location on a two-dimensional playing surface within at least one of the plurality of video frames, player identification information, one or more sporting events linked to at least one of the plurality of video frames, player seasonal statistics, player career statistics, one or more sporting event facts and/or a live win probability;

generating, by the computing system, a plurality of data frames based on the plurality of data inputs, wherein each data frame is uniquely associated with a respective video frame;

mapping, by the computing system, each data frame with a respective video frame using the annotations;

causing, by the computing system, a user device to present an interactive video to the user by instructing the user device to merge the plurality of data frames with the plurality of video frames;

receiving, by the computing system, a request from the user device for overlay information corresponding to selecting at least one of one or more actors;

generating, by the computing system, overlay information that includes actor data corresponding to the selected at least one of the one or more actors; and

outputting, by the computing system, the overlay information to the user device with the interactive video.

2. The method of claim 1 , wherein the plurality of video frames corresponds to live broadcast video data.

3. The method of claim 1 , wherein annotating, by the computing system, each video frame of the plurality of video frames to uniquely identify the video frame and the contents included within the corresponding video frame comprises:

tagging, by the computing system, each video frame with a unique identifier.

4. The method of claim 1 , wherein generating, by the computing system, the plurality of data frames based on the plurality of data inputs comprises:

identifying, by the computing system, a game context captured in a respective video frame; and

associating, by the computing system, predictive analytics generated by the plurality of prediction models with a respective data frame based on the game context.

5. The method of claim 1 , wherein generating, by the computing system, the plurality of data frames based on the plurality of data inputs comprises:

identifying, by the computing system, each agent in each data frame.

6. The method of claim 1 , wherein causing, by the computing system, the user device to present the interactive video to the user comprises:

sending, by the computing system, the plurality of data frames and the plurality of video frames to the user device, wherein the user device merges the plurality of data frames with the plurality of video frames.

7. The method of claim 1 , further comprising:

generating, by the computing system, an interactive viewer comprising content retrieved from an in-venue data capture or a broadcast data capture; and

presenting, by the computing system, the interactive viewer to an end user, wherein the end user can modify content within the interactive viewer.

8. The method of claim 7 , wherein modifying the content within the interactive viewer comprises modifying one or more of: a camera angle, artificial intelligence generated metrics overlaying the content, speed of the content, target player within the content, and/or navigation to a portion of the content.

9. A system, comprising:

a processor; and

a memory having programming instructions stored thereon, which, when executed by the processor, causes the system to perform one or more operations, comprising:

identifying video contents corresponding to a sporting event, wherein the video contents comprise a plurality of video frames;

annotating each video frame of the plurality of video frames to uniquely identify a corresponding video frame and contents included within the corresponding video frame;

receiving, from a plurality of prediction models, a plurality of data inputs corresponding to one or more agents and one or more actions captured in each video frame of the plurality of video frames, wherein the plurality of data inputs includes a win probability at a moment in time represented by a respective video frame and at least one of: one or more sporting event statistics, team or squad data, sporting event data, a player location within at least one of the plurality of video frames, a player location on a two-dimensional playing surface within at least one of the plurality of video frames, player identification information, one or more sporting events linked to at least one of the plurality of video frames, player seasonal statistics, player career statistics, one or more sporting event facts and/or a live win probability;

generating a plurality of data frames based on the plurality of data inputs, wherein each data frame is uniquely associated with a respective video frame;

mapping each data frame with a respective video frame using the annotations;

causing a user device to present an interactive video to the user by instructing the user device to merge the plurality of data frames with the plurality of video frames;

receiving a request from the user device for overlay information corresponding to selecting at least one of one or more actors;

generating overlay information that includes actor data corresponding to the selected at least one of the one or more actors; and

outputting the overlay information to the user device with the interactive video.

10. The system of claim 9 , wherein the plurality of video frames corresponds to live broadcast video data.

11. The system of claim 9 , wherein annotating each video frame of the plurality of video frames to uniquely identify the video frame and the contents included within the corresponding video frame comprises:

tagging each video frame with a unique identifier.

12. The system of claim 9 , wherein generating the plurality of data frames based on the plurality of data inputs comprises:

identifying game context captured in a respective video frame; and

associating predictive analytics generated by the plurality of prediction models with a respective data frame based on the game context.

13. The system of claim 9 , wherein generating the plurality of data frames based on the plurality of data inputs comprises:

identifying each agent in each data frame.

14. The system of claim 9 , wherein causing the user device to present the interactive video to the user comprises:

sending the plurality of data frames and the plurality of video frames to the user device, wherein the user device merges the plurality of data frames with the plurality of video frames.

15. A non-transitory computer readable medium comprising one or more sequences of instructions, which, when executed by one or more processors, causes a computing system to perform operations, comprising:

identifying, by a computing system, video contents corresponding to a sporting event, wherein the video contents comprise a plurality of video frames;

annotating, by the computing system, each video frame of the plurality of video frames to uniquely identify a corresponding video frame and contents included within the corresponding video frame;

receiving, by the computing system from a plurality of prediction models, a plurality of data inputs corresponding to one or more agents and one or more actions captured in each video frame of the plurality of video frames, wherein the plurality of data inputs includes a win probability at a moment in time represented by a respective video frame and at least one of: one or more sporting event statistics, team or squad data, sporting event data, a player location within at least one of the plurality of video frames, a player location on a two-dimensional playing surface within at least one of the plurality of video frames, player identification information, one or more sporting events linked to at least one of the plurality of video frames, player seasonal statistics, player career statistics, one or more sporting event facts and/or a live win probability;

generating, by the computing system, a plurality of data frames based on the plurality of data inputs, wherein each data frame is uniquely associated with a respective video frame;

mapping, by the computing system, each data frame with a respective video frame using the annotations;

causing, by the computing system, a user device to present an interactive video to the user by instructing the user device to merge the plurality of data frames with the plurality of video frames;

receiving, by the computing system, a request from the user device for overlay information corresponding to selecting at least one of one or more actors;

generating, by the computing system, overlay information that includes actor data corresponding to the selected at least one of the one or more actors; and

outputting, by the computing system, the overlay information to the user device with the interactive video.

16. The non-transitory computer readable medium of claim 15 , wherein the plurality of video frames corresponds to live broadcast video data.

17. The non-transitory computer readable medium of claim 15 , wherein annotating, by the computing system, each video frame of the plurality of video frames to uniquely identify the video frame and contents included within the corresponding video frame comprises:

tagging, by the computing system, each video frame with a unique identifier.

18. The non-transitory computer readable medium of claim 15 , wherein generating, by the computing system, the plurality of data frames based on the plurality of data inputs comprises:

identifying, by the computing system, a game context captured in a respective video frame; and

associating, by the computing system, predictive analytics generated by the plurality of prediction models with a respective data frame based on the game context.

Assignments (2)

Continuity (3)

References Cited (11)