IP Library Granted Patent US 11,902,603
Granted Patent B2
US 11,902,603 · App. 17/821,002 · Granted Feb 13, 2024

Methods and systems for utilizing live embedded tracking data within a live sports video stream

Inventors: Sateesh Pedagadi (London, GB); Johannes Kuehnel (Graz, AT); Bradford Griffiths (London, GB); Christian Marko (Graz, AT); Raphael Reiners (Munich, DE); Brian Orefice (Chicago, IL); Patrick Joseph Lucey (Chicago, IL)
Assignee: STATS LLC
H04N21/23614H04N21/2187H04N21/23418H04N21/4312
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,902,603
App. No.
17/821,002
Granted
Feb 13, 2024
Kind
B2
Abstract

A computing system receives a video stream of a game. The computing system generates tracking data corresponding to the video stream using one or more artificial intelligence models. The computing system generates interactive video data by combining the video stream of the game with the tracking data. The computing system causes a media player to render graphics corresponding to the tracking data over the video stream by sending the interactive video data to a client device executing the media player.

Claims (45)

1. A method comprising:

receiving, by a computing system, a video stream of a game;

generating, by the computing system, tracking data corresponding to the video stream using one or more artificial intelligence models;

generating, by the computing system, interactive video data by multiplexing the video stream of the game with the tracking data to generate a multiplexed data stream, wherein the multiplexing includes mapping the tracking data with the video stream on a packet-by-packet basis; and

causing, by the computing system, a media player to render graphics corresponding to the tracking data over the video stream by sending the interactive video data including the multiplexed data stream to a client device executing the media player.

2. The method of claim 1 , wherein multiplexing the video stream with the tracking data to generate the multiplexed data stream comprises:

adding the mapping of the tracking data with the video stream to the video stream as a subtitle track within the video stream.

3. The method of claim 1 , wherein generating, by the computing system, the tracking data corresponding to the video stream using the one or more artificial intelligence models comprises:

generating a JavaScript Object Notation (JSON) file comprising the tracking data.

4. The method of claim 3 , causing, by the computing system, the media player to render the graphics corresponding to the tracking data over the video stream comprises:

causing the client device to unpack the JSON file to identify metadata events in the tracking data.

5. The method of claim 1 , wherein generating, by the computing system, the tracking data corresponding to the video stream using the one or more artificial intelligence models comprises:

generating player and ball positional data corresponding to locational coordinates of each player and the ball.

6. The method of claim 1 , wherein generating, by the computing system, the tracking data corresponding to the video stream using the one or more artificial intelligence models comprises:

generating event data based on the tracking data, wherein the event data captures events that occur within the game.

7. A non-transitory computer readable medium comprising one or more sequences of instructions, that, when executed by one or more processors, causes a computing system to perform operations comprising:

receiving, by the computing system, a video stream of a game;

generating, by the computing system, tracking data corresponding to the video stream using one or more artificial intelligence models;

generating, by the computing system, interactive video data by combining multiplexing the video stream of the game with the tracking data to generate a multiplexed data stream, wherein the multiplexing includes mapping the tracking data with the video stream on a packet-by-packet basis; and

causing, by the computing system, a media player to render graphics corresponding to the tracking data over the video stream by sending the interactive video data including the multiplexed data stream to a client device executing the media player.

8. The non-transitory computer readable medium of claim 7 , wherein multiplexing the video stream with the tracking data to generate the multiplexed data stream comprises:

adding the mapping of the tracking data with the video stream to the video stream as a subtitle track within the video stream.

9. The non-transitory computer readable medium of claim 7 , wherein generating, by the computing system, the tracking data corresponding to the video stream using the one or more artificial intelligence models comprises:

generating a JavaScript Object Notation (JSON) file comprising the tracking data.

10. The non-transitory computer readable medium of claim 9 , causing, by the computing system, the media player to render the graphics corresponding to the tracking data over the video stream comprises:

causing the client device to unpack the JSON file to identify metadata events in the tracking data.

11. The non-transitory computer readable medium of claim 7 , wherein generating, by the computing system, the tracking data corresponding to the video stream using the one or more artificial intelligence models comprises:

generating player and ball positional data corresponding to locational coordinates of each player and the ball.

12. The non-transitory computer readable medium of claim 7 , wherein generating, by the computing system, the tracking data corresponding to the video stream using the one or more artificial intelligence models comprises:

generating event data based on the tracking data, wherein the event data captures events that occur within the game.

13. A system comprising:

a processor; and

a memory having programming instructions stored thereon, which, when executed by the processor, causes a computing system to perform operations comprising:

receiving a video stream of a game;

generating tracking data corresponding to the video stream using one or more artificial intelligence models;

generating interactive video data by multiplexing the video stream of the game with the tracking data to generate a multiplexed data stream, wherein the multiplexing includes mapping the tracking data with the video stream on a packet-by-packet basis; and

causing a media player to render graphics corresponding to the tracking data over the video stream by sending the interactive video data including the multiplexed data stream to a client device executing the media player.

14. The system of claim 13 , wherein multiplexing the video stream with the tracking data to generate the multiplexed data stream comprises: adding the mapping of the tracking data with the video stream to the video stream as a subtitle track within the video stream.

15. The system of claim 13 , wherein generating the tracking data corresponding to the video stream using the one or more artificial intelligence models comprises:

generating a JavaScript Object Notation (JSON) file comprising the tracking data.

16. The system of claim 15 , causing the media player to render the graphics corresponding to the tracking data over the video stream comprises:

causing the client device to unpack the JSON file to identify metadata events in the tracking data.

17. The system of claim 13 , wherein generating the tracking data corresponding to the video stream using the one or more artificial intelligence models comprises:

generating player and ball positional data corresponding to locational coordinates of each player and the ball; and

generating event data based on the tracking data, wherein the event data captures events that occur within the game.

Assignments (2)
SECURITY INTEREST Recorded Apr 14, 2026
From: STATS LLC
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 075390/0491 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 12, 2022
From: PEDAGADI, SATEESH; KUEHNEL, JOHANNES; GRIFFITHS, BRADFORD; MARKO, CHRISTIAN; REINERS, RAPHAEL; OREFICE, BRIAN; LUCEY, PATRICK JOSEPH
To: STATS LLC
Reel/Frame 061059/0305 →
Continuity (2)
Provisional Application 63260482 · Aug 20, 2021
Related Publication 20230056531A1 · Feb 23, 2023
Cited By (1)
US 12,273,574