IP Library Granted Patent US 12,470,666
Granted Patent B1
US 12,470,666 · App. 16/847,904 · Granted Nov 11, 2025

Systems and methods to add content to a video stream

Inventor: Stephen M. Markert (Stillwater, MN)
Assignee: SPORTSIGHT, LLC
H04N5/91G11B27/10G11B31/006H04N5/77
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,470,666
App. No.
16/847,904
Granted
Nov 11, 2025
Kind
B1
Abstract

Systems and methods are disclosed including systems to receive a tagging signal initiated by a user interacting with a device that displays icons corresponding to potential events that may occur in the area of interest. Systems detect an identifiable feature occurring in the area and generate a feature tag based on the detected identifiable feature. Systems arrange the tagging signal, the feature tag and the video stream together into a combined event stream so users may enter desirable tagging signals and/or tags and view portions of the combined event stream having the desirable characteristics.

Claims (39)

1 . A computer implemented method for adding content to a video stream, where at least a portion of the method is performed by a computing device comprising at least one processor, the method comprising:

Receiving a video stream of an event occurring in an area of interest from at least one camera mounted in view of the area of interest;

Receiving a tagging signal representative of an activity occurring in the area of interest, the tagging signal initiated by a user located in view of the area of interest interacting with a device that displays icons on a user interface, where the icons correspond to a plurality of potential tagging events that may occur in the area of interest;

Detecting an identifiable feature occurring in the area of interest and generating a feature tag based on the detected identifiable feature;

Arranging the tagging signal, the feature tag and the video stream together into a combined event stream; and

Saving the combined event stream.

2 . The method as set forth in claim 1 , further comprising:

Obtaining contextual information of the event; and

Adding the contextual information to the combined event stream.

3 . The method as set forth in claim 2 , where the obtaining step comprises receiving an image of a scoreboard.

4 . The method as set forth in claim 1 , where the detecting an identifiable feature comprises detecting a player identifier.

5 . The method as set forth in claim 1 , where the detecting an identifiable feature comprises detecting status of the event where the status includes play start and play stoppage.

6 . The method as set forth in claim 5 , further comprising, upon detecting a play stoppage status, inserting advertising into the combined event stream.

7 . The method as set forth in claim 1 , further comprising replaying the combined the combined event stream.

8 . The method as set forth in claim 7 , further comprising:

receiving a desired tagging signal; and

replaying portions of the combined event stream corresponding to the desired tagging signal.

9 . The method as set forth in claim 7 , further comprising:

receiving a desired feature tag; and

replaying portions of the combined event stream corresponding to the desired feature tag.

10 . A computer-based system for adding content to a video stream, the system including a processor comprising:

A video processing section in data communication with at least one camera, the video processing section executing computer-readable code to receive a video stream of an event occurring in an area of interest from at least one camera mounted in view of the area of interest;

A tag processing section in data communication with a device, the tag processing section executing computer-readable code to receive from the device a tagging signal representative of an activity occurring in the area of interest, the tagging signal initiated by a user located in view of the area of interest interacting with the device displaying icons on a user interface, where the icons correspond to a plurality of potential tagging events that may occur in the area of interest;

A feature tag processing section executing computer-readable code to detect an identifiable feature occurring in the area of interest from the video stream and generating a feature tag based on the detected identifiable feature;

A processor executing computer-readable code to arrange the tagging signal, the feature tag and the video stream together into a combined event stream; and

A storage device to save the combined event stream.

11 . The system as set forth in claim 10 , further comprising a context processing section executing computer-readable code to obtain contextual information of the event and add the contextual information to the combined event stream.

12 . The system as set forth in claim 11 , where the contextual information comprises an image of a scoreboard.

13 . The system as set forth in claim 11 , where the contextual information comprises situational information.

14 . The system as set forth in claim 10 , where the identifiable feature comprises a player identifier.

15 . The system as set forth in claim 10 , where the identifiable feature comprises play stoppage.

16 . The system as set forth in claim 10 , further comprising a replay processing section executing computer-readable code to replay portions of the combined event stream corresponding to a desired tagging signal and a desired feature tag.

17 . An article of manufacture embodied in a non-transitory computer-readable medium for associating tags received from a user during a live event, feature tags representative of a computer identified feature in the live event and a video capture of the live event, the article of manufacture comprising:

first computer executable instructions for causing a device to display on a user interface a plurality of buttons where the buttons correspond to various potential activities occurring during the live event;

second computer executable instructions for causing the device to detect user interaction with at least one of the buttons representing a potential activity and generating a tag based on the user interaction;

third computer executable instructions for detecting an identifiable feature in the area of interest from a video stream and generating a feature tag based on the identifiable feature; and

fourth computer executable instructions for correlating the tag, the feature tag and the video stream into a combined data stream.

18 . The article of manufacture as set forth in claim 17 , the article of manufacture further comprising fifth computer executable instructions for obtaining contextual information related to the event and adding the contextual information to the combined event stream.

19 . The article of manufacture as set forth in claim 17 , the article of manufacture further comprising sixth computer executable instructions for inserting advertising into the combined event stream upon determination of a play stoppage.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 23, 2025
From: MARKERT, STEPHEN M.
To: SPORTSIGHT, LLC
Reel/Frame 072951/0642 →
Continuity (3)
Continuation In Part 16504434 · Jul 8, 2019
Continuation 14052643 · Oct 11, 2013
Provisional Application 61712594 · Oct 11, 2012
References Cited (42)
US 7796155B1 · Neely, III · 2010 [cited by examiner]
US 9032296B1 · Jeffs · 2015 [cited by examiner]
US 10226698B1 · Lockton · 2019 [cited by examiner]
US 20040073437A1 · Halgas, Jr. · 2004 [cited by examiner]
US 20040243922A1 · Sirota · 2004 [cited by examiner]
US 20040268413A1 · Reid · 2004 [cited by examiner]
US 20070280638A1 · Aoki · 2007 [cited by examiner]
US 20070288951A1 · Ray · 2007 [cited by examiner]
US 20080129825A1 · DeAngelis · 2008 [cited by examiner]
US 20090082110A1 · Relyea · 2009 [cited by examiner]
US 20090210395A1 · Sedam · 2009 [cited by examiner]
US 20090228279A1 · Kephart · 2009 [cited by examiner]
US 20090228798A1 · Kephart · 2009 [cited by examiner]
US 20090228928A1 · Lee · 2009 [cited by examiner]
US 20090254843A1 · Van Wie · 2009 [cited by examiner]
US 20100179867A1 · Hughes · 2010 [cited by examiner]
US 20100195623A1 · Narasimhan · 2010 [cited by examiner]
US 20100257212A1 · Polumbus · 2010 [cited by examiner]
US 20110022471A1 · Brueck · 2011 [cited by examiner]
US 20110141357A1 · Price · 2011 [cited by examiner]
US 20110154200A1 · Davis · 2011 [cited by examiner]
US 20120030263A1 · John · 2012 [cited by examiner]
US 20120030292A1 · John · 2012 [cited by examiner]
US 20120072845A1 · John · 2012 [cited by examiner]
US 20120087588A1 · Carter · 2012 [cited by examiner]
US 20120093481A1 · McDowell · 2012 [cited by examiner]
US 20120110455A1 · Sharma · 2012 [cited by examiner]
US 20120169742A1 · Baxter · 2012 [cited by examiner]
US 20120219271A1 · Vunic · 2012 [cited by examiner]
US 20120250950A1 · Papakipos · 2012 [cited by examiner]
US 20120263430A1 · Spitzer-Williams · 2012 [cited by examiner]
US 20130029735A1 · Hormigo Cebolla · 2013 [cited by examiner]
US 20130081082A1 · Riveiro Insua · 2013 [cited by examiner]
US 20130083003A1 · Perez · 2013 [cited by examiner]
US 20130151969A1 · Campbell · 2013 [cited by examiner]
US 20130159858A1 · Joffray · 2013 [cited by examiner]
US 20130222583A1 · Earnshaw · 2013 [cited by examiner]
US 20130326406A1 · Reiley · 2013 [cited by examiner]
US 20140033081A1 · Fernandez · 2014 [cited by examiner]
US 20140089449A1 · Bhogal · 2014 [cited by examiner]
US 20140101550A1 · Zises · 2014 [cited by examiner]
WO WO0193590A2 · 2001 [cited by examiner]