IP Library Granted Patent US 11,076,200
Granted Patent B2
US 11,076,200 · App. 16/466,758 · Granted Jul 27, 2021

Systems and methods for minimizing obstruction of a media asset by an overlay by predicting a path of movement of an object of interest of the media asset and avoiding placement of the overlay in the path of movement

Inventors: Vikram Makam Gupta (Karnataka, IN); Vishwas Sharadanagar Panchaksharaiah (Tumkur District, IN)
Assignee: Rovi Guides, Inc.
H04N21/4316H04N21/2187H04N21/44008H04N21/4532H04N21/466H04N21/8133
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,076,200
App. No.
16/466,758
Filed
Jun 5, 2019
Granted
Jul 27, 2021
Kind
B2
Art Unit
2424
USPC
725/32
Abstract

Systems and methods are provided herein for minimizing obstruction of a media asset by an overlay by predicting a path of movement of an object of interest of the media asset and avoiding placement of the overlay in the path of movement. To this end, a media guidance application may detect an object of interest in a first frame of a media asset, and may determine a determining a first location of the object in the first frame and a second location of the object of interest in a second frame. The media guidance application may calculate, based on the first location and the second location, a projected location of the object of interest in a third frame of the media asset, and may generate for display an overlay in a location that does not overlap with any of the first location, the second location, and the projected location.

Claims (87)

1. A method for minimizing obstruction of a media asset by an overlay by predicting a path of movement of an object of interest of the media asset and avoiding placement of the overlay in the path of movement, the method comprising:

determining that a media asset is a live media asset broadcast;

determining that the media asset is of a certain type of a plurality of types;

detecting an object of interest in a first frame of the media asset by discerning the object of interest from a plurality of candidate objects of interest based on the certain type;

determining a first location of the object of interest in the first frame;

determining a second location of the object of interest in a second frame of the media asset;

calculating, based on the first location and the second location, a projected location of the object of interest in a third frame of the media asset that is displayed after the first frame and the second frame, wherein the calculating is performed based on both an identity of the object of interest and the certain type; and

generating for display an overlay on top of the media asset in a location that does not overlap with any of the first location, the second location, and the projected location.

2. The method of claim 1 , further comprising:

determining a size of the overlay;

identifying a region in the second frame corresponding to the size of the overlay that is unchanged in the second frame as compared to the first frame; and

determining whether the region overlaps with any of the first location, the second location, and the projected location; wherein the generating for display of the overlay is performed in response to determining that the region does not overlap with any of the first location, the second location, and the projected location, and wherein the overlay is generated for display on top of the media asset within the region.

3. The method of claim 1 , further comprising:

determining that the object of interest is not in the projected location of the third frame; and

in response to determining that the object of interest is not in the projected location of the third frame, ceasing the generating for display of the overlay on top of the media asset.

4. The method of claim 3 , further comprising, further in response to determining that the object of interest is not in the projected location of the third frame:

updating a model used to calculate the projected location of the object of interest with data indicating that the calculation of the projected location of the object of interest has failed;

determining, based on the updated model, an updated projected location of the object of interest in a fourth frame of the media asset; and

generating for display the overlay on top of the media asset in a location that does not overlap the updated projected location.

5. The method of claim 1 , wherein calculating, based on the first location and the second location, the projected location of the object of interest in the third frame of the media asset comprises:

determining an amount of content that is to be included in the overlay;

determining, based on information of a user profile, a first amount of time the user will require to consume the content;

determining a second amount of time that will lapse before the object of interest reaches the projected location; and

in response to determining that the second amount of time exceeds the first amount of time, generating for display the overlay on top of the media asset at the projected location for a period of time that is less than the second amount of time.

6. The method of claim 1 , wherein calculating, based on the first location and the second location, the projected location of the object of interest in the third frame of the media asset, comprises:

comparing the first location to the second location to determine a distance between the first location and the second location and a direction in which the media object is traveling;

comparing a time stamp of the first frame to a time stamp of the second frame to determine a time difference between the times at which the first frame and the second frame were broadcast;

determining a velocity of the object of interest based on the distance, the direction, and the time difference;

determining a projected time stamp of the third frame; and

determining the projected location based on where the object of interest will be in the third frame if the velocity is substantially maintained.

7. The method of claim 1 , wherein the media asset is a live broadcast of a sporting event, wherein the object of interest is a person participating in the sporting event, wherein the first location and the second location are equal, and wherein the method further comprises:

accessing a profile of the person; and

determining, based on information of the profile, a preferred direction that the person tends to travel when participating in the sporting event, wherein calculating the projected location of the object of interest in the third frame of the media asset further comprises basing the projected location on the preferred direction.

8. The method of claim 1 , wherein the media asset is a live broadcast of a sporting event, wherein the object of interest is a ball, and wherein the method further comprises:

detecting, in a fourth frame of the media asset, a person at a third position;

detecting, in a fifth frame of the media asset, the person at a fourth position;

determining, based on movement of the person between the third position and the fourth position, that the person is likely to interact with the ball; and

calculating an updated projected position for a sixth frame of the media asset of the ball based on the movement of the person between the third position and the fourth position.

9. The method of claim 8 , wherein calculating the updated projected position for the sixth frame of the media asset of the ball based on the movement of the person between the third position and the fourth position comprises:

determining a first velocity of the person based on the third position, the fourth position, a time stamp of the fourth frame, and a time stamp of the fifth frame;

determining a second velocity of the ball based on a location of the ball at in the fourth frame and the fifth frame; and

determining the updated projected position by combining the first velocity and the second velocity.

10. A system for minimizing obstruction of a media asset by an overlay by predicting a path of movement of an object of interest of the media asset and avoiding placement of the overlay in the path of movement, the system comprising:

object detection circuitry;

display circuitry; and

control circuitry configured to:

determine that a media asset is a live media asset broadcast;

determine that the media asset is of a certain type of a plurality of types;

detect, using the object detection circuitry, an object of interest in a first frame of the media asset by discerning the object of interest from a plurality of candidate objects of interest based on the certain type;

determine a first location of the object of interest in the first frame;

determine a second location of the object of interest in a second frame of the media asset;

calculate, based on the first location and the second location, a projected location of the object of interest in a third frame of the media asset that is displayed after the first frame and the second frame, wherein the calculating is performed based on both an identity of the object of interest and the certain type; and

generate for display, using the display circuitry, an overlay on top of the media asset in a location that does not overlap with any of the first location, the second location, and the projected location.

11. The system of claim 10 , wherein the control circuitry is further configured to:

determine a size of the overlay;

identify a region in the second frame corresponding to the size of the overlay that is unchanged in the second frame as compared to the first frame; and

determine whether the region overlaps with any of the first location, the second location, and the projected location; wherein the control circuitry is further configured to perform the generating for display of the overlay in response to determining that the region does not overlap with any of the first location, the second location, and the projected location, and wherein the overlay is generated for display on top of the media asset within the region.

12. The system of claim 10 , wherein the control circuitry is further configured to:

determine that the object of interest is not in the projected location of the third frame; and

in response to determining that the object of interest is not in the projected location of the third frame, cease the generating for display of the overlay on top of the media asset.

13. The system of claim 12 , wherein the control circuitry is further configured to, further in response to determining that the object of interest is not in the projected location of the third frame:

update a model used to calculate the projected location of the object of interest with data indicating that the calculation of the projected location of the object of interest has failed;

determine, based on the updated model, an updated projected location of the object of interest in a fourth frame of the media asset; and

generate for display the overlay on top of the media asset in a location that does not overlap the updated projected location.

14. The system of claim 10 , wherein the control circuitry is further configured, when calculating, based on the first location and the second location, the projected location of the object of interest in the third frame of the media asset, to:

determine an amount of content that is to be included in the overlay;

determine, based on information of a user profile, a first amount of time the user will require to consume the content;

determine a second amount of time that will lapse before the object of interest reaches the projected location; and

in response to determining that the second amount of time exceeds the first amount of time, generate for display the overlay on top of the media asset at the projected location for a period of time that is less than the second amount of time.

15. The system of claim 10 , wherein the control circuitry is further configured, when calculating, based on the first location and the second location, the projected location of the object of interest in the third frame of the media asset, to:

compare the first location to the second location to determine a distance between the first location and the second location and a direction in which the media object is traveling;

compare a time stamp of the first frame to a time stamp of the second frame to determine a time difference between the times at which the first frame and the second frame were broadcast;

determine a velocity of the object of interest based on the distance, the direction, and the time difference;

determine a projected time stamp of the third frame; and

determine the projected location based on where the object of interest will be in the third frame if the velocity is substantially maintained.

16. The system of claim 10 , wherein the media asset is a live broadcast of a sporting event, wherein the object of interest is a person participating in the sporting event, wherein the first location and the second location are equal, and wherein the control circuitry is further configured to:

access a profile of the person; and

determine, based on information of the profile, a preferred direction that the person tends to travel when participating in the sporting event, wherein the control circuitry is further configured, when calculating the projected location of the object of interest in the third frame of the media asset further, to base the projected location on the preferred direction.

17. The system of claim 10 , wherein the media asset is a live broadcast of a sporting event, wherein the object of interest is a ball, and wherein the control circuitry is further configured to:

detect, in a fourth frame of the media asset, a person at a third position;

detect, in a fifth frame of the media asset, the person at a fourth position;

determine, based on movement of the person between the third position and the fourth position, that the person is likely to interact with the ball; and

calculate an updated projected position for a sixth frame of the media asset of the ball based on the movement of the person between the third position and the fourth position.

18. The system of claim 17 , wherein the control circuitry is further configured, when calculating the updated projected position for the sixth frame of the media asset of the ball based on the movement of the person between the third position and the fourth position, to:

determine a first velocity of the person based on the third position, the fourth position, a time stamp of the fourth frame, and a time stamp of the fifth frame;

determine a second velocity of the ball based on a location of the ball at in the fourth frame and the fifth frame; and

determine the updated projected position by combining the first velocity and the second velocity.

Assignments (7)
CHANGE OF NAME Recorded Oct 2, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069086/0199 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: MORGAN STANLEY SENIOR FUNDING, INC.
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053481/0790 →
RELEASE OF SECURITY INTEREST Recorded Jun 5, 2020
From: HPS INVESTMENT PARTNERS, LLC
To: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
Reel/Frame 053458/0749 →
SECURITY INTEREST Recorded Jun 1, 2020
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS INC.; VEVEO, INC.; INVENSAS CORPORATION; INVENSAS BONDING TECHNOLOGIES, INC.; TESSERA, INC.; TESSERA ADVANCED TECHNOLOGIES, INC.; DTS, INC.; PHORUS, INC.; IBIQUITY DIGITAL CORPORATION
To: BANK OF AMERICA, N.A.
Reel/Frame 053468/0001 →
PATENT SECURITY AGREEMENT Recorded Nov 25, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: MORGAN STANLEY SENIOR FUNDING, INC., AS COLLATERAL AGENT
Reel/Frame 051110/0006 →
SECURITY INTEREST Recorded Nov 22, 2019
From: ROVI SOLUTIONS CORPORATION; ROVI TECHNOLOGIES CORPORATION; ROVI GUIDES, INC.; TIVO SOLUTIONS, INC.; VEVEO, INC.
To: HPS INVESTMENT PARTNERS, LLC, AS COLLATERAL AGENT
Reel/Frame 051143/0468 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 5, 2019
From: GUPTA, VIKRAM MAKAM; PANCHAKSHARAIAH, VISHWAS SHARADANAGAR
To: ROVI GUIDES, INC.
Reel/Frame 049380/0446 →
Continuity (1)
Related Publication 20190349626A1 · Nov 14, 2019
Cited By (3)
US 12,189,130 US 12,341,737 US 12,425,699