IP Library Granted Patent US 11,611,794
Granted Patent B2
US 11,611,794 · App. 17/358,701 · Granted Mar 21, 2023

Systems and methods for minimizing obstruction of a media asset by an overlay by predicting a path of movement of an object of interest of the media asset and avoiding placement of the overlay in the path of movement

Inventors: Vikram Makam Gupta (Karnataka, IN); Vishwas Sharadanagar Panchaksharaiah (Tumkur District, IN)
Assignee: Rovi Guides, Inc.
H04N21/4316H04N21/2187H04N21/44008H04N21/4532H04N21/466H04N21/8133
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,611,794
App. No.
17/358,701
Granted
Mar 21, 2023
Kind
B2
Abstract

Systems and methods are provided herein for minimizing obstruction of a media asset by an overlay by predicting a path of movement of an object of interest of the media asset and avoiding placement of the overlay in the path of movement. To this end, a media guidance application may detect an object of interest in a first frame of a media asset, and may determine a determining a first location of the object in the first frame and a second location of the object of interest in a second frame. The media guidance application may calculate, based on the first location and the second location, a projected location of the object of interest in a third frame of the media asset, and may generate for display an overlay in a location that does not overlap with any of the first location, the second location, and the projected location.

Claims (96)

1. A method comprising:

detecting an object of interest in a first frame of a media asset;

determining a first location of the object of interest in the first frame;

determining a second location of the object of interest in a second frame of the media asset;

calculating, based on the first location and the second location, a projected location of the object of interest in a third frame of the media asset that is displayed after the first frame and the second frame;

determining an amount of content that is to be included in an overlay to be generated for display;

determining a first amount of time to consume the content of the overlay;

determining a second amount of time for the object of interest to reach the projected location from the first location or from the second location; and

in response to determining that the second amount of time exceeds the first amount of time, generating for display the overlay on top of the media asset at the projected location for a period of time that is less than the second amount of time.

2. The method of claim 1 , further comprising:

in response to determining that the second amount of time does not exceed the first amount of time, generating for display the overlay on top of the media asset at a portion of the media asset that does not obscure any point of a projected path of the object of interest.

3. The method of claim 1 , wherein the amount of content that is to be included in the overlay is determined based on a type of content of the overlay.

4. The method of claim 1 , wherein the first amount of time to consume the content of the overlay is determined based on a user profile of a user consuming the media asset.

5. The method of claim 1 , further comprising:

determining a size of the overlay;

identifying a region in the second frame corresponding to the size of the overlay that is unchanged in the second frame as compared to the first frame; and

determining whether the region overlaps with any of the first location, the second location, and the projected location;

wherein the generating for display of the overlay is performed in response to determining that the region does not overlap with any of the first location, the second location, and the projected location, and wherein the overlay is generated for display on top of the media asset within the region.

6. The method of claim 1 , further comprising:

determining that the object of interest is not in the projected location of the third frame; and

in response to determining that the object of interest is not in the projected location of the third frame, ceasing the generating for display of the overlay on top of the media asset.

7. The method of claim 6 , further comprising, further in response to determining that the object of interest is not in the projected location of the third frame:

updating a model used to calculate the projected location of the object of interest with data indicating that the calculation of the projected location of the object of interest has failed;

determining, based on the updated model, an updated projected location of the object of interest in a fourth frame of the media asset; and

generating for display the overlay on top of the media asset in a location that does not overlap the updated projected location.

8. The method of claim 1 , wherein calculating, based on the first location and the second location, the projected location of the object of interest in the third frame of the media asset, comprises:

comparing the first location to the second location to determine a distance between the first location and the second location and a direction in which the object of interest is traveling;

comparing a time stamp of the first frame to a time stamp of the second frame to determine a time difference between the times at which the first frame and the second frame were broadcast;

determining a velocity of the object of interest based on the distance, the direction, and the time difference;

determining a projected time stamp of the third frame; and

determining the projected location based on where the object of interest will be in the third frame if the velocity is substantially maintained.

9. The method of claim 1 , wherein:

the media asset is a live broadcast of a sporting event;

the object of interest is a person participating in the sporting event;

the first location is the same as the second location, and

the method further comprises:

accessing a profile of the person; and

determining, based on information of the profile, a preferred direction that the person tends to travel when participating in the sporting event, wherein calculating the projected location of the object of interest in the third frame of the media asset further comprises basing the projected location on the preferred direction.

10. The method of claim 2 , wherein:

the media asset is a live broadcast of a sporting event;

the object of interest is a ball;

the method further comprises:

detecting, in a fourth frame of the media asset, a person at a third position;

detecting, in a fifth frame of the media asset, the person at a fourth position;

determining, based on movement of the person between the third position and the fourth position, that the person is likely to interact with the ball; and

calculating an updated projected position for a sixth frame of the media asset of the ball based on the movement of the person between the third position and the fourth position.

11. A system comprising:

memory;

control circuitry configured to:

detect an object of interest in a first frame of a media asset;

determine a first location of the object of interest in the first frame;

determine a second location of the object of interest in a second frame of the media asset, wherein the first location and the second location are stored in the memory;

calculate, based on the first location and the second location, a projected location of the object of interest in a third frame of the media asset that is displayed after the first frame and the second frame;

determine an amount of content that is to be included in an overlay to be generated for display;

determine a first amount of time to consume the content of the overlay;

determine a second amount of time for the object of interest to reach the projected location from the first location or from the second location; and

in response to determining that the second amount of time exceeds the first amount of time, generate for display the overlay on top of the media asset at the projected location for a period of time that is less than the second amount of time.

12. The system of claim 11 , the control circuitry is further configured to:

in response to determining that the second amount of time does not exceed the first amount of time, generate for display the overlay on top of the media asset at a portion of the media asset that does not obscure any point of a projected path of the object of interest.

13. The system of claim 11 , wherein the control circuitry is configured to determine the amount of content that is to be included in the overlay based on a type of content of the overlay.

14. The system of claim 11 , wherein the control circuitry is configured to determine the first amount of time to consume the content of the overlay based on a user profile of a user consuming the media asset.

15. The system of claim 11 , wherein the control circuitry is further configured to:

determine a size of the overlay;

identify a region in the second frame corresponding to the size of the overlay that is unchanged in the second frame as compared to the first frame; and

determine whether the region overlaps with any of the first location, the second location, and the projected location;

generate for display of the overlay in response to determining that the region does not overlap with any of the first location, the second location, and the projected location; and

generate for display the overlay on top of the media asset within the region.

16. The system of claim 11 , wherein the control circuitry is further configured to:

determine that the object of interest is not in the projected location of the third frame; and

in response to determining that the object of interest is not in the projected location of the third frame, cease the generating for display of the overlay on top of the media asset.

17. The system of claim 16 , wherein the control circuitry is further configured to, in response to determining that the object of interest is not in the projected location of the third frame:

update a model used to calculate the projected location of the object of interest with data indicating that the calculation of the projected location of the object of interest has failed;

determine, based on the updated model, an updated projected location of the object of interest in a fourth frame of the media asset; and

generate for display the overlay on top of the media asset in a location that does not overlap the updated projected location.

18. The system of claim 11 , wherein the control circuitry is configured to calculate, based on the first location and the second location, the projected location of the object of interest in the third frame of the media asset, by:

comparing the first location to the second location to determine a distance between the first location and the second location and a direction in which the object of interest is traveling;

comparing a time stamp of the first frame to a time stamp of the second frame to determine a time difference between the times at which the first frame and the second frame were broadcast;

determining a velocity of the object of interest based on the distance, the direction, and the time difference;

determining a projected time stamp of the third frame; and

determining the projected location based on where the object of interest will be in the third frame if the velocity is substantially maintained.

19. The system of claim 11 , wherein:

the media asset is a live broadcast of a sporting event;

the object of interest is a person participating in the sporting event;

the first location and the second location are equal, and

the control circuitry is further configured to:

access a profile of the person;

determine, based on information of the profile, a preferred direction that the person tends to travel when participating in the sporting event; and

calculate the projected location of the object of interest in the third frame of the media asset further based on the preferred direction.

20. The system of claim 11 , wherein:

the media asset is a live broadcast of a sporting event;

the object of interest is a ball; and

the control circuitry is further configured to:

detect, in a fourth frame of the media asset, a person at a third position;

detect, in a fifth frame of the media asset, the person at a fourth position;

determine, based on movement of the person between the third position and the fourth position, that the person is likely to interact with the ball; and

calculate an updated projected position for a sixth frame of the media asset of the ball based on the movement of the person between the third position and the fourth position.

Assignments (3)
CHANGE OF NAME Recorded Oct 2, 2024
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 069086/0199 →
SECURITY INTEREST Recorded May 19, 2023
From: ADEIA GUIDES INC.; ADEIA MEDIA HOLDINGS LLC; ADEIA MEDIA SOLUTIONS INC.; ADEIA SEMICONDUCTOR BONDING TECHNOLOGIES INC.; ADEIA SEMICONDUCTOR SOLUTIONS LLC; ADEIA SEMICONDUCTOR TECHNOLOGIES LLC
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 063707/0884 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2021
From: GUPTA, VIKRAM MAKAM; PANCHAKSHARAIAH, VISHWAS SHARADANAGAR
To: ROVI GUIDES, INC.
Reel/Frame 056672/0179 →
Continuity (2)
Continuation 16466758
Related Publication 20210400333A1 · Dec 23, 2021