IP Library Granted Patent US 11,381,881
Granted Patent B2
US 11,381,881 · App. 16/881,698 · Granted Jul 5, 2022

Systems and methods for performing an action based on context of a feature in a media asset

Inventors: Glen E. Roe (Simi Valley, CA); Michael K. McCarty (Agoura Hills, CA)
Assignee: Rovi Guides, Inc.
H04N21/4882H04N21/435H04N21/482H04N21/4826
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,381,881
App. No.
16/881,698
Granted
Jul 5, 2022
Kind
B2
Abstract

Systems and methods are provided herein for performing an action based on a feature in a media asset. In many media assets, specific features appear at portions of a program that users find interesting. These features can be compared with a database of stored objects that commonly appear in media assets to determine the object corresponding to the feature. The context of the object in the media asset then may be determined so that an appropriate action is selected for the system to take.

Claims (94)

1. A method for performing an action based on context of a feature in a media asset over a communications network, the method comprising:

transmitting a command to generate a user interface on a computing device, wherein a media asset can be selected using the user interface;

analyzing pixels of a frame of the selected media asset being presented on the user interface of the computing device;

determining a presence of a feature in the frame of the media asset based on the analysis of the pixels, wherein the feature corresponds to properties of a plurality of pixels;

determining a context of the feature based on the frame and based on a data structure comprising a plurality of contexts and corresponding context characteristics;

determining a different priority level of the same feature based on the determined context of the feature;

determining an action to be performed based on the determined priority level, wherein each priority level is associated with a different action to be performed; and

performing the action in response to the presence of the feature.

2. The method of claim 1 , wherein determining the presence of the feature comprises:

analyzing a group of pixels in a pixel map associated with the frame of the media asset;

determining shared properties of a subset of pixels in the group of pixels; and

identifying positions of pixels in the subset of pixels as corresponding to the feature.

3. The method of claim 1 , wherein determining the context of the feature comprises:

determining, from data associated with the feature, a characteristic of the feature;

comparing the characteristic to context characteristics of the plurality of contexts stored in the data structure to identify the context; and

retrieving the context from a context field of the data structure associated.

4. The method of claim 1 , wherein determining the action to be performed based the context of the feature comprises:

retrieving the context from a context field of the data structure associated; and

retrieving, from a database of actions corresponding to contexts, an action corresponding to the context of the feature.

5. The method of claim 1 , wherein the action relates to moving a current playback position to another playback position and wherein performing the action in response to the presence of the feature comprises:

determining the another playback position based on the frame containing the feature;

moving the current playback position to the another playback position; and

playing the media asset from the another playback position.

6. The method of claim 1 , wherein the action relates to alerting a user to a media asset with subject matter that corresponds to the feature and wherein performing the action in response to the presence of the feature comprises:

retrieving subject matter of the feature from a subject matter field of a data structure associated with the feature;

searching for a first media asset associated with the retrieved subject matter; and

promoting the first media asset among a plurality of displayed media assets.

7. The method of claim 1 , wherein the action relates to presenting supplemental information related to the feature and wherein performing the action in response to the presence of the feature comprises:

retrieving a pointer to a location of the supplemental information related to the feature from a supplemental information field of a data structure associated with the feature;

accessing the location of the supplemental information;

retrieving the supplemental information; and

generating a simultaneous display of the media asset and the supplemental information.

8. The method of claim 1 , wherein the media asset is a first media asset, wherein the action is associated with presenting the first media asset to the user simultaneously with a second media asset currently being accessed by the user, and wherein performing the action in response to the presence of the feature comprises:

determining the user is not accessing the first media asset;

retrieving the first media asset; and

generating a simultaneous display of the first media asset and the second media asset currently being accessed by the user.

9. The method of claim 1 , further comprising:

associating the feature with a plurality of media assets, wherein the plurality of media assets contains similar content;

storing the feature as a first feature in a library of features associated with the plurality of media assets; and

storing, in a context field of a data structure associated with the first feature of a plurality of features, a first context indicator, wherein action relating to the first feature is stored as a first characteristic of the first context indicator.

10. A system for performing an action based on context of a feature in a media asset over a communications network, the system comprising:

storage circuitry configured to store a data structure comprising a plurality of contexts and corresponding context characteristics; and

control circuitry configured to:

transmit a command to generate a user interface on a computing device, wherein a media asset can be selected using the user interface;

analyze pixels of a frame of the selected media asset being presented on the user interface of the computing device;

determine a presence of a feature in the frame of the media asset based on the analysis of the pixels, wherein the feature corresponds to properties of a plurality of pixels;

determine a context of the feature based on the frame and based on the data structure;

determine a different priority level of the same feature based on the determined context of the feature;

determine an action to be performed based on the determined priority level, wherein each priority level is associated with a different action to be performed; and

perform the action in response to the presence of the feature.

11. The system of claim 10 , wherein the control circuitry is further configured, when determining the presence of the feature, to:

analyze a group of pixels in a pixel map associated with the frame of the media asset;

determine shared properties of a subset of pixels in the group of pixels; and

identify positions of pixels in the subset of pixels as corresponding to the feature.

12. The system of claim 10 , wherein the control circuitry is further configured, when determining a context of the feature, to:

determine, from data associated with the feature, a characteristic of the feature;

compare the characteristic to context characteristics of the plurality of contexts stored in the data structure to identify the context; and

retrieve the context from a context field of the data structure associated.

13. The system of claim 10 , wherein the control circuitry is further configured, when determining the action to be performed based the context of the feature, to:

retrieve the context from a context field of the data structure associated; and

retrieve, from a database of actions corresponding to contexts, an action corresponding to the context of the feature.

14. The system of claim 10 , wherein the action relates to moving a current playback position to another playback position and wherein the control circuitry is further configured, when performing the action in response to the presence of the feature, to:

determine the another playback position based on the frame containing the feature;

move the current playback position to the another playback position; and

play the media asset from the another playback position.

15. The system of claim 10 , wherein the action relates to alerting a user to a media asset with subject matter that corresponds to the feature and wherein the control circuitry is further configured, when performing the action in response to the presence of the feature, to:

retrieve subject matter of the feature from a subject matter field of a data structure associated with the feature;

search for a first media asset associated with the retrieved subject matter; and

promote the first media asset among a plurality of displayed media assets.

16. The system of claim 10 , wherein the action relates to presenting supplemental information related to the feature and wherein the control circuitry is further configured, when performing the action in response to the presence of the feature, to:

retrieve a pointer to a location of the supplemental information related to the feature from a supplemental information field of a data structure associated with the feature;

access the location of the supplemental information;

retrieve the supplemental information; and

generate a simultaneous display of the media asset and the supplemental information.

17. The system of claim 10 , wherein the media asset is a first media asset, wherein the action is associated with presenting the first media asset to the user simultaneously with a second media asset currently being accessed by the user, and wherein the control circuitry is further configured, when performing the action in response to the presence of the feature, to:

determine the user is not accessing the first media asset;

retrieve the first media asset; and

generate a simultaneous display of the first media asset and the second media asset currently being accessed by the user.

18. The system of claim 10 , wherein the control circuitry is further configured to:

associate the feature with a plurality of media assets, wherein the plurality of media assets contains similar content;

store the feature as a first feature in a library of features associated with the plurality of media assets; and

store, in a context field of a data structure associated with the first feature of a plurality of features, a first context indicator, wherein action relating to the first feature is stored as a first characteristic of the first context indicator.

19. A non-transitory computer readable medium having instructions encoded thereon that when executed causes the control circuitry to:

transmit a command to generate a user interface on a computing device, wherein a media asset can be selected using the user interface;

analyze pixels of a frame of the selected media asset being presented on the user interface of the computing device;

determine a presence of a feature in the frame of the media asset based on the analysis of the pixels, wherein the feature corresponds to properties of a plurality of pixels;

determine a context of the feature based on the frame and based on a data structure comprising a plurality of contexts and corresponding context characteristics;

determine a different priority level of the same feature based on the determined context of the feature;

determine an action to be performed based on the determined priority level, wherein each priority level is associated with a different action to be performed; and

perform the action in response to the presence of the feature.

20. The non-transitory computer readable medium of claim 19 , wherein the instruction for determining the presence of the feature, causes the control circuitry to:

analyze a group of pixels in a pixel map associated with the frame of the media asset;

determine shared properties of a subset of pixels in the group of pixels; and

identify positions of pixels in the subset of pixels as corresponding to the feature.

Assignments (3)
CHANGE OF NAME Recorded Oct 23, 2022
From: ROVI GUIDES, INC.
To: ADEIA GUIDES INC.
Reel/Frame 061746/0981 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 23, 2022
From: ADEIA GUIDES INC.
To: ROVI PRODUCT CORPORATION
Reel/Frame 061747/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 22, 2020
From: ROE, GLEN E.; MCCARTY, MICHAEL K.
To: ROVI GUIDES, INC.
Reel/Frame 052736/0645 →
Continuity (3)
Continuation 16002666 · Jun 7, 2018
Continuation 15056733 · Feb 29, 2016
Related Publication 20200359103A1 · Nov 12, 2020