Granted Patent B2

US 12,389,076 · App. 18/141,059 · Granted Aug 12, 2025

Inventors: Mustafa Coskun (Kayseri, TR); Vehbi Cagri Gungor (Kayseri, TR); Dhananjay Lal (Englewood, CO); Reda Harb (Issaquah, WA)

Assignee: Adeia Guides Inc.

H04N21/4722H04N21/44008H04N21/4532H04N21/8133

Abstract

Claims (75)

1. A computer-implemented system, comprising:

control circuitry configured to:

generate for display a media asset; and

input/output (I/O) circuitry configured to:

receive a query regarding an object depicted in the media asset at a first time point within a presentation duration of the media asset;

wherein the control circuitry is further configured to:

identify supplemental content related to the object by:

determining a presentation point within the presentation duration of the media asset related to the object;

determining, based on a user profile of a user associated with the query, whether the presentation point was previously consumed by the user of the user profile; and

based on determining that the presentation point was not previously consumed by the user of the user profile, refraining from using the presentation point as the supplemental content; and

identifying other content to be used as the supplemental content; and

generate for display the other content as the supplemental content while the media asset is being generated for display.

2. The system of claim 1 , wherein the control circuitry is configured to determine an identity of the object in a context of the media asset by:

identifying a plurality of portions of the media asset that are related to the object depicted at the first time point of the media asset and associated with the query; and

using one or more attributes of the plurality of portions of the media asset to determine the identity of the object in the context of the media asset.

3. The system of claim 2 , wherein the control circuitry is configured to determine the identity of the object in the context of the media asset by:

determining a type of the object depicted at the first time point of the media asset and associated with the query, wherein the plurality of portions of the media asset that are related to the object are identified based on depicting one or more objects of the same type as the object;

comparing the object associated with the query to the one or more objects depicted in the plurality of portions of the media asset;

determining, based on the comparing, one or more matching objects in the plurality of portions that match the object depicted at the first time point of the media asset and associated with the query; and

using the one or more matching objects to determine the identity of the object in the context of the media asset.

4. The system of claim 2 , wherein the control circuitry is further configured to:

train a machine learning model to receive as input an attribute related to a particular object depicted in the media asset and output an indication of an identity of the particular object in the context of the media asset;

input, to the trained machine learning model, a particular attribute related to the object and one or more attributes related to the plurality of portions of the media asset, wherein the one or more attributes are different than the particular attribute of the object; and

determine an output of the trained machine learning model indicating the identity of the object in the context of the media asset.

5. The system of claim 2 , wherein the control circuitry is further configured to:

generate a knowledge graph comprising a plurality of nodes, the plurality of nodes comprising a first node corresponding to a particular attribute related to the object and one or more other nodes corresponding to one or more attributes related to the plurality of portions of the media asset; and

use the knowledge graph to determine the identity of the object in the context of the media asset.

6. The system of claim 1 , wherein:

the media asset is an episodic media asset comprising a plurality of episodes of a series;

the first time point occurs during a first episode of the plurality of episodes; and

the presentation point occurs during a second episode of the plurality of episodes that is earlier in the series than the first episode or later in the series than the first episode.

7. The system of claim 1 , wherein:

the media asset comprises a plurality of related media assets;

the first time point occurs during a first related media asset of the plurality of related media assets; and

the presentation point occurs during a second related media asset corresponding to a prequel of, or a sequel to, the first related media asset.

8. The system of claim 1 , wherein the other content and the media asset are displayed simultaneously on a same device.

9. The system of claim 1 , wherein the other content and the media asset are displayed simultaneously on different devices.

10. The system of claim 1 , wherein the control circuitry is configured to identify the other content to be used as the supplemental content by:

obtaining the other content from an external source that is distinct from within the presentation duration of the media asset, based on determining that the presentation point was not previously consumed by the user of the user profile.

11. A computer-implemented method, comprising:

generating for display a media asset;

receiving a query regarding an object depicted in the media asset at a first time point within a presentation duration of the media asset;

identifying supplemental content related to the object by:

determining a presentation point within the presentation duration of the media asset related to the object;

determining, based on a user profile of a user associated with the query, whether the presentation point was previously consumed by the user of the user profile; and

based on determining that the presentation point was not previously consumed by the user of the user profile, refraining from using the presentation point as the supplemental content; and

identifying other content to be used as the supplemental content; and

generating for display the other content as the supplemental content while the media asset is being generated for display.

12. The method of claim 11 , further comprising determining an identity of the object in a context of the media asset by:

identifying a plurality of portions of the media asset that are related to the object depicted at the first time point of the media asset and associated with the query; and

using one or more attributes of the plurality of portions of the media asset to determine the identity of the object in the context of the media asset.

13. The method of claim 12 , wherein determining the identity of the object in the context of the media asset further comprises:

determining a type of the object depicted at the first time point of the media asset and associated with the query, wherein the plurality of portions of the media asset that are related to the object are identified based on depicting one or more objects of the same type as the object;

comparing the object associated with the query to the one or more objects depicted in the plurality of portions of the media asset;

determining, based on the comparing, one or more matching objects in the plurality of portions that match the object depicted at the first time point of the media asset and associated with the query; and

using the one or more matching objects to determine the identity of the object in the context of the media asset.

14. The method of claim 12 , further comprising:

training a machine learning model to receive as input an attribute related to a particular object depicted in the media asset and output an indication of an identity of the particular object in the context of the media asset;

inputting, to the trained machine learning model, a particular attribute related to the object and one or more attributes related to the plurality of portions of the media asset, wherein the one or more attributes are different than the particular attribute of the object; and

determining an output of the trained machine learning model indicating the identity of the object in the context of the media asset.

15. The method of claim 12 , further comprising:

generating a knowledge graph comprising a plurality of nodes, the plurality of nodes comprising a first node corresponding to a particular attribute related to the object and one or more other nodes corresponding to one or more attributes related to the plurality of portions of the media asset; and

using the knowledge graph to determine the identity of the object in the context of the media asset.

16. The method of claim 11 , wherein:

the media asset is an episodic media asset comprising a plurality of episodes of a series;

the first time point occurs during a first episode of the plurality of episodes; and

the presentation point occurs during a second episode of the plurality of episodes that is earlier in the series than the first episode or later in the series than the first episode.

17. The method of claim 11 , wherein:

the media asset comprises a plurality of related media assets;

the first time point occurs during a first related media asset of the plurality of related media assets; and

the presentation point occurs during a second related media asset corresponding to a prequel of, or a sequel to, the first related media asset.

18. The method of claim 11 , wherein identifying the other content to be used as the supplemental content comprises:

obtaining the other content from an external source that is distinct from within the presentation duration of the media asset, based on determining that the presentation point was not previously consumed by the user of the user profile.

19. The method of claim 11 , wherein the other content and the media asset are displayed simultaneously on a same device.

20. The method of claim 11 , wherein the other content and the media asset are displayed simultaneously on different devices.

Assignments (1)

Continuity (1)

References Cited (32)