IP Library Granted Patent US 12,405,993
Granted Patent B2
US 12,405,993 · App. 18/390,590 · Granted Sep 2, 2025

Media consumption history

Inventor: Matthew Sharifi (Kilchberg, CH)
Assignee: GOOGLE LLC
G06F16/487G06F16/245G06F16/2455G06F16/24578G06F16/433G06F16/435G06F16/437G06F16/489G06F16/685G06F16/7834G06F16/9535G06F16/955G06Q30/02G06Q30/0631
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,405,993
App. No.
18/390,590
Granted
Sep 2, 2025
Kind
B2
Abstract

Methods, systems, and apparatus for receiving, from a user, a request that includes an entity identifier associated with an entity that is referenced by one or more query terms of a search query, determining that the entity is identified in a media consumption database as a media item that has been indicated as consumed by the user or that the entity is associated with a media item that is identified in the media consumption database as a media item that has been indicated as consumed by the user, and based on the determination, providing a response to the request, the response including data indicating that the entity is a media item that has been indicated as consumed by the user or that the entity is associated with a media item that has been indicated as consumed by the user.

Claims (52)

1. A method implemented by one or more processors, the method comprising:

receiving a search query from a user, wherein the search query references a particular entity;

in response to receiving the search query:

(i) identifying, from a plurality of media items that are each identified as having been previously consumed by the user, a particular media item that features the particular entity, comprising:

identifying a subset of the plurality of media items, based on each media item in the subset featuring the particular entity, wherein the media items in the subset are not directly referenced in the search query;

for each media item in the subset, identifying a relevance score for the media item, based on an extent to which the particular entity is featured in the media item; and

identifying the particular media item based on the relevance scores for the media items in the subset; and

(ii) obtaining a set of web search results responsive to the search query, the set of web search results being separate from the particular media item that features the particular entity; and

providing, for display on a screen of a computing device, an interface that includes information about the particular media item that was identified in response to the search query and information about the set of web search results that were identified in response to the search query,

wherein the information about the particular media item includes an indication that the particular media item features the particular entity that was referenced in the search query.

2. The method according to claim 1 , wherein the information about the particular media item that is provided for display in the interface includes an indication that the particular media item was previously consumed by the user.

3. The method according to claim 1 , further comprising identifying a particular device on which the particular media item was previously consumed by the user.

4. The method according to claim 3 , wherein the information about the particular media item that is provided for display in the interface includes an indication of the particular device on which the particular media item was previously consumed by the user.

5. The method according to claim 1 , wherein:

the identified media item is a video and the particular entity featured in the identified media item is a person that features in the video, or

the identified media item is a song and the particular entity featured in the identified media item is a person that features in the song.

6. The method according to claim 1 , further comprising designating the particular media item as having previously been consumed by the user based on an audio recognition engine having processed audio data captured in an environment of the computing device and having recognized the particular media item from the captured audio data.

7. The method according to claim 1 , wherein the information about the particular media item that is provided for display in the interface includes an indication of a time when the particular media item was previously consumed by the user.

8. The method according to claim 1 , wherein the information about the particular media item that is provided for display in the interface includes an indication of a location where the particular media item was previously consumed by the user.

9. The method according to claim 1 , further comprising analyzing one or more terms of the search query to identify the particular entity that is referenced by the search query.

10. The method according to claim 1 , wherein, for each media item in the subset, the relevance score for the media item is further based on a likelihood of the user having consumed at least a threshold portion of the media item.

11. A computer program product comprising one or more computer-readable storage media having program instructions collectively stored on the one or more non-transitory computer-readable storage media, the program instructions executable to:

receive a search query from a user, wherein the search query references a particular entity;

in response to receiving the search query:

(i) identify, from a plurality of media items that are each identified as having been previously consumed by the user, a particular media item that features the particular entity, comprising:

identifying a subset of the plurality of media items, based on each media item in the subset featuring the particular entity, wherein the media items in the subset are not directly referenced in the search query;

for each media item in the subset, identifying a relevance score for the media item, based on an extent to which the particular entity is featured in the media item; and

identifying the particular media item based on the relevance scores for the media items in the subset; and

(ii) obtain a set of web search results responsive to the search query, the set of web search results being separate from the particular media item that features the particular entity; and

provide, for display on a screen of a computing device, an interface that includes information about the particular media item that was identified in response to the search query and information about the set of web search results that were identified in response to the search query,

wherein the information about the particular media item includes an indication that the particular media item features the particular entity that was referenced in the search query.

12. The computer program product according to claim 11 , wherein the information about the particular media item that is provided for display in the interface includes an indication that the particular media item was previously consumed by the user.

13. The computer program product according to claim 11 , wherein the program instructions are further executable to identify a particular device on which the particular media item was previously consumed by the user.

14. The computer program product according to claim 13 , wherein the information about the particular media item that is provided for display in the interface includes an indication of the particular device on which the particular media item was previously consumed by the user.

15. The computer program product according to claim 11 , wherein:

the identified media item is a video and the particular entity featured in the identified media item is a person that features in the video, or

the identified media item is a song and the particular entity featured in the identified media item is a person that features in the song.

16. The computer program product according to claim 11 , wherein the program instructions are further executable to designate the particular media item as having previously been consumed by the user based on an audio recognition engine having processed audio data captured in an environment of the computing device and having recognized the particular media item from the captured audio data.

17. The computer program product according to claim 11 , wherein the information about the particular media item that is provided for display in the interface includes an indication of a time when the particular media item was previously consumed by the user.

18. The computer program product according to claim 11 , wherein the information about the particular media item that is provided for display in the interface includes an indication of a location where the particular media item was previously consumed by the user.

19. The computer program product according to claim 11 , wherein the program instructions are further executable to analyze one or more terms of the search query to identify the particular entity that is referenced by the search query.

20. A system comprising:

a processor, a computer-readable memory, one or more computer-readable storage media, and program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:

receive a search query from a user, wherein the search query references a particular entity;

in response to receiving the search query:

(i) identify, from a plurality of media items that are each identified as having been previously consumed by the user, a particular media item that features the particular entity, comprising:

identifying a subset of the plurality of media items, based on each media item in the subset featuring the particular entity, wherein the media items in the subset are not directly referenced in the search query;

for each media item in the subset, identifying a relevance score for the media item, based on an extent to which the particular entity is featured in the media item; and

identifying the particular media item based on the relevance scores for the media items in the subset; and

(ii) obtain a set of web search results responsive to the search query, the set of web search results being separate from the particular media item that features the particular entity; and

provide, for display on a screen of a computing device, an interface that includes information about the particular media item that was identified in response to the search query and information about the set of web search results that were identified in response to the search query,

wherein the information about the particular media item includes an indication that the particular media item features the particular entity that was referenced in the search query.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 5, 2024
From: SHARIFI, MATTHEW
To: GOOGLE INC.
Reel/Frame 066038/0695 →
CHANGE OF NAME Recorded Jan 5, 2024
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 066208/0336 →
Continuity (4)
Continuation 16264125 · Jan 31, 2019
Continuation 14142171 · Dec 27, 2013
Provisional Application 61866234 · Aug 15, 2013
Related Publication 20240119086A1 · Apr 11, 2024
References Cited (56)
US 6791580B1 · Abbott et al. · 2004 [cited by applicant]
US 7181444B2 · Porter et al. · 2007 [cited by applicant]
US 7444353B1 · Chen et al. · 2008 [cited by applicant]
US 7746895B2 · Bucher et al. · 2010 [cited by applicant]
US 7937403B2 · Kehl · 2011 [cited by applicant]
US 8180765B2 · Nicolov · 2012 [cited by applicant]
US 8484017B1 · Sharifi et al. · 2013 [cited by applicant]
US 8799814B1 · Bryc et al. · 2014 [cited by applicant]
US 8954448B1 · Durham et al. · 2015 [cited by applicant]
US 9110954B2 · Shen et al. · 2015 [cited by applicant]
US 10198442B2 · Sharifi · 2019 [cited by applicant]
US 10275464B2 · Sharifi · 2019 [cited by applicant]
US 10303779B2 · Sharifi · 2019 [cited by applicant]
US 10332151B2 · Megdal · 2019 [cited by applicant]
US 20030212659A1 · Ban · 2003 [cited by applicant]
US 20050071323A1 · Gabriel · 2005 [cited by examiner]
US 20050234992A1 · Haberman · 2005 [cited by examiner]
US 20070192319A1 · Finley et al. · 2007 [cited by applicant]
US 20070239675A1 · Ragno et al. · 2007 [cited by applicant]
US 20080222105A1 · Matheny · 2008 [cited by applicant]
US 20080222295A1 · Robinson et al. · 2008 [cited by applicant]
US 20080275846A1 · Almas · 2008 [cited by applicant]
US 20090164641A1 · Rogers et al. · 2009 [cited by applicant]
US 20100070488A1 · Sylvain · 2010 [cited by applicant]
US 20100082585A1 · Barsook · 2010 [cited by examiner]
US 20100161643A1 · Gionis et al. · 2010 [cited by applicant]
US 20100211575A1 · Collins · 2010 [cited by examiner]
US 20110153050A1 · Bauer et al. · 2011 [cited by applicant]
US 20110276396A1 · Rathod · 2011 [cited by applicant]
US 20110314039A1 · Zheleva · 2011 [cited by applicant]
US 20120059495A1 · Weiss et al. · 2012 [cited by applicant]
US 20120059838A1 · Berntson et al. · 2012 [cited by applicant]
US 20120166432A1 · Tseng et al. · 2012 [cited by applicant]
US 20130117259A1 · Ackerman · 2013 [cited by applicant]
US 20130173604A1 · Li et al. · 2013 [cited by applicant]
US 20130212081A1 · Shenoy et al. · 2013 [cited by applicant]
US 20130291025A1 · Ozawa · 2013 [cited by examiner]
US 20130325869A1 · Reiley et al. · 2013 [cited by applicant]
US 20130326406A1 · Reiley et al. · 2013 [cited by applicant]
US 20140095608A1 · Mandalia · 2014 [cited by examiner]
US 20140101142A1 · Gomez Uribe et al. · 2014 [cited by applicant]
US 20140101192A1 · Sabah et al. · 2014 [cited by applicant]
US 20140280112A1 · Cheng et al. · 2014 [cited by applicant]
US 20140280291A1 · Collins et al. · 2014 [cited by applicant]
US 20150052168A1 · Sharifi · 2015 [cited by applicant]
US 20150134334A1 · Sachidanandam et al. · 2015 [cited by applicant]
US 20190236094A1 · Sharifi · 2019 [cited by applicant]
US 20190251117A1 · Sharifi · 2019 [cited by applicant]
Feng et al., “Speech and Multimodal Interaction in Mobile Search,” IEEE Signal Processing Magazine, IEEE 1-21 NJ, US, Service Center, Piscataway, vol. 28, No. 4; pp. 40-49; dated Jul. 1, 2011. [cited by applicant]
Fink et al* “Social and interactive television applications based on real-time ambient-audio identification”, Proceedings of the EuroITV 2006 Conference, pp. 138-146, ResearchGate; dated 2006. [cited by applicant]
International Preliminary Report on Patentability in International Application No. PCT/US2014/051126, 8 pages; mailed Feb. 25, 2016. [cited by applicant]
International Preliminary Report on Patentability in International Application No. PCT/US2014/051123, 8 pages; mailed Nov. 28, 2014. [cited by applicant]
International Search Report and Written Opinion in International Application No. PCT/US2014/051123, 11 pages; mailed Nov. 28, 2014. [cited by applicant]
Lee. “Analysis of User Needs and Information Features in Natural Language Queries Seeking Music Information,” Journal of the American Society for Information Science and Techonology, 61(5), 42 pages; dated May 1, 2010. [cited by applicant]
Song et al. “Voice search of structured media data,” ICASSP 2009, IEEE International Conference; 4 pages; dated Apr. 19, 2009. [cited by applicant]
TW Office Action in Taiwan Appin. No. 103127977, 12 pages; dated Jun. 13, 2019. [cited by applicant]