IP Library Granted Patent US 12,210,562
Granted Patent B2
US 12,210,562 · App. 18/376,735 · Granted Jan 28, 2025

Media consumption history

Inventor: Matthew Sharifi (Kilchberg, CH)
Assignee: GOOGLE LLC
G06F16/487G06F16/245G06F16/2455G06F16/24578G06F16/433G06F16/435G06F16/437G06F16/489G06F16/685G06F16/7834G06F16/9535G06F16/955G06Q30/02G06Q30/0631
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,210,562
App. No.
18/376,735
Granted
Jan 28, 2025
Kind
B2
Abstract

Methods, systems, and apparatus for receiving a request that includes a user identifier of a user that submitted a search query and an entity identifier of an entity that is referenced by the search query, identifying a plurality of knowledge elements that are related to the entity, identifying, in a consumption database, one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query, assigning rank scores to the plurality of knowledge elements, based at least on identifying the one or more items, selecting one or more of the knowledge elements from among the knowledge elements based at least on the rank scores assigned to the knowledge elements, and providing, in response to the request, information associated with the entity and the one or more selected knowledge elements.

Claims (74)

1. A method implemented by one or more processors, the method comprising:

receiving a request at a request time that indicates (i) a user that submitted a search query, and (ii) an entity that is referenced by the search query;

identifying (i) one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query, and (ii) for each item, a time of when the user consumed the item;

determining, based at least on (i) identifying the one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query, and (ii) for each item, the time the user consumed the item, a level of familiarity of the user with the entity;

in response to determining the level of familiarity of the user with the entity is a first level of familiarity:

selecting, based on first rank scores for a plurality of knowledge elements that are related to the entity that is referenced by the search query, a first subset of one or more knowledge elements to include in a knowledge card that is to be presented in a search results page in response to the request,

the first rank scores being determined based on the level of familiarity of the user with the entity being the first level of familiarity, and

the first subset of the one or more knowledge elements being selected based at least on the first rank scores, for the one or more knowledge elements selected for inclusion in the first subset, satisfying a threshold;

in response to determining the level of familiarity of the user with the entity is a second level of familiarity that differs from the first level of familiarity:

selecting, based on second rank scores for the plurality of knowledge elements that are related to the entity that is referenced by the search query, a second subset of one or more additional knowledge elements to include in the knowledge card that is to be presented in the search results page in response to the request,

the second rank scores being determined based on the level of familiarity of the user with the entity being the second level of familiarity, and

the second subset of one or more additional knowledge elements being selected based at least on the second rank scores, for the one or more knowledge elements selected for inclusion in the second subset, satisfying the threshold or an additional threshold, and

at least one knowledge element, included in the second subset of the one or more additional knowledge elements, differing from another knowledge element, included in the first subset of the one or more knowledge elements; and

providing, in response to the request, data that causes the knowledge card, including the one or more knowledge elements, to be presented within the search results page.

2. The method according to claim 1 , further comprising:

identifying, for each item of the one or more items, a prominence of the entity in the item,

wherein determining the level of familiarity of the user with the entity is further based on, for each item, the prominence of the entity in the item.

3. The method according to claim 1 , further comprising:

identifying the plurality of knowledge elements that are related to the entity that is referenced by the search query; and

assigning, based on the level of familiarity of the user with the entity, a corresponding rank score to each of the plurality of knowledge elements.

4. The method according to claim 1 , further comprising:

identifying one or more search results that are determined to be responsive to the search query; and

providing, in response to the request, data that causes the one or more search results that are determined to be responsive to the search query to be presented within the search results page such that a position of the one or more search results that are determined to be responsive to the search query does not overlap with a position of the knowledge card presented within the search results page.

5. The method according to claim 1 , wherein a position of the knowledge card presented within the search results page is a position that is above a position of a listing of search results that are determined to be responsive to the search query and that are presented within the search results page.

6. The method according to claim 1 , wherein a position of the knowledge card presented within the search results page is a position that is below a position of one or more search results that are determined to be responsive to the search query that are presented within the search results page.

7. The method according to claim 1 , wherein a position of the knowledge card presented within the search results page is a position that is beside a listing of one or more search results that are determined to be responsive to the search query that are presented within the search results page.

8. The method according to claim 1 , wherein determining the level of familiarity of the user with the entity is further based on a count of the one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query.

9. The method according to claim 1 , wherein determining the level of familiarity of the user with the entity is further based on an elapsed time between a first time and a most recent consumption time of one of the one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query.

10. A computer program product comprising one or more non-transitory computer-readable storage media having program instructions collectively stored on the one or more non-transitory computer-readable storage media, the program instructions executable to:

receive a request at a request time that indicates (i) a user that submitted a search query, and (ii) an entity that is referenced by the search query;

identify (i) one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query, and (ii) for each item, a time of when the user consumed the item;

determine, based at least on (i) identifying the one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query, and (ii) for each item, the time the user consumed the item, a level of familiarity of the user with the entity;

in response to determining the level of familiarity of the user with the entity is a first level of familiarity:

select, based on first rank scores for a plurality of knowledge elements that are related to the entity that is referenced by the search query, a first subset of one or more knowledge elements to include in a knowledge card that is to be presented in a search results page in response to the request,

the first rank scores being determined based on the level of familiarity of the user with the entity being the first level of familiarity, and

the first subset of the one or more knowledge elements being selected based at least on the first rank scores, for the one or more knowledge elements selected for inclusion in the first subset, satisfying a threshold;

in response to determining the level of familiarity of the user with the entity is a second level of familiarity that differs from the first level of familiarity:

select, based on second rank scores for the plurality of knowledge elements that are related to the entity that is referenced by the search query, a second subset of one or more additional knowledge elements to include in the knowledge card that is to be presented in the search results page in response to the request,

the second rank scores being determined based on the level of familiarity of the user with the entity being the second level of familiarity, and

the second subset of one or more additional knowledge elements being selected based at least on the second rank scores, for the one or more knowledge elements selected for inclusion in the second subset, satisfying the threshold or an additional threshold, and

at least one knowledge element, included in the second subset of the one or more additional knowledge elements, differing from another knowledge element, included in the first subset of the one or more knowledge elements; and

provide, in response to the request, data that causes the knowledge card, including the one or more knowledge elements, to be presented within the search results page.

11. The computer program product according to claim 10 , wherein:

the program instructions are further executable to identify, for each item of the one or more items, a prominence of the entity in the item; and

determining the level of familiarity of the user with the entity is further based on, for each item, the prominence of the entity in the item.

12. The computer program product according to claim 10 , wherein the program instructions are further executable to:

identify the plurality of knowledge elements that are related to the entity that is referenced by the search query; and

assign, based on the level of familiarity of the user with the entity, a corresponding rank score to each of the plurality of knowledge elements.

13. The computer program product according to claim 10 , wherein the program instructions are further executable to:

identify one or more search results that are determined to be responsive to the search query; and

provide, in response to the request, data that causes the one or more search results that are determined to be responsive to the search query to be presented within the search results page such that a position of the one or more search results that are determined to be responsive to the search query does not overlap with a position of the knowledge card presented within the search results page.

14. The computer program product according to claim 10 , wherein a position of the knowledge card presented within the search results page is a position that is above a position of a listing of search results that are determined to be responsive to the search query and that are presented within the search results page.

15. The computer program product according to claim 10 , wherein a position of the knowledge card presented within the search results page is a position that is below a position of one or more search results that are determined to be responsive to the search query that are presented within the search results page.

16. The computer program product according to claim 10 , wherein a position of the knowledge card presented within the search results page is a position that is beside a listing of one or more search results that are determined to be responsive to the search query that are presented within the search results page.

17. The computer program product according to claim 10 , wherein determining the level of familiarity of the user with the entity is further based on a count of the one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query.

18. The computer program product according to claim 10 , wherein determining the level of familiarity of the user with the entity is further based on an elapsed time between a first time and a most recent consumption time of one of the one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query.

19. A system comprising:

a processor, a computer-readable memory, one or more computer-readable storage media, and program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:

receive a request at a request time that indicates (i) a user that submitted a search query, and (ii) an entity that is referenced by the search query;

identify (i) one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query, and (ii) for each item, a time of when the user consumed the item;

determine, based at least on (i) identifying the one or more items that have been indicated as consumed by the user and that are associated with the entity that is referenced by the search query, and (ii) for each item, the time the user consumed the item, a level of familiarity of the user with the entity;

in response to determining the level of familiarity of the user with the entity is a first level of familiarity:

select, based on first rank scores for a plurality of knowledge elements that are related to the entity that is referenced by the search query, a first subset of one or more knowledge elements to include in a knowledge card that is to be presented in a search results page in response to the request,

the first rank scores being determined based on the level of familiarity of the user with the entity being the first level of familiarity, and

the first subset of the one or more knowledge elements being selected based at least on the first rank scores, for the one or more knowledge elements selected for inclusion in the first subset, satisfying a threshold;

in response to determining the level of familiarity of the user with the entity is a second level of familiarity that differs from the first level of familiarity:

select, based on second rank scores for the plurality of knowledge elements that are related to the entity that is referenced by the search query, a second subset of one or more additional knowledge elements to include in the knowledge card that is to be presented in the search results page in response to the request,

the second rank scores being determined based on the level of familiarity of the user with the entity being the second level of familiarity, and

the second subset of one or more additional knowledge elements being selected based at least on the second rank scores, for the one or more knowledge elements selected for inclusion in the second subset, satisfying the threshold or an additional threshold, and

at least one knowledge element, included in the second subset of the one or more additional knowledge elements, differing from another knowledge element, included in the first subset of the one or more knowledge elements; and

provide, in response to the request, data that causes the knowledge card, including the one or more knowledge elements, to be presented within the search results page.

20. The system according to claim 19 , wherein:

the program instructions are further executable to identify, for each item of the one or more items, a prominence of the entity in the item; and

determining the level of familiarity of the user with the entity is further based on, for each item, the prominence of the entity in the item.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 19, 2023
From: SHARIFI, MATTHEW
To: GOOGLE INC.
Reel/Frame 065282/0868 →
CHANGE OF NAME Recorded Oct 19, 2023
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 065290/0791 →
Continuity (5)
Continuation 16393029 · Apr 24, 2019
Continuation 15173794 · Jun 6, 2016
Division 14133791 · Dec 19, 2013
Provisional Application 61866234 · Aug 15, 2013
Related Publication 20240037137A1 · Feb 1, 2024
References Cited (53)
US 6791580B1 · Abbott et al. · 2004 [cited by applicant]
US 7181444B2 · Porter et al. · 2007 [cited by applicant]
US 7444353B1 · Chen et al. · 2008 [cited by applicant]
US 7746895B2 · Bucher et al. · 2010 [cited by applicant]
US 7937403B2 · Kehl · 2011 [cited by applicant]
US 8180765B2 · Nicolov · 2012 [cited by applicant]
US 8484017B1 · Sharifi et al. · 2013 [cited by applicant]
US 8799814B1 · Bryc et al. · 2014 [cited by applicant]
US 8954448B1 · Durham et al. · 2015 [cited by applicant]
US 9110954B2 · Shen et al. · 2015 [cited by applicant]
US 10198442B2 · Sharifi · 2019 [cited by applicant]
US 10275464B2 · Sharifi · 2019 [cited by applicant]
US 10303779B2 · Sharifi · 2019 [cited by applicant]
US 10332151B2 · Megdal · 2019 [cited by examiner]
US 20030212659A1 · Ban · 2003 [cited by applicant]
US 20050071323A1 · Gabriel et al. · 2005 [cited by applicant]
US 20070192319A1 · Finley et al. · 2007 [cited by applicant]
US 20070239675A1 · Ragno et al. · 2007 [cited by applicant]
US 20080222105A1 · Matheny · 2008 [cited by examiner]
US 20080222295A1 · Robinson et al. · 2008 [cited by applicant]
US 20080275846A1 · Almas · 2008 [cited by applicant]
US 20090164641A1 · Rogers et al. · 2009 [cited by applicant]
US 20100070488A1 · Sylvain · 2010 [cited by applicant]
US 20100161643A1 · Gionis et al. · 2010 [cited by applicant]
US 20100211575A1 · Collins et al. · 2010 [cited by applicant]
US 20110153050A1 · Bauer et al. · 2011 [cited by applicant]
US 20110276396A1 · Rathod · 2011 [cited by applicant]
US 20110314039A1 · Zheleva · 2011 [cited by examiner]
US 20120059495A1 · Weiss et al. · 2012 [cited by applicant]
US 20120059838A1 · Berntson · 2012 [cited by examiner]
US 20120166432A1 · Tseng et al. · 2012 [cited by applicant]
US 20130117259A1 · Ackerman · 2013 [cited by applicant]
US 20130173604A1 · Li · 2013 [cited by examiner]
US 20130212081A1 · Shenoy et al. · 2013 [cited by applicant]
US 20130291025A1 · Ozawa et al. · 2013 [cited by applicant]
US 20130325869A1 · Reiley et al. · 2013 [cited by applicant]
US 20130326406A1 · Reiley et al. · 2013 [cited by applicant]
US 20140095608A1 · Mandalia et al. · 2014 [cited by applicant]
US 20140101142A1 · Gomez Uribe et al. · 2014 [cited by applicant]
US 20140101192A1 · Sabah et al. · 2014 [cited by applicant]
US 20140280112A1 · Cheng · 2014 [cited by examiner]
US 20140280291A1 · Collins et al. · 2014 [cited by applicant]
US 20150052168A1 · Sharifi · 2015 [cited by applicant]
US 20150134334A1 · Sachidanandam et al. · 2015 [cited by applicant]
US 20190251117A1 · Sharifi · 2019 [cited by applicant]
Feng et al., “Speech and Multimodal Interaction in Mobile Search,” IEEE Signal Processing Magazine, IEEE 1-21 NJ, US, Service Center, Piscataway, vol. 28, No. 4; pp. 40-49; dated Jul. 1, 2011. [cited by applicant]
Fink et al* “Social and interactive television applications based on real-time ambient-audio identification”, Proceedings of the EuroITV 2006 Conference, pp. 138-146, ResearchGate. [cited by applicant]
International Preliminary Report on Patentability in International Application No. PCT/US2014/051126, 8 pages; mailed Feb. 25, 2016. [cited by applicant]
International Preliminary Report on Patentability in International Application No. PCT/US2014/051123, 8 pages; mailed Nov. 28, 2014. [cited by applicant]
International Search Report and Written Opinion in International Application No. PCT/US2014/051123, 11 pages; mailed Nov. 28, 2014. [cited by applicant]
Lee. “Analysis of User Needs and Information Features in Natural Language Queries Seeking Music Information,” Journal of the American Society for Information Science and Techonology, 61(5), 42 pages; dated May 1, 2010. [cited by applicant]
Song et al. “Voice search of structured media data,” ICASSP 2009, IEEE International Conference; 4 pages; dated Apr. 19, 2009. [cited by applicant]
TW Office Action in Taiwan Appin. No. 103127977, 12 pages; dated Jun. 13, 2019. [cited by applicant]