IP Library › Granted Patent US 12,229,127
Granted Patent B2
US 12,229,127 · App. 17/977,601 · Granted Feb 18, 2025

Assistive browsing using context

Inventors: Gokhan H. Bakir (Zurich, CH); Behshad Behzadi (Freienbach, CH); Marcin M. Nowak-Przygodzki (Zurich, CH)
Assignee: GOOGLE LLC
G06F16/24534G06F16/248G06F16/9535G06F40/143H04L67/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,229,127
App. No.
17/977,601
Granted
Feb 18, 2025
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a query provided by a user and comprising one or more terms. Obtaining context data based on at least a portion of a first resource displayed to the user at a time that the query is received. Obtaining a revised query that is based on the query and the context data. Receiving a plurality of search results responsive to the revised query. Automatically, selecting a search result that represents a second resource from the plurality of search results, and providing the second resource for display to the user.

Claims (58)

1. A system comprising:

a user device comprising a processor, a computer-readable memory, one or more computer-readable storage media, and program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:

receive, by the user device, a first query from a user;

provide, by the user device, the first query to a search system;

provide, by the user device to the user, first content of a first resource as a first response to the first query, the first resource being identified by the search system as responsive to the first query;

receive, by the user device, a second query from the user following the providing of the first response;

in response to receiving the second query, identify, by the user device, based on the first content of the first resource having been provided to the user, context data based on the first content of the first resource;

provide, by the user device, to the search system, (i) the second query and (ii) the context data based on the first content of the first resource; and

provide, by the user device to the user, second content of a second resource as a second response to the second query, the second resource being identified by the search system as responsive to a third query, the third query being a revised query generated by the search system based on (i) the second query and (ii) the context data based on the first content of the first resource, the third query including a term that is not included in the first query and is not included in the second query, and the term being based on the context data identified based on the first content of the first resource and provided to the search system by the user device.

2. The system of claim 1 , wherein:

the first query and the second query are spoken queries; and

the first response and the second response are spoken responses.

3. The system of claim 1 , wherein the third query includes a noun that replaces a pronoun in the second query, the noun being included in the context data.

4. The system of claim 1 , the program instructions further being executable to:

rank one or more resources using the context data; and

select the second resource based on the ranking.

5. The system of claim 1 , wherein:

the second content comprises text; and

providing, by the user device to the user, the second content of the second resource as the second response to the second query comprises speaking the text of the second content.

6. The system of claim 1 , the program instructions further being executable to display, by the user device and in response to the second query, the second resource on a display of the user device.

7. The system of claim 6 , wherein displaying, by the user device and in response to the second query, the second resource on the display of the user device comprises providing instructions to cause a web browser on the user device to open a tab and display the second resource in the tab.

8. The system of claim 1 , wherein the context data is not included in the first query and is not included in the second query.

9. The system of claim 1 , wherein the context data is obtained from a portion of the first resource that was viewed by the user.

10. A method, comprising:

receiving, by a user device, a first query from a user;

providing, by the user device, the first query to a search system;

providing, by the user device to the user, first content of a first resource as a first response to the first query, the first resource being identified by the search system as responsive to the first query;

receiving, by the user device, a second query from the user following the providing of the first response;

in response to receiving the second query, based on the first content of the first resource having been provided to the user, identifying, by the user device, context data based on the first content of the first resource;

providing, by the user device, to the search system, (i) the second query and (ii) the context data based on the first content of the first resource; and

providing, by the user device to the user, second content of a second resource as a second response to the second query, the second resource being identified by the search system as responsive to a third query, the third query being a revised query generated by the search system based on (i) the second query and (ii) the context data based on the first content of the first resource, the third query including a term that is not included in the first query and is not included in the second query, and the term being based on the context data identified based on the first content of the first resource and provided to the search system by the user device.

11. The method of claim 10 , wherein:

the first query and the second query are spoken queries; and

the first response and the second response are spoken responses.

12. The method of claim 10 , wherein the third query includes a noun that replaces a pronoun in the second query, the noun being included in the context data.

13. The method of claim 10 , further comprising:

ranking one or more resources using the context data; and

selecting the second resource based on the ranking.

14. The method of claim 10 , wherein:

the second content comprises text; and

providing, by the user device to the user, the second content of the second resource as the second response to the second query comprises speaking the text of the second content.

15. The method of claim 10 , further comprising displaying, by the user device and in response to the second query, the second resource on a display of the user device.

16. The method of claim 15 , wherein displaying, by the user device and in response to the second query, the second resource on the display of the user device comprises providing instructions to cause a web browser on the user device to open a tab and display the second resource in the tab.

17. A computer program product comprising one or more non-transitory computer-readable storage media having program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:

receive, by a user device, a first query from a user;

provide, by the user device, the first query to a search system;

provide, by the user device to the user, first content of a first resource as a first response to the first query, the first resource being identified by the search system as responsive to the first query;

receive, by the user device, a second query from the user following the providing of the first response;

in response to receiving the second query, identify, by the user device, based on the first content of the first resource having been provided to the user, context data based on the first content of the first resource;

provide, by the user device, to the search system, (i) the second query and (ii) the context data based on the first content of the first resource; and

provide, by the user device to the user, second content of a second resource as a second response to the second query, the second resource being identified by the search system as responsive to a third query, the third query being a revised query generated by the search system based on (i) the second query and (ii) the context data based on the first content of the first resource, the third query including a term that is not included in the first query and is not included in the second query, and the term being based on the context data identified based on the first content of the first resource and provided to the search system by the user device.

18. The computer program product according to claim 17 , wherein:

the first query and the second query are spoken queries; and

the first response and the second response are spoken responses.

19. The computer program product according to claim 17 , wherein the third query includes a noun that replaces a pronoun in the second query, the noun being included in the context data.

20. The computer program product according to claim 17 , the program instructions further being executable to:

rank one or more resources using the context data; and

select the second resource based on the ranking.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 1, 2022
From: BAKIR, GOKHAN H.; BEHZADI, BEHSHAD; NOWAK-PRZYGODZKI, MARCIN M.
To: GOOGLE INC.
Reel/Frame 061616/0855 →
CHANGE OF NAME Recorded Nov 1, 2022
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 061833/0695 →
Continuity (4)
Continuation 16667823 · Oct 29, 2019
Continuation 14881336 · Oct 13, 2015
Provisional Application 62063644 · Oct 14, 2014
Related Publication 20230047212A1 · Feb 16, 2023
References Cited (49)
US 6434561B1 · Durst et al. · 2002 [cited by applicant]
US 7409402B1 · Chan et al. · 2008 [cited by applicant]
US 7421441B1 · Chan et al. · 2008 [cited by applicant]
US 7603349B1 · Kraft et al. · 2009 [cited by applicant]
US 7831588B2 · Jones et al. · 2010 [cited by applicant]
US 7917528B1 · Dave · 2011 [cited by examiner]
US 7974964B2 · Cucerzan et al. · 2011 [cited by applicant]
US 8108385B2 · Kraft et al. · 2012 [cited by applicant]
US 8117196B2 · Jones et al. · 2012 [cited by applicant]
US 8489641B1 · Seefeld · 2013 [cited by examiner]
US 9104750B1 · Dhamdhere et al. · 2015 [cited by applicant]
US 10503733B2 · Bakir et al. · 2019 [cited by applicant]
US 20030182258A1 · Sakamoto et al. · 2003 [cited by applicant]
US 20040267730A1 · Dumais et al. · 2004 [cited by applicant]
US 20050033641A1 · Jha et al. · 2005 [cited by applicant]
US 20060248061A1 · Kulakow et al. · 2006 [cited by applicant]
US 20060271524A1 · Tanne · 2006 [cited by examiner]
US 20070038601A1 · Guha · 2007 [cited by examiner]
US 20070038603A1 · Guha · 2007 [cited by applicant]
US 20070174257A1 · Howard · 2007 [cited by applicant]
US 20070286360A1 · Chu et al. · 2007 [cited by applicant]
US 20080133504A1 · Messer · 2008 [cited by examiner]
US 20100105370A1 · Kruzeniski · 2010 [cited by examiner]
US 20100332470A1 · Farkash et al. · 2010 [cited by applicant]
US 20110161309A1 · Lung et al. · 2011 [cited by applicant]
US 20110219319A1 · Chen et al. · 2011 [cited by applicant]
US 20110252343A1 · Broman et al. · 2011 [cited by applicant]
US 20120084279A1 · Driscoll · 2012 [cited by examiner]
US 20130110627A1 · Guha · 2013 [cited by applicant]
US 20130166528A1 · Morris · 2013 [cited by applicant]
US 20130226935A1 · Bai · 2013 [cited by applicant]
US 20140149390A1 · Chen et al. · 2014 [cited by applicant]
US 20140172899A1 · Hakkani-Tur · 2014 [cited by examiner]
US 20140188894A1 · Chechik et al. · 2014 [cited by applicant]
US 20140214820A1 · ODonnell · 2014 [cited by applicant]
US 20150134444A1 · Liang · 2015 [cited by examiner]
US 20200065304A1 · Bakir et al. · 2020 [cited by applicant]
CN 1489740 · 2004 [cited by applicant]
CN 104011721 · 2014 [cited by applicant]
WO 2013130215 · 2013 [cited by applicant]
Hattori et al., Context-Aware Query Refinement for Mobile Web Search, Proceedings of the 2007 International Symposium on Applications and the Internet Workshops (SAINTW'07), pp. 1-4. (Year: 2007). [cited by examiner]
Kawashige et all., Context Matcher: Improved Web Search Using Query Term Context in Source Document and in Search Results APWeb 2006: Frontiers of WWW Research and Development—APWeb 2006 pp. 486-497. (Year: 2006). [cited by examiner]
Anderson, N., Putting Search in Context: Using Dynamically-Weighted Information Fusion to Improve Search Results, 2011 Eighth International Conference on Information Technology: New Generations, pp. 66-71. (Year: 2011). [cited by examiner]
Anderson et al.; Eighth International Conference on Information Technology: New Generations; pp. 66-71; dated 2011. [cited by applicant]
Chinese Patent Office; Office Action issued in Application No. 201580035660; 4 pages; dated Mar. 4, 2020. [cited by applicant]
European Patent Office; International Search Report and Written Opinion in Application No. PCT/US2015/055332; 12 pages; dated Jan. 7, 2017. [cited by applicant]
European Patent Office; International Preliminary Report on Patentability issued in Application No. PCT/US2015/055332; 9 pages; dated Apr. 27, 2017. [cited by applicant]
European Patent Office; Office Action issued in Application No. 15784903.5; 6 pages; dated Mar. 5, 2018. [cited by applicant]
Chinese Patent Office; Office Action issued in Application No. 201580035660.6; 10 pages; dated Feb. 27, 2019. [cited by applicant]