IP Library Granted Patent US 12,443,667
Granted Patent B2
US 12,443,667 · App. 18/598,843 · Granted Oct 14, 2025

Contextual search tool in a browser interface

Inventors: Yana Yushkina (Seattle, WA); Carlos Augusto Marin Capriles (Venice, CA); Gabrielle Chung (Santa Clara, CA); John Oliver Por (San Francisco, CA); Tarun Bansal (Bellevue, WA); Greg Duman Schechter (Los Angeles, CA); Allison Stanfield (Beaverton, OR); Anudeep Palanki (Sammamish, WA); Michael Blair Crouse (Seattle, WA); Frank Goodman (San Francisco, CA); Thomas Lukaszewicz (Manly, AU); Timothy Sohn (Los Altos, CA); Wilson Shih-Wei Sun (Shoreline, WA); Juan Alberto Mojica (Alhambra, CA); Duncan Andres Mercer (Orange, CA); Justin Gabriel Donnelly (Westlake Village, CA); Leonardo Jesus Peña (Marina Del Rey, CA); Jason Xia Hu (Santa Monica, CA); Lilyana Simeonova Mihalkova (Los Angeles, CA); Ji Young Lee (Sunnyvale, CA); Gabriel Mintzer Bender (Mountain View, CA); Behzad Golshan (Los Altos, CA); Bhavesh Sethi (Mountain View, CA)
Assignee: GOOGLE LLC
G06F16/9532G06F9/44526G06F16/9574
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,443,667
App. No.
18/598,843
Granted
Oct 14, 2025
Kind
B2
Abstract

A browser-based tool is disclosed for providing context-based assistance during web browsing. An example method involves receiving a contextual search request pertaining to main content displayed in a browser's display area, extracting content from the main content, receiving a contextual suggestion based on the extracted content, and displaying the contextual suggestion in a designated contextual search area within the browser. This innovative approach streamlines the search process by providing users with relevant suggestions based on the content they are currently viewing, thereby improving efficiency in navigating online information.

Claims (66)

1. A computer-implemented method, comprising:

receiving a contextual search request relating to main content, the main content being displayed in a display area of a browser;

extracting at least some content from the main content;

receiving a contextual suggestion associated with the at least some content; and

as a response to the contextual search request, causing display of the contextual suggestion in a contextual search area within the browser.

2. The method of claim 1 , wherein the contextual suggestion is based on a category of the main content that is determined based on the at least some content.

3. The method of claim 1 , wherein the contextual suggestion is one of a plurality of contextual suggestions and the plurality of contextual suggestions are ordered based on a category of the main content that is determined based on the at least some content.

4. The method of claim 1 , wherein the contextual suggestion is a search suggestion and the method further comprises:

receiving a selection of the search suggestion;

obtaining a search result page using the search suggestion as a query;

causing display of the search result page in the contextual search area;

receiving a selection of a search result from the search result page;

fetching second main content for a resource associated with the search result;

extracting second content from the second main content;

receiving a second contextual suggestion associated with the second content; and

causing display of the second contextual suggestion in the contextual search area.

5. The method of claim 1 , wherein the at least some content is identified by a model trained to exclude user information from the at least some content.

6. The method of claim 1 , wherein the at least some content is identified by a model trained to exclude information provided by an entity not associated with a provider of the main content from the at least some content.

7. The method of claim 1 , wherein the contextual suggestion includes generated content describing an entity identified in the at least some content.

8. The method of claim 1 , wherein the contextual suggestion is a suggested search related to an entity identified in the at least some content.

9. The method of claim 1 , wherein the contextual suggestion is a description of the main content.

10. The method of claim 1 , further comprising:

detecting a scrolling input; and

in response to detecting the scrolling input, changing the contextual suggestion based on the main content in a viewport of the display area.

11. The method of claim 10 , wherein changing the contextual suggestion includes:

re-extracting content from the main content now in the viewport; and

receiving a contextual suggestion associated with the re-extracted content.

12. The method of claim 10 , wherein the contextual suggestion is a first contextual suggestion of a plurality of contextual suggestions and changing the contextual suggestion includes:

re-ordering the plurality of contextual suggestions based on the scrolling input; and

replacing the first contextual suggestion with a second contextual suggestion of the plurality of contextual suggestions based on the re-ordering.

13. The method of claim 1 , wherein the at least some content includes an indication of content that is visible in a viewport, wherein the content that is visible in the viewport has a higher weight in determining the contextual suggestion than content not visible in the viewport.

14. A computer-implemented method, comprising:

receiving a contextual search request for main content, the main content being displayed in a display area of a browser;

receiving a prompt input;

extracting content from the main content;

receiving generated content based on the prompt input and the extracted content; and

causing display of the generated content in a contextual search area that is within the browser.

15. The method of claim 14 , further comprising:

receiving a selected region of the main content,

wherein the selected region is used as the prompt input.

16. The method of claim 15 , wherein the selected region is a region determined to correspond to an object and receiving the selected region includes:

detecting a hover input over the region;

in response to detecting the hover input, changing an appearance of the region during the hover input; and

receiving a selection of the region.

17. The method of claim 14 , further comprising:

providing a condensed contextual search area with a dialog input area,

wherein the prompt input is received in the dialog input area.

18. The method of claim 14 , wherein the generated content includes a search suggestion and the method further comprises:

receiving a selection of the search suggestion;

sending a query associated with the search suggestion to a search engine;

receiving a search result page for the query; and

causing display of the search result page in the contextual search area.

19. The method of claim 18 , further comprising:

receiving a selection of a search result from the search result page;

fetching second main content for a resource associated with the search result;

extracting second content from the second main content;

receiving a contextual suggestion associated with the second content in response to providing the content to the search engine; and

causing display of the contextual suggestion in the contextual search area.

20. The method of claim 14 , wherein the generated content is determined based on the extracted content, the prompt input, and preference information.

21. The method of claim 14 , wherein the extracted content is identified by a model trained to exclude user information from the extracted content.

22. The method of claim 14 , wherein the extracted content is identified by a model trained to exclude information provided by an entity not associated with a provider of the main content from the extracted content.

23. The method of claim 14 , wherein the prompt input identifies an entity and the generated content includes information about the entity.

24. The method of claim 14 , further comprising:

receiving contextual search suggestions based on the extracted content; and

causing display of the contextual search suggestions with the generated content in the contextual search area.

25. The method of claim 14 , wherein the generated content relates to an entity identified in the extracted content.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2024
From: YUSHKINA, YANA; CAPRILES, CARLOS AUGUSTO MARIN; CHUNG, GABRIELLE; POR, JOHN OLIVER; BANSAL, TARUN; SCHECHTER, GREG DUMAN; STANFIELD, ALLISON; PALANKI, ANUDEEP; CROUSE, MICHAEL BLAIR; GOODMAN, FRANK; LUKASZEWICZ, THOMAS; SOHN, TIMOTHY; SUN, WILSON SHIH-WEI; MOJICA, JUAN ALBERTO; MERCER, DUNCAN ANDRES; DONNELLY, JUSTIN GABRIEL; PEÑA, LEONARDO JESUS; HU, JASON XIA; MIHALKOVA, LILYANA SIMEONOVA; LEE, JI YOUNG; BENDER, GABRIEL MINTZER; GOLSHAN, BEHZAD; SETHI, BHAVESH
To: GOOGLE LLC
Reel/Frame 066812/0743 →
Continuity (3)
Continuation PCTUS2024016955 · Feb 22, 2024
Provisional Application 63486451 · Feb 22, 2023
Related Publication 20240281481A1 · Aug 22, 2024
References Cited (17)
US 7451152B2 · Kraft · 2008 [cited by examiner]
US 8655872B2 · Kraft · 2014 [cited by examiner]
US 10204163B2 · Gao · 2019 [cited by examiner]
US 11860958B2 · Lee · 2024 [cited by examiner]
US 20020103789A1 · Turnbull · 2002 [cited by examiner]
US 20090083232A1 · Ives · 2009 [cited by examiner]
US 20120158685A1 · White · 2012 [cited by examiner]
US 20150169643A1 · Kogan · 2015 [cited by examiner]
US 20160103876A1 · Bakir · 2016 [cited by examiner]
US 20210365521A1 · Yusuf et al. · 2021 [cited by applicant]
US 20220107802A1 · Rao · 2022 [cited by examiner]
Yang, Yi-Hsuan, et al., “ContextSeer: Context Search and Recommendation at Query Time for Shared Consumer Photos”, MM '08, Vancouver, British Columbia, Canada, Oct. 26-31, 2008, pp. 199-208. [cited by examiner]
Feild, Henry, et al., “Task-Aware Query Recommendation”, SIGIR '13, Dublin. Ireland, Jul. 28-Aug. 1, 2013, pp. 83-92. [cited by examiner]
Rossiello, Gaetano, et al., “Workflow”, Open Computer Science, vol. 9, Issue 1, © 2019, published by De Gruyter, pp. 212-225. [cited by examiner]
Bossetti, Gabriela, et al., “ANDES: An approach to embed search services on the Web Browser”, Computer Standards & Interfaces, vol. 82, Article 103633, Aug. 2022, Elsevier / Science Direct, pp. 1-17. [cited by examiner]
“Document Object Model”, Wikipedia, downloaded from: https://en.wikipedia.org/wiki/Document_Object_Model, Jul. 8, 2025, pp. 1-8. [cited by examiner]
International Search Report and Written Opinion for PCT Application No. PCT/US2024/016955, mailed on Aug. 29, 2024, 13 pages. [cited by applicant]
Cited By (1)
US 12,632,644