IP Library › Granted Patent US 11,574,028
Granted Patent B2
US 11,574,028 · App. 16/972,250 · Granted Feb 7, 2023

Annotation and retrieval of personal bookmarks

Inventors: Mugurel Ionut Andreica (Adliswil, CH); Jonathan Small (Mountain View, CA); Marcin M. Nowak-Przygodzki (Bäch, CH)
Assignee: GOOGLE LLC
G06F16/9562G06F16/9574G06F16/972G06F40/169
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,574,028
App. No.
16/972,250
Granted
Feb 7, 2023
Kind
B2
Abstract

Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for receiving a first input associated with a bookmark and, in response to receiving the first input, obtaining context data for deriving annotations for the bookmark. An annotation engine of a system obtains multiple annotations that are derived using information included in the context data and a transcription of the first input associated with the bookmark. The annotation engine generates an importance value for each annotation. The importance value characterizes a relationship between each annotation and at least one of: the information included in the context data; or the transcription of the first input. The annotation engine generates a set of annotations for retrieving the bookmark. Each annotation in the set of annotations is generated from the obtained multiple annotations and each annotation has an importance value that exceeds a threshold value.

Claims (97)

1. A computer-implemented method, comprising:

receiving, by a computing system, a first input associated with a bookmark;

in response to receiving the input, obtaining, by the computing system, context data for deriving annotations for the bookmark;

wherein the context data for deriving the annotations is obtained from a plurality of data sources;

wherein at least one data source of the plurality of data sources includes information obtained from a search engine based on search queries submitted to the search engine that returned one or more search results that included a resource identifier stored in the bookmark;

obtaining, by an annotation engine of the computing system, multiple annotations that are derived using information included in the context data and a transcription of the first input associated with the bookmark;

generating, by the annotation engine, an importance value for each annotation, the importance value characterizing a relationship between each annotation and at least one of:

i) the information included in the context data; or

ii) the transcription of the first input;

generating, by the annotation engine, a set of annotations for retrieving the bookmark, each annotation in the set of annotations being generated from the obtained multiple annotations and each annotation having an importance value that exceeds a threshold value; and

using, by the computing system, a particular annotation in the set of annotations to retrieve the bookmark for accessing a resource page.

2. The method of claim 1 , wherein using the particular annotation comprises:

receiving, by the computing system, a second input; and

selecting, by the annotation engine and based on the second input, the particular annotation from the set of annotations to cause retrieval of the bookmark; and

using, by the computing system, the particular annotation to retrieve the bookmark for accessing the resource page.

3. The method of claim 2 , wherein selecting comprises:

analyzing a transcription of the second input;

obtaining one or more terms from the transcription of the second input;

for each annotation in the set of annotations:

determining a similarity score that indicates an extent to which terms in the transcription of the second input matches terms in the annotation for retrieving the bookmark; and

selecting the particular annotation based on the similarity score for the annotation exceeding a threshold similarity score.

4. The method of claim 1 , wherein the particular annotation is configured as a trigger to cause retrieval of the bookmark and the method further comprises:

determining, by the computing system, that a trigger condition is satisfied based on analysis of a transcription of a second input;

retrieving, by the computing system, the bookmark from a bookmark index in response to determining that the trigger condition is satisfied; and

providing, by the computing system, the bookmark for display at a client device in response to retrieving the bookmark from the bookmark index.

5. The method of claim 1 , wherein the context data for deriving the annotations further comprises at least one of:

i) an identifier for the bookmark;

ii) the resource identifier stored as the bookmark;

iii) a resource page that is accessed using the resource identifier; or

iv) text of the resource page.

6. The method of claim 5 , wherein the context data for deriving the annotations comprises an N-gram and data describing an entity, each of the N-gram and the data describing the entity being obtained from a plurality of data sources with reference to the transcription of the first input.

7. The method of claim 5 , wherein:

i) the resource page is generated by a web-browser application, and

ii) the resource identifier is a uniform resource locator (URL) that provides a resource address for accessing the resource page.

8. The method of claim 5 , wherein:

i) the resource page is generated by an application accessed using a client device, the application being configured to store one or more deep-links in an application index, and

ii) the resource identifier is a uniform resource locator (URL) for the resource page and is obtained from the application index comprising address data about the application.

9. The method of claim 5 , wherein the resource identifier is at least one of:

a) data identifying a screen image of the resource page generated by an application accessed using a client device, or

b) a deep-link that provides a resource address for accessing the resource page of the application.

10. An electronic system comprising:

one or more processing devices;

one or more non-transitory machine-readable storage devices for storing instructions that are executable by the one or more processing devices to perform operations comprising:

receiving, by a computing system, a first input associated with a bookmark;

in response to receiving the first input, obtaining, by the computing system, context data for deriving annotations for the bookmark;

wherein the context data for deriving the annotations is obtained from a plurality of data sources;

wherein at least one data source of the plurality of data sources comprises information obtained from a search engine based on search queries submitted to the search engine that returned one or more search results that included a resource identifier stored in the bookmark;

obtaining, by an annotation engine of the computing system, multiple annotations that are derived using information included in the context data and a transcription of the first input associated with the bookmark;

generating, by the annotation engine, an importance value for each annotation, the importance value characterizing a relationship between each annotation and at least:

i) the information included in the context data; or

ii) the transcription of the first input;

generating, by the annotation engine, a set of annotations for retrieving the bookmark, each annotation in the set of annotations being generated from the obtained multiple annotations and each annotation having an importance value that exceeds a threshold value; and

using, by the computing system, a particular annotation in the set of annotations to retrieve the bookmark for accessing a resource page.

11. The electronic system of claim 10 , wherein using the particular annotation comprises:

receiving, by the computing system, a second input; and

selecting, by the annotation engine and based on the second input, the particular annotation from the set of annotations to cause retrieval of the bookmark; and

using, by the computing system, the particular annotation to retrieve the bookmark for accessing the resource page.

12. The electronic system of claim 11 , wherein selecting comprises:

analyzing a transcription of the second input;

obtaining one or more terms from the transcription of the second input;

for each annotation in the set of annotations:

determining a similarity score that indicates an extent to which terms in the transcription of the second input matches terms in the annotation for retrieving the bookmark; and

selecting the particular annotation based on the similarity score for the annotation exceeding a threshold similarity score.

13. The electronic system of claim 10 , wherein the particular annotation is configured as a trigger to cause retrieval of the bookmark and the method further comprises:

determining, by the computing system, that a trigger condition is satisfied based on analysis of a transcription of a second input;

retrieving, by the computing system, the bookmark from a bookmark index in response to determining that the trigger condition is satisfied; and

providing, by the computing system, the bookmark for display at a client device in response to retrieving the bookmark from the bookmark index.

14. The electronic system of claim 10 , wherein the plurality of data sources further comprise at least one of:

i) an identifier for the bookmark;

ii) the resource identifier stored as the bookmark;

iii) a resource page that is accessed using the resource identifier; or

iv) text of the resource page.

15. The electronic system of claim 14 , wherein the context data for deriving the annotations comprises an N-gram and data describing an entity, each of the N-gram and the data describing the entity being obtained from a plurality of data sources with reference to the transcription of the first input.

16. The electronic system of claim 14 , wherein:

i) the resource page is generated by a web-browser application, and

ii) the resource identifier is a uniform resource locator (URL) that provides a resource address for accessing the resource page.

17. The electronic system of claim 14 , wherein:

i) the resource page is generated by an application accessed using a client device, the application being configured to store one or more deep-links in an application index, and

ii) the resource identifier is a uniform resource locator (URL) for the resource page and is obtained from the application index comprising address data about the application.

18. The electronic system of claim 14 , wherein the resource identifier is at least one of:

a) data identifying a screen image of the resource page generated by an application accessed using a client device, or

b) a deep-link that provides a resource address for accessing the resource page of the application.

19. One or more non-transitory machine-readable storage devices storing instructions that are executable by one or more processing devices to perform operations comprising:

receiving, by a computing system, a first input associated with a bookmark;

in response to receiving the first input, obtaining, by the computing system, context data for deriving annotations for the bookmark;

wherein the context data for deriving the annotations is obtained from a plurality of data sources;

wherein at least one data source of the plurality of data sources comprises information obtained from a search engine based on search queries that returned one or more search results that included a resource identifier stored in the bookmark;

obtaining, by an annotation engine of the computing system, multiple annotations that are derived using information included in the context data and a transcription of the first input associated with the bookmark;

generating, by the annotation engine, an importance value for each annotation, the importance value characterizing a relationship between each annotation and at least:

i) the information included in the context data; or

ii) the transcription of the first input;

generating, by the annotation engine, a set of annotations for retrieving the bookmark, each annotation in the set of annotations being generated from the obtained multiple annotations and each annotation having an importance value that exceeds a threshold value; and

using, by the computing system, a particular annotation in the set of annotations to retrieve the bookmark for accessing a resource page.

20. The machine-readable storage devices of claim 19 , wherein using the particular annotation comprises:

receiving, by the computing system, a second input; and

selecting, by the annotation engine and based on the second input, the particular annotation from the set of annotations to cause retrieval of the bookmark; and

using, by the computing system, the particular annotation to retrieve the bookmark for accessing the resource page.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 28, 2021
From: ANDREICA, MUGUREL IONUT; SMALL, JONATHAN; NOWAK-PRZYGODZKI, MARCIN M.
To: GOOGLE LLC
Reel/Frame 055065/0585 →
Continuity (2)
Provisional Application 62691061 · Jun 28, 2018
Related Publication 20210240793A1 · Aug 5, 2021
Cited By (1)
US 12,608,549