IP Library Granted Patent US 11,423,113
Granted Patent B2
US 11,423,113 · App. 17/073,735 · Granted Aug 23, 2022

Contextual deep bookmarking

Inventors: Mugurel Ionut Andreica (Adliswil, CH); Gokhan H. Bakir (Zurich, CH); Tak Keung Cheng (Los Altos, CA); Marcin M. Nowak-Przygodzki (Zurich, CH)
Assignee: GOOGLE LLC
G06F16/9562G06F3/167G06F16/9566G10L15/22G10L15/26G06F40/134G10L2015/223
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,423,113
App. No.
17/073,735
Granted
Aug 23, 2022
Kind
B2
Abstract

A computer-implemented method is described. The method includes a computing system receiving a first voice input from a user for generating a bookmark. Responsive to receiving the voice input, the computing system obtains a resource identifier associated with a resource page. The method includes the computing system storing the resource identifier as a bookmark in a bookmark index that is accessible in response to a request from a user device. The method further includes the computing system using the resource identifier, stored as the bookmark, to access the resource page. The computing system uses the resource identifier to access the resource page based on the request from the user device. The request is generated by the user device in response to the user device receiving a second voice input from the user.

Claims (114)

1. A computer-implemented method, comprising:

receiving a first voice input from a user;

determining, based on a transcription of the first voice input, that the first voice input indicates:

an application resource page, and

a term or phrase that is to be used in future voice inputs of the user to cause a user device of the user to present the application resource page;

identifying a resource identifier associated with the application resource page and usable by a virtual assistant executing at least partially on the user device to present the application resource page, the identifying comprising:

determining an application identifier for a particular application that corresponds to the application resource page;

identifying, based on the determined application identifier, a resource identifier pattern based on a plurality of previously stored resource identifiers that correspond to the particular application;

generating data indicating information displayed on the user device;

identifying, based on the identified resource identifier pattern and from the generated data indicating the information displayed on the user device, an attribute of the application resource page; and

generating the resource identifier for the application resource page based on the identified resource identifier pattern and the identified attribute;

storing the resource identifier in association with the term or phrase; and

subsequent to storing the resource identifier in association with the term or phrase:

receiving a second voice input from the user;

determining, based on a transcription of the second voice input, that the second voice input indicates the term or phrase that is stored in association with the resource identifier; and

in response to determining that the second voice input indicates the term or phrase:

causing the virtual assistant executing at least partially on the user device to present the application resource page.

2. The method of claim 1 , wherein identifying a resource identifier associated with the application resource page and usable by a virtual assistant executing at least partially on the user device to present the application resource page further comprises:

determining that the resource identifier cannot be obtained from the user device.

3. The method of claim 1 , wherein the first voice input indicates an application resource page of a particular software application, and wherein identifying a resource identifier associated with the application resource page and usable by a virtual assistant executing at least partially on the user device to present the application resource page further comprises:

determining that the resource identifier for the application resource page is not included in an application resource identifier index.

4. The method of claim 1 , wherein the application resource page is currently displayed on the user device when the first voice input is received and when the resource identifier is identified.

5. The method of claim 1 , further comprising:

subsequent to storing the resource identifier in association with the term or phrase:

receiving a second voice input from the user;

determining, based on a transcription of the second voice input, that the second voice input indicates:

a different application resource page, and

a different term or phrase that is to be used in future voice inputs of the user to cause a user device of the user to present the application resource page;

identifying a pattern in a plurality of previously resource identifiers;

generating data indicating information displayed on the user device when the second voice input was received;

generating, based on the identified pattern and the data indicating the information displayed on the user device when the second voice input was received, a different resource identifier for the different application resource page; and

storing the different resource identifier in association with the different term or phrase.

6. The method of claim 1 , further comprising:

subsequent to storing the resource identifier in association with the term or phrase:

receiving a second voice input from a user;

determining, based on a transcription of the first voice input, that the second voice input indicates the term or phrase that is stored in association with the resource identifier; and

in response to determining that the second voice input indicates the term or phrase:

providing, to the user device for graphical output, a notification indicating the resource identifier.

7. A system comprising one or more processors and memory storing instructions that, in response to execution of the instructions by the one or more processors, cause the one or more processors to:

receive a first voice input from a user;

determine, based on a transcription of the first voice input, that the first voice input indicates:

an application resource page, and

a term or phrase that is to be used in future voice inputs of the user to cause a user device of the user to present the application resource page;

identify a resource identifier associated with the application resource page and usable by a virtual assistant executing at least partially on the user device to present the application resource page, the identifying comprising:

determining an application identifier for a particular application that corresponds to the application resource page;

identifying, based on the determined application identifier, a resource identifier pattern based on a plurality of previously stored resource identifiers that correspond to the particular application;

generating data indicating information displayed on the user device;

identifying, based on the identified resource identifier pattern and from the generated data indicating the information displayed on the user device, an attribute of the application resource page; and

generating the resource identifier for the application resource page based on the identified resource identifier pattern and the identified attribute;

store the resource identifier in association with the term or phrase; and

subsequent to storing the resource identifier in association with the term or phrase:

receiving a second voice input from the user;

determine, based on a transcription of the second voice input, that the second voice input indicates the term or phrase that is stored in association with the resource identifier; and

in response to determining that the second voice input indicates the term or phrase:

cause the virtual assistant executing at least partially on the user device to present the application resource page.

8. The system of claim 7 , wherein identifying a resource identifier associated with the application resource page and usable by a virtual assistant executing at least partially on the user device to present the application resource page further comprises:

determining that the resource identifier cannot be obtained from the user device.

9. The system of claim 7 , wherein the first voice input indicates an application resource page of a particular software application, and wherein identifying a resource identifier associated with the application resource page and usable by a virtual assistant executing at least partially on the user device to present the application resource page further comprises:

determining that the resource identifier for the application resource page is not included in an application resource identifier index.

10. The system of claim 7 , wherein the application resource page is currently displayed on the user device when the first voice input is received and when the resource identifier is identified.

11. The system of claim 7 , further comprising instructions to:

subsequent to storing the resource identifier in association with the term or phrase:

receiving a second voice input from the user;

determining, based on a transcription of the second voice input, that the second voice input indicates:

a different application resource page, and

a different term or phrase that is to be used in future voice inputs of the user to cause a user device of the user to present the application resource page;

identifying a pattern in a plurality of previously resource identifiers;

generating data indicating information displayed on the user device when the second voice input was received;

generating, based on the identified pattern and the data indicating the information displayed on the user device when the second voice input was received, a different resource identifier for the different application resource page; and

storing the different resource identifier in association with the different term or phrase.

12. The system of claim 7 , further comprising instructions to:

subsequent to storing the resource identifier in association with the term or phrase:

receiving a second voice input from a user;

determining, based on a transcription of the first voice input, that the second voice input indicates the term or phrase that is stored in association with the resource identifier; and

in response to determining that the second voice input indicates the term or phrase:

providing, to the user device for graphical output, a notification indicating the resource identifier.

13. At least one non-transitory computer-readable storage medium comprising instructions which, when executed by one or more processors, cause a computing device to:

receive a first voice input from a user;

determine, based on a transcription of the first voice input, that the first voice input indicates:

an application resource page, and

a term or phrase that is to be used in future voice inputs of the user to cause a user device of the user to present the application resource page;

identify a resource identifier associated with the application resource page and usable by a virtual assistant executing at least partially on the user device to present the application resource page, the identifying comprising:

determining an application identifier for a particular application that corresponds to the application resource page;

identifying, based on the determined application identifier, a resource identifier pattern based on a plurality of previously stored resource identifiers that correspond to the particular application;

generating data indicating information displayed on the user device;

identifying, based on the identified resource identifier pattern and from the generated data indicating the information displayed on the user device, an attribute of the application resource page; and

generating the resource identifier for the application resource page based on the identified resource identifier pattern and the identified attribute;

store the resource identifier in association with the term or phrase; and

subsequent to storing the resource identifier in association with the term or phrase:

receiving a second voice input from the user;

determine, based on a transcription of the second voice input, that the second voice input indicates the term or phrase that is stored in association with the resource identifier; and

in response to determining that the second voice input indicates the term or phrase:

cause the virtual assistant executing at least partially on the user device to present the application resource page.

14. The at least one non-transitory computer-readable storage medium of claim 13 , wherein identifying a resource identifier associated with the application resource page and usable by a virtual assistant executing at least partially on the user device to present the application resource page further comprises:

determining that the resource identifier cannot be obtained from the user device.

15. The at least one non-transitory computer-readable storage medium of claim 13 , wherein the first voice input indicates an application resource page of a particular software application, and wherein identifying a resource identifier associated with the application resource page and usable by a virtual assistant executing at least partially on the user device to present the application resource page further comprises:

determining that the resource identifier for the application resource page is not included in an application resource identifier index.

16. The at least one non-transitory computer-readable storage medium of claim 13 , wherein the application resource page is currently displayed on the user device when the first voice input is received and when the resource identifier is identified.

17. The at least one non-transitory computer-readable storage medium of claim 13 , further comprising instructions to:

subsequent to storing the resource identifier in association with the term or phrase:

receiving a second voice input from the user;

determining, based on a transcription of the second voice input, that the second voice input indicates:

a different application resource page, and

a different term or phrase that is to be used in future voice inputs of the user to cause a user device of the user to present the application resource page;

identifying a pattern in a plurality of previously resource identifiers;

generating data indicating information displayed on the user device when the second voice input was received;

generating, based on the identified pattern and the data indicating the information displayed on the user device when the second voice input was received, a different resource identifier for the different application resource page; and

storing the different resource identifier in association with the different term or phrase.

18. The at least one non-transitory computer-readable storage medium of claim 13 , further comprising instructions to:

subsequent to storing the resource identifier in association with the term or phrase:

receiving a second voice input from a user;

determining, based on a transcription of the first voice input, that the second voice input indicates the term or phrase that is stored in association with the resource identifier; and

in response to determining that the second voice input indicates the term or phrase:

providing, to the user device for graphical output, a notification indicating the resource identifier.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 19, 2021
From: ANDREICA, MUGUREL IONUT; BAKIR, GOKHAN H.; CHENG, TAK KEUNG; NOWAK-PRZYGODZKI, MARCIN M.
To: GOOGLE INC.
Reel/Frame 055336/0692 →
CHANGE OF NAME Recorded Feb 19, 2021
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 055345/0813 →
Continuity (3)
Continuation 15836599 · Dec 8, 2017
Provisional Application 62486601 · Apr 18, 2017
Related Publication 20210103628A1 · Apr 8, 2021
Cited By (1)
US 12,235,921