IP Library Granted Patent US 11,556,309
Granted Patent B2
US 11,556,309 · App. 17/549,478 · Granted Jan 17, 2023

Virtual assistant configured to automatically customize groups of actions

Inventors: Vikram Aggarwal (Palo Alto, CA); Michael Andrew Goodman (Oakland, CA)
Assignee: GOOGLE LLC
G06F3/167G06F9/453G06Q10/10
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,556,309
App. No.
17/549,478
Granted
Jan 17, 2023
Kind
B2
Abstract

A method includes determining, by an assistant executing at one or more processors, a default group of actions that the assistant is configured to execute in response to receiving a particular audible command. The method includes determining, by the assistant, based on the default group of actions and a user profile associated with a particular user, a custom group of actions that the assistant is configured to execute in response to receiving the particular audible command from the particular user. The method also includes receiving, by the assistant, an indication of the particular audible command, and determining, by the assistant, whether the indication of particular audible command originated from the particular user. The method further includes, responsive to determining that the indication of particular audible command originated from the particular user, executing, by the assistant, each action from the custom group of actions.

Claims (66)

1. A method comprising:

determining, by an assistant executing at least in part on a computing device of a user, a default group of actions for a routine that the assistant is configured to execute in response to satisfaction of a particular condition;

receiving, by the computing device of the user, a notification associated with an application installed on the computing device of the user;

determining, by the assistant and based on the received notification, to customize the routine for the user for a particular period of time,

wherein customizing the routine for the particular period of time comprises causing an additional action to be performed during the routine when the particular condition is satisfied within the particular period of time, and

wherein the additional action is determined based on the received notification and wherein the additional action is not included in the default group of actions; and

subsequent to customizing the routine for the user for the particular period of time, and during the particular period of time:

receiving, by the assistant, an indication of satisfaction of the condition; and

responsive to receiving the indication of satisfaction of the condition during the particular period of time, executing, by the assistant, the customized routine, including executing the additional action and at least one action from the default group of actions.

2. The method of claim 1 , wherein the particular condition being satisfied comprises determining that a particular command was spoken and was directed to the automated assistant.

3. The method of claim 1 , wherein executing the customized routine, including executing the additional action and at least one action from the default group of actions, includes causing one or more additional computing devices associated with the user to execute the additional action and/or the at least one action from the default group of actions.

4. The method of claim 1 , wherein determining, by the assistant and based on the received notification, to customize the routine for the user for the particular period of time includes:

identifying a user profile, of the user, based on processing image data and/or audio data, and

determining to customize the routine for the user for the particular period of time based on information included in the user profile of the user.

5. The method of claim 1 , further comprising:

subsequent to executing the customized routine responsive to the indication of the satisfaction of the condition, and during the particular period of time:

receiving, by the assistant, a subsequent indication of satisfaction of the condition; and

responsive to receiving the subsequent indication of the satisfaction of the condition, again executing, by the assistant, the customized routine, including executing the additional action and the at least one action from the default group of actions.

6. The method of claim 1 , further comprising:

subsequent to executing the customized routine responsive to the indication of the satisfaction of the condition, and during the particular period of time:

receiving, by the assistant, a subsequent indication of satisfaction of the condition; and

responsive to receiving the subsequent indication of the satisfaction of the condition, executing, by the assistant, the default group of actions for the routine without the additional action, wherein executing the default group of actions for the routine without the additional action is based on the subsequent indication of the satisfaction of the condition being received subsequent to the indication of the satisfaction of the condition.

7. A method, comprising:

determining, by an assistant executing at least in part on a computing device of a user, a default group of actions for a routine, for the user, that the assistant is configured to execute in response to satisfaction of a particular condition;

receiving, by the assistant, an indication that the particular condition is satisfied during a particular time of day;

executing, by the assistant, each action from the default group of actions for the routine responsive to receiving the indication that the particular condition is satisfied; and

subsequent to executing the default group of actions for the routine responsive to receiving the indication that the particular condition is satisfied:

determining, by the assistant and based on receiving the indication that the particular condition is satisfied during the particular time of day, to customize the routine for the user for a particular period of time,

wherein customizing the routine for the particular period of time comprises causing an additional action to be performed during the routine when the particular condition is satisfied within the particular period of time, and

wherein the additional action is determined based on receiving the indication of the particular condition being satisfied and wherein the additional action is not included in the default group of actions, and

wherein the particular period of time corresponds to a threshold amount of time that includes the particular time of day; and

subsequent to customizing the routine for the user for the particular period of time, and during the particular period of time:

receiving, by the assistant, an additional indication that the particular condition is satisfied; and

responsive to receiving the additional indication that particular condition is satisfied during the particular period of time, executing, by the assistant, the customized routine, including executing the additional action and at least one action from the default group of actions.

8. The method of claim 7 , wherein determining the default group of actions for the routine for the user comprises determining the default group of actions based at least on a frequency with which the user uses the computing device to perform one or more actions of the default group of actions.

9. The method of claim 7 , wherein executing the additional action comprises controlling, by the assistant, at least one home automation device.

10. The method of claim 7 , wherein the particular condition being satisfied comprises determining that a particular command was spoken and was directed to the automated assistant.

11. The method of claim 10 , wherein the indication of the particular command is received from at least one home automation device.

12. The method of claim 7 , wherein executing the customized routine, including executing the additional action and at least one action from the default group of actions, includes causing one or more additional computing devices associated with the user to execute the additional action and/or the at least one action from the default group of actions.

13. The method of claim 7 , wherein determining, by the assistant and based on receiving the indication that the particular condition is satisfied during the particular time of day, to customize the routine for the user for the particular period of time includes:

identifying a user profile, of the user, based on processing image data and/or audio data, and

determining to customize the routine for the user for the particular period of time based on information included in the user profile of the user.

14. The method of claim 7 , further comprising:

subsequent to executing the customized routine responsive to the additional indication of the satisfaction of the condition, and during the particular period of time:

receiving, by the assistant, a subsequent indication of satisfaction of the condition; and

responsive to receiving the subsequent indication of the satisfaction of the condition, again executing, by the assistant, the customized routine, including executing the additional action and the at least one action from the default group of actions.

15. The method of claim 7 , further comprising:

subsequent to executing the customized routine responsive to the additional indication of the satisfaction of the condition, and during the particular period of time:

receiving, by the assistant, a subsequent indication of satisfaction of the condition; and

responsive to receiving the subsequent indication of the satisfaction of the condition, executing, by the assistant the default group of actions for the routine without the additional action.

16. A system comprising:

one or more computers and one or more storage devices storing instructions that are operable and when executed by one or more computers, cause the one or more computers to perform actions comprising:

determining, by an assistant executing at least in part on a computing device of a user, a default group of actions for a routine, for the user, that the assistant is configured to execute in response to satisfaction of a particular condition;

receiving, by the assistant, an indication that the particular condition is satisfied during a particular time of day;

executing, by the assistant, each action from the default group of actions for the routine responsive to receiving the indication that the particular condition is satisfied; and

subsequent to executing the default group of actions for the routine responsive to receiving the indication that the particular condition is satisfied:

determining, by the assistant and based on receiving the indication that the particular condition is satisfied during the particular time of day, to customize the routine for the user for a particular period of time,

wherein customizing the routine for the particular period of time comprises causing an additional action to be performed during the routine when the particular condition is satisfied within the particular period of time, and

wherein the additional action is determined based on receiving the indication of the particular condition being satisfied and wherein the additional action is not included in the default group of actions, and

wherein the particular period of time corresponds to a threshold amount of time that includes the particular time of day; and

subsequent to customizing the routine for the user for the particular period of time, and during the particular period of time:

receiving, by the assistant, an additional indication that the particular condition is satisfied; and

responsive to receiving the additional indication that particular condition is satisfied during the particular period of time, executing, by the assistant, the customized routine, including executing the additional action and at least one action from the default group of actions.

17. The system of claim 16 , wherein determining the default group of actions for the routine for the user comprises determining the default group of actions based at least on a frequency with which the user uses the computing device to perform one or more actions of the default group of actions.

18. The system of claim 16 , wherein the indication of the particular command is received from at least one home automation device.

19. The system of claim 16 , wherein executing the additional action comprises controlling, by the assistant, at least one home automation device.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 2, 2022
From: AGGARWAL, VIKRAM; GOODMAN, MICHAEL ANDREW
To: GOOGLE INC.
Reel/Frame 059783/0662 →
CHANGE OF NAME Recorded May 2, 2022
From: GOOGLE INC.
To: GOOGLE LLC
Reel/Frame 059845/0444 →
Continuity (2)
Continuation 15709157 · Sep 19, 2017
Related Publication 20220100465A1 · Mar 31, 2022
Cited By (1)
US 12,327,066