Granted Patent B2

US 12,327,066 · App. 18/432,921 · Granted Jun 10, 2025

Inventors: Vikram Aggarwal (Palo Alto, CA); Michael Andrew Goodman (Oakland, CA)

Assignee: GOOGLE LLC

G06F3/167G06F9/453G06Q10/10

Abstract

Claims (53)

1. A method comprising:

determining, by an assistant executing at least in part on a computing device, a default group of actions for a routine that the assistant is configured to execute in response to satisfaction of a particular condition;

receiving, by the computing device, a notification associated with an application installed on the computing device;

receiving, by the assistant, an indication of satisfaction of the condition; and determining, by the assistant, based on the received notification, and based on the received indication of satisfaction of the condition, to render a selectable element, wherein selection of the selectable element customizes the routine for a particular period of time,

wherein customizing the routine for the particular period of time comprises causing modification of one or more actions, during the particular period of time once the particular condition is satisfied, during the routine, and

wherein the modification is determined based on the received notification; and

responsive to receiving a selection of the selectable element by a user, customizing the routine for the particular period of time, and executing, during the particular period of time and by the assistant, the customized routine, including executing the modification of the one or more actions and at least one action from the default group of actions.

2. The method of claim 1 , wherein the particular condition being satisfied comprises determining that a particular command was spoken and was directed to the assistant.

3. The method of claim 1 , wherein executing the customized routine, including executing the modification of the one or more actions and at least one action from the default group of actions, includes causing one or more additional computing devices associated with the user to execute the modification of the one or more actions and/or the at least one action from the default group of actions.

4. The method of claim 1 , wherein determining, by the assistant and based on the received notification, to customize the routine for the user for the particular period of time includes:

identifying a user profile, of the user, based on processing image data and/or audio data, and

determining to customize the routine for the user for the particular period of time based on information included in the user profile of the user.

5. The method of claim 1 , further comprising:

subsequent to executing the customized routine responsive to the indication of the satisfaction of the condition, and during the particular period of time:

receiving, by the assistant, a subsequent indication of satisfaction of the condition; and

responsive to receiving the subsequent indication of the satisfaction of the condition, again executing, by the assistant, the customized routine, including executing the modification of the one or more actions and the at least one action from the default group of actions.

6. The method of claim 1 , further comprising:

subsequent to executing the customized routine responsive to the indication of the satisfaction of the condition, and during the particular period of time:

receiving, by the assistant, a subsequent indication of satisfaction of the condition; and

responsive to receiving the subsequent indication of the satisfaction of the condition, executing, by the assistant, the default group of actions for the routine without the modification of the one or more actions, wherein executing the default group of actions for the routine without the modification of the one or more actions is based on the subsequent indication of the satisfaction of the condition being received subsequent to the indication of the satisfaction of the condition.

7. The method of claim 1 , wherein the modification of the one or more actions includes disabling the one or more actions.

8. The method of claim 1 , wherein the modification of the one or more actions includes enabling the one or more actions.

9. The method of claim 8 , further comprising:

determining a relevancy score for the modification of the one or more actions based on one or more characteristics of one or more additional computing devices, wherein determining to render the selectable element is further based on the relevancy score.

10. The method of claim 1 , further comprising:

determining the modification of the one or more actions based on one or more additional computing devices associated with the default group of actions for the routine.

11. The method of claim 10 , wherein the modification of the one or more actions includes a particular modification based on the one or more additional computing devices including a first characteristic, and wherein the modification of the one or more actions includes a second modification based on the one or more additional computing devices including a second characteristic.

12. A system comprising:

one or more computers comprising one or more processors, and one or more storage devices storing instructions that are operable, when executed by the one or more computers, to cause the one or more processors to perform operations comprising:

determining, by an assistant executing at least in part on a computing device, a default group of actions for a routine that the assistant is configured to execute in response to satisfaction of a particular condition;

receiving, by the computing device, a notification associated with an application installed on the computing device;

receiving, by the assistant, an indication of satisfaction of the condition; and determining, by the assistant, based on the received notification, and based on the received indication of satisfaction of the condition, to render a selectable element, wherein selection of the selectable element customizes the routine for a particular period of time,

wherein customizing the routine for the particular period of time comprises causing addition and/or removal of one or more actions, during the particular period of time once the particular condition is satisfied, during the routine, and

wherein the addition and/or removal of the one or more actions is determined based on the received notification; and

responsive to receiving a selection of the selectable element by a user, customizing the routine for the particular period of time, and executing, during the particular period of time and by the assistant, the customized routine, including executing the addition and/or removal of the one or more actions and at least one action from the default group of actions.

13. The system of claim 12 , wherein the particular condition being satisfied comprises determining that a particular command was spoken and was directed to the assistant.

14. The system of claim 12 , wherein executing the customized routine, including executing the addition and/or removal of the one or more actions and at least one action from the default group of actions, includes causing one or more additional computing devices associated with the user to execute an additional action of the one or more actions, or causing one or more additional computing devices associated with the user to not execute a removed action corresponding to the removal of the one or more actions, wherein the removed action is included in the default group of actions.

15. The system of claim 12 , wherein determining, by the assistant and based on the received notification, to customize the routine for the user for the particular period of time includes:

identifying a user profile, of the user, based on processing image data and/or audio data, and

determining to customize the routine for the user for the particular period of time based on information included in the user profile of the user.

16. The system of claim 12 , further comprising:

subsequent to executing the customized routine responsive to the indication of the satisfaction of the condition, and during the particular period of time:

receiving, by the assistant, a subsequent indication of satisfaction of the condition; and

responsive to receiving the subsequent indication of the satisfaction of the condition, again executing, by the assistant, the customized routine, including executing an additional action corresponding to the addition of the one or more actions, or not executing a removed action corresponding to the removal of the one or more actions, wherein the removed action is included in the default group of actions.

17. The system of claim 12 , further comprising:

subsequent to executing the customized routine responsive to the indication of the satisfaction of the condition, and during the particular period of time:

receiving, by the assistant, a subsequent indication of satisfaction of the condition; and

responsive to receiving the subsequent indication of the satisfaction of the condition, executing, by the assistant, the default group of actions for the routine without the addition and/or removal of the one or more actions, wherein executing the default group of actions for the routine without the addition and/or removal of the one or more actions is based on the subsequent indication of the satisfaction of the condition being received subsequent to the indication of the satisfaction of the condition.

18. The system of claim 12 , further comprising:

determining the addition and/or removal of the one or more actions based on one or more additional computing devices associated with the default group of actions for the routine.

19. The system of claim 18 , wherein a particular addition and/or removal of the one or more actions is based on the one or more additional computing devices including a first characteristic, and wherein another particular addition and/or removal of the one or more actions is based on the one or more additional computing devices including a second characteristic.

20. The system of claim 19 , further comprising:

determining a relevancy score for the addition and/or removal of the one or more actions based on one or more characteristics of the one or more additional computing devices, wherein determining to render the selectable element is further based on the relevancy score.

Assignments (2)

Continuity (4)

References Cited (51)