Granted Patent B2

US 12,581,015 · App. 18/337,283 · Granted Mar 17, 2026

Inventors: Sasha Goldshtein (Tel Aviv, IL); Yoav Tzur (Tel Aviv, IL)

Assignee: GOOGLE LLC

H04M3/4936H04M1/72454H04M1/72484

Abstract

Claims (78)

1 . A computer-implemented method, comprising:

receiving, via a client device and from a user of the client device, user input to initiate a telephone call;

identifying, based on the user input, an entity to engage with during the telephone call;

determining whether a voice assistant is able to automate the telephone call with the entity on behalf of the user;

in response to determining that the voice assistant is able to automate the telephone call with the entity on behalf of the user and prior to initiating the telephone call:

causing an automated telephone call suggestion element to be rendered via a user interface of the client device,

wherein the automated telephone call suggestion element is selectable and, when selected, causes the voice assistant to automate the telephone call on behalf of the user;

receiving, via the client device and from the user, a user selection of the automated telephone call suggestion element that causes the voice assistant to automate the telephone call on behalf of the user; and

in response to receiving the user selection of the automated telephone call suggestion selectable element that causes the voice assistant to automate the telephone call on behalf of the user:

determining a task to be performed on behalf of the user and during the telephone call, and

causing the voice assistant to initiate and conduct the telephone call to perform the task on behalf of the user.

2 . The method of claim 1 , wherein determining the task to be performed on behalf of the user and during the telephone call comprises:

identifying one or more tasks that are associated with the entity to engage with during the telephone call;

generating, based on the identified one or more tasks, one or more task suggestion elements,

wherein each of the one or more task suggestion elements are selectable and, when selected, causes a respective task of the identified one or more tasks to be determined as the task to be performed on behalf of the user and during the telephone call;

causing the one or more task suggestion elements to be rendered via the user interface of the client device;

receiving, via the client device and from the user, an additional user selection of a particular task suggestion element, of the one or more task suggestion elements, that suggests a particular task; and

determining, based on the additional user selection of the particular task suggestion element, the particular task as the task to be performed on behalf of the user and during the telephone call.

3 . The method of claim 2 , wherein identifying the one or more tasks that are associated with the entity to engage with during the telephone call comprises identifying the one or more tasks based on a type of the entity.

4 . The method of claim 2 , wherein identifying the one or more tasks that are associated with the entity to engage with during the telephone call comprises identifying the one or more tasks based on one or more prior interactions involving the user and the entity.

5 . The method of claim 4 , wherein the one or more prior interactions include a prior message or call between the user and the entity, a browsing history of the user, or a searching history of the user.

6 . The method of claim 1 , wherein causing the voice assistant to initiate and conduct the telephone call to perform the task on behalf of the user comprises:

causing the voice assistant to place the telephone call using an entity telephone number for the entity to engage with during the telephone call; and

during the telephone call:

generating, based on the task to be performed on behalf of the user, one or more instances of synthesized speech audio data that capture synthesized speech of the voice assistant, and

causing the one or more instances of synthesized speech audio data to be audibly rendered via one or more speakers of an additional client device of the entity to engage with during the telephone call.

7 . The method of claim 6 , during the telephone call, further comprising:

generating, based on the one or more instances of synthesized speech audio data and based on one or more instance of audio data that capture speech of a representative of the entity, a transcription of the telephone call; and

causing the transcription of the telephone call to be rendered via the user interface of the client device.

8 . The method of claim 6 , during the telephone call, further comprising:

causing a call participation suggestion element to be graphically rendered via the user interface of the client device,

wherein the call participation suggestion element is selectable and, when selected, causes the user to join the telephone call between the voice assistant and the entity.

9 . The method of claim 1 , further comprising:

determining operating hours that are associated with the entity to engage with during the telephone call; and

in response to determining that a current time is not within the operating hours that are associated with the entity, delaying causing the voice assistant to initiate and conduct the telephone call until a future time that is within the operating hours, wherein the future time is subsequent to the current time.

10 . The method of claim 1 , wherein determining the task to be performed on behalf of the user and during the telephone call comprises:

causing a natural language input field to be graphically rendered via the user interface of the client device, and

determining, based on natural language input provided by the user via the natural language input field, the task to be performed on behalf of the user and during the telephone call.

11 . A system, comprising:

at least one processor; and

memory storing instructions that, when executed, cause the at least one processor to be operable to:

receive, via a client device and from a user of the client device, user input to initiate a telephone call;

identify, based on the user input, an entity to engage with during the telephone call;

determine whether a voice assistant is able to automate the telephone call with the entity on behalf of the user;

in response to determining that the voice assistant is able to automate the telephone call with the entity on behalf of the user and prior to initiating the telephone call:

cause an automated telephone call suggestion element to be rendered via a user interface of the client device,

wherein the automated telephone call suggestion element is selectable and, when selected, causes the voice assistant to automate the telephone call on behalf of the user;

receive, via the client device and from the user, a user selection of the automated telephone call suggestion element that causes the voice assistant to automate the telephone call on behalf of the user; and

in response to receiving the user selection of the automated telephone call suggestion selectable element that causes the voice assistant to automate the telephone call on behalf of the user:

determine a task to be performed on behalf of the user and during the telephone call, and

cause the voice assistant to initiate and conduct the telephone call to perform the task on behalf of the user.

12 . The system of claim 11 , wherein the instructions to determine the task to be performed on behalf of the user and during the telephone call comprise instructions to:

cause a natural language input field to be graphically rendered via the user interface of the client device, and

determine, based on natural language input provided by the user via the natural language input field, the task to be performed on behalf of the user and during the telephone call.

13 . The system of claim 12 , wherein the instructions to determine the task to be performed on behalf of the user and during the telephone call comprise instructions to:

identify one or more tasks that are associated with the entity to engage with during the telephone call;

generate, based on the identified one or more tasks, one or more task suggestion elements,

wherein each of the one or more task suggestion elements are selectable and, when selected, causes a respective task of the identified one or more tasks to be determined as the task to be performed on behalf of the user and during the telephone call;

cause the one or more task suggestion elements to be rendered via the user interface of the client device;

receive, via the client device and from the user, an additional user selection of a particular task suggestion element, of the one or more task suggestion elements, that suggests a particular task; and

determine, based on the additional user selection of the particular task suggestion element, the particular task as the task to be performed on behalf of the user and during the telephone call.

14 . The system of claim 13 , wherein the instructions to identify the one or more tasks that are associated with the entity to engage with during the telephone call comprise instructions to identify the one or more tasks based on a type of the entity.

15 . The system of claim 13 , wherein the instructions to identify the one or more tasks that are associated with the entity to engage with during the telephone call comprise instructions to identify the one or more tasks based on one or more prior interactions involving the user and the entity.

16 . The system of claim 15 , wherein the one or more prior interactions include a prior message or call between the user and the entity, a browsing history of the user, or a searching history of the user.

17 . The system of claim 12 , wherein the instructions to cause the voice assistant to initiate and conduct the telephone call to perform the task on behalf of the user comprise instructions to:

cause the voice assistant to place the telephone call using an entity telephone number for the entity to engage with during the telephone call; and

during the telephone call:

generate, based on the task to be performed on behalf of the user, one or more instances of synthesized speech audio data that capture synthesized speech of the voice assistant, and

cause the one or more instances of synthesized speech audio data to be audibly rendered via one or more speakers of an additional client device of the entity to engage with during the telephone call.

18 . The system of claim 17 , during the telephone call, the instructions further cause the at least one processor to be operable to:

generate, based on the one or more instances of synthesized speech audio data and based on one or more instance of audio data that capture speech of a representative of the entity, a transcription of the telephone call; and

cause the transcription of the telephone call to be rendered via the user interface of the client device.

19 . The system of claim 17 , during the telephone call, the instructions further cause the at least one processor to be operable to:

cause a call participation suggestion element to be graphically rendered via the user interface of the client device,

wherein the call participation suggestion element is selectable and, when selected, causes the user to join the telephone call between the voice assistant and the entity.

20 . The system of claim 12 , the instructions further cause the at least one processor to be operable to:

determine operating hours that are associated with the entity to engage with during the telephone call; and

in response to determining that a current time is not within the operating hours that are associated with the entity, delay causing the voice assistant to initiate and conduct the telephone call until a future time that is within the operating hours, wherein the future time is subsequent to the current time.

Assignments (1)

Continuity (2)

References Cited (145)