Multiple concurrent voice assistants
Techniques are described herein for concurrent voice assistants. A method includes: providing first and second automated assistants with access to one or more microphones; receiving, from the first automated assistant, an indication that the first automated assistant has initiated a first session, and in response: continuing providing, to the first automated assistant, access to the one or more microphones; discontinuing providing, to the second automated assistant, access to the one or more microphones; and preventing the second automated assistant from accessing one or more portions of an output audio data stream; receiving, from the first automated assistant, an indication that the first session has ended, and in response: continuing providing, to the first automated assistant, access to the one or more microphones; resuming providing, to the second automated assistant, access to the one or more microphones; and resuming providing, to the second automated assistant, the output audio data stream.
1. A computer program product comprising one or more non-transitory computer-readable storage media having program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:
concurrently provide a first automated assistant and a second automated assistant with access to one or more microphones;
receive, from the first automated assistant, an indication that the first automated assistant has initiated a first session;
in response to receiving, from the first automated assistant, the indication that the first automated assistant has initiated the first session:
continue providing, to the first automated assistant, access to the one or more microphones;
discontinue providing, to the second automated assistant, access to the one or more microphones; and
prevent the second automated assistant from accessing one or more portions of an output audio data stream provided for rendering via one or more speakers, the one or more portions including output audio data of the first automated assistant;
receive, from the first automated assistant, an indication that the first session has ended; and
in response to receiving, from the first automated assistant, the indication that the first session has ended:
continue providing, to the first automated assistant, access to the one or more microphones;
resume providing, to the second automated assistant, access to the one or more microphones; and
resume providing, to the second automated assistant, the output audio data stream, wherein the second automated assistant uses the output audio data stream in noise cancellation.
2. The computer program product according to claim 1 , wherein in preventing the second automated assistant from accessing the one or more portions of the output audio data stream the program instructions are executable to:
prevent the second automated assistant from accessing the output audio data stream while the first automated assistant is providing audible output during the first session.
3. The computer program product according to claim 1 , wherein the program instructions are further executable to:
determine that a phone call has been initiated;
in response to determining that the phone call has been initiated, discontinue providing, to the first automated assistant and to the second automated assistant, access to the one or more microphones;
determine that the phone call has ended; and
in response to determining that the phone call has ended, resume providing, to the first automated assistant and to the second automated assistant, access to the one or more microphones.
4. The computer program product according to claim 1 , wherein the program instructions are further executable to:
subsequent to receiving, from the first automated assistant, the indication that the first automated assistant has initiated the first session, and prior to receiving, from the first automated assistant, the indication that the first session has ended:
identify a notification, from the second automated assistant, to be output;
determine a priority of the notification; and
in response to the priority of the notification satisfying a threshold, prior to receiving, from the first automated assistant, the indication that the first session has ended, output the notification.
5. The computer program product according to claim 4 , wherein the program instructions are further executable to:
buffer, in a buffer, the one or more portions of the output audio data stream that include the output audio data of the first automated assistant;
pause presentation of the one or more portions of the output audio data stream that include the output audio data of the first automated assistant, while outputting the notification from the second automated assistant; and
after outputting the notification from the second automated assistant, resume, from the buffer, presentation of the one or more portions of the output audio data stream that include the output audio data of the first automated assistant.
6. The computer program product according to claim 1 , wherein the program instructions are further executable to:
subsequent to receiving, from the first automated assistant, the indication that the first automated assistant has initiated the first session, and prior to receiving, from the first automated assistant, the indication that the first session has ended:
identify a notification, from the second automated assistant, to be output;
determining a priority of the notification; and
in response to the priority of the notification not satisfying a threshold, suppress the notification until receiving, from the first automated assistant, the indication that the first session has ended.
7. The computer program product according to claim 6 , wherein the program instructions are further executable to:
buffer, in a buffer, the notification;
in response to receiving, from the first automated assistant, the indication that the first session has ended, output, from the buffer, the notification.
8. The computer program product according to claim 1 , wherein the program instructions are further executable to:
receive, via a graphical user interface, user interface input that is a request to initiate, on the second automated assistant, a second session;
in response to receiving the user interface input:
cause the second automated assistant to initiate the second session;
continue providing, to the second automated assistant, access to the one or more microphones;
discontinue providing, to the first automated assistant, access to the one or more microphones; and
prevent the first automated assistant from accessing output audio data of the second automated assistant.
9. The computer program product according to claim 1 , wherein the program instructions are further executable to, subsequent to receiving, from the first automated assistant, the indication that the first automated assistant has initiated the first session, and prior to receiving, from the first automated assistant, the indication that the first session has ended:
display, on a graphical user interface, a visual indication that access to the one or more microphones is being provided to the first automated assistant.
10. The computer program product according to claim 1 , wherein the program instructions are further executable to, subsequent to receiving, from the first automated assistant, the indication that the first automated assistant has initiated the first session:
provide an audible indication that access to the one or more microphones is being provided to the first automated assistant.
11. The computer program product according to claim 1 , wherein the program instructions are further executable to, in response to receiving, from the first automated assistant, the indication that the first automated assistant has initiated the first session:
reassign a physical button, that, upon activation, is configured to initiate a session of the second automated assistant, to instead initiate a session of the first automated assistant.
12. A method implemented by one or more processors, the method comprising:
receiving, via one or more microphones, first audio data that captures a first spoken utterance of a user;
concurrently providing the first audio data to a first hotword detector of a first automated assistant and to a second hotword detector of a second automated assistant;
receiving a first confidence score based on a probability, determined by the first hotword detector of the first automated assistant, of a first hotword being present in the first audio data, and a second confidence score based on a probability, determined by the second hotword detector of the second automated assistant, of a second hotword being present in the first audio data;
based on the first confidence score and the second confidence score:
providing, to the first automated assistant, second audio data, received via the one or more microphones, that captures a second spoken utterance of the user that follows the first spoken utterance of the user;
providing an indication that audio from the one or more microphones is being provided to the first automated assistant; and
preventing the second automated assistant from obtaining the second audio data.
13. The method according to claim 12 , wherein:
the first hotword detector processes the first audio data using one or more machine learning models of the first hotword detector to generate a first predicted output that indicates the probability of the first hotword being present in the first audio data; and
the second hotword detector processes the first audio data using one or more machine learning models of the second hotword detector to generate a second predicted output that indicates the probability of the second hotword being present in the first audio data.
14. The method according to claim 13 , wherein:
the first confidence score is higher than the second confidence score; and
the first confidence score satisfies a threshold.
15. The method according to claim 14 , wherein the indication that audio from the one or more microphones is being provided to the first automated assistant is a visual indication that is displayed on a graphical user interface, or an audible indication.
16. A system comprising:
a processor, a computer-readable memory, one or more non-transitory computer-readable storage media, and program instructions collectively stored on the one or more computer-readable storage media, the program instructions executable to:
receive, via one or more microphones, first audio data that captures a first spoken utterance of a user;
concurrently provide the first audio data to a first hotword detector of a first automated assistant and to a second hotword detector of a second automated assistant;
receive a first confidence score based on a probability, determined by the first hotword detector of the first automated assistant, of a first hotword being present in the first audio data, and a second confidence score based on a probability, determined by the second hotword detector of the second automated assistant, of a second hotword being present in the first audio data;
based on the first confidence score and the second confidence score:
provide, to the first automated assistant, second audio data, received via the one or more microphones, that captures a second spoken utterance of the user that follows the first spoken utterance of the user;
provide an indication that audio from the one or more microphones is being provided to the first automated assistant; and
prevent the second automated assistant from obtaining the second audio data.
17. The system according to claim 16 , wherein:
the first hotword detector processes the first audio data using one or more machine learning models of the first hotword detector to generate a first predicted output that indicates the probability of the first hotword being present in the first audio data; and
the second hotword detector processes the first audio data using one or more machine learning models of the second hotword detector to generate a second predicted output that indicates the probability of the second hotword being present in the first audio data.
18. The system according to claim 16 , wherein:
the first confidence score is higher than the second confidence score; and
the first confidence score satisfies a threshold.
19. The system according to claim 16 , wherein the indication that audio from the one or more microphones is being provided to the first automated assistant is a visual indication that is displayed on a graphical user interface, or an audible indication.