Method, apparatus, and system for automatically monitoring for voice input based on context
In one implementation, a computer-implemented method includes detecting a current context associated with a mobile computing device and determining, based on the current context, whether to switch the mobile computing device from a current mode of operation to a second mode of operation during which the mobile computing device monitors ambient sounds for voice input that indicates a request to perform an operation. The method can further include, in response to determining whether to switch to the second mode of operation, activating one or more microphones and a speech analysis subsystem associated with the mobile computing device so that the mobile computing device receives a stream of audio data. The method can also include providing output on the mobile computing device that is responsive to voice input that is detected in the stream of audio data and that indicates a request to perform an operation.
1. A method comprising:
detecting a context associated with a mobile computing device;
determining, based at least on the context associated with the mobile computing device, to automatically switch from a first mode of operation in which ambient sounds are not monitored to determine whether the ambient sounds include one or more trigger terms that correspond to a request from a user for the mobile computing device to perform an operation, to a second mode of operation in which the ambient sounds are monitored to determine whether the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform an operation;
in response to determining to automatically switch to the second mode of operation, activating one or more microphones to receive the ambient sounds, and activating a speech analysis system for determining whether the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform the operation;
receiving data indicating that the speech analysis system has determined that the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform the operation; and
based at least on receiving the data indicating that the speech analysis system has determined that the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform the operation, providing an output that is responsive to the request.
2. The method of claim 1 including using the mobile computing device in conjunction with a separate computer system to monitor for voice input indicating the request from the user for the mobile computing device to perform an operation.
3. The automated method of claim 1 including processing the request from the user for the mobile computing device to perform operation by the mobile computing device interacting with an information server system.
4. The method of claim 1 including providing the output on an output device separate from the mobile computing device.
5. The method of claim 1 including providing the output on a display.
6. The method of claim 1 wherein the context associated with the mobile computing device indicates a physical location at which the mobile computing device is located.
7. The method of claim 1 wherein the context associated with the mobile computing device indicates that the mobile computing device is located in a vehicle.
8. The method of claim 1 including detecting that the mobile computing device is traveling in the vehicle based at least in part on a calculated speed of the mobile computing device.
9. The method of claim 1 further including:
automatically determining to switch from the second mode of operation to the first mode of operation; and
in response to automatically determining to switch to the first mode of operation, deactivating the one or more microphones and deactivating the speech analysis system.
10. The method of claim 1 including, after activating the speech analysis system, using the speech analysis system to analyze and determine whether any voice input is present in the audio data received by the one or microphones.
11. The method of claim 1 including displaying a message indicating that audio signal monitoring currently is taking place.
12. A system comprising:
one or more computers and one or more storage devices storing instructions that, when executed by the one or more computers, cause the one or more computers to perform operations comprising:
detecting a context associated with a mobile computing device;
determining, based at least on the context associated with the mobile computing device, to automatically switch from a first mode of operation in which ambient sounds are not monitored to determine whether the ambient sounds include one or more trigger terms that correspond to a request from a user for the mobile computing device to perform an operation, to a second mode of operation in which the ambient sounds are monitored to determine whether the ambient sounds include the one or more trigger terms that correspond to the request from a user for the mobile computing device to perform an operation;
in response to determining to automatically switch to the second mode of operation, activating one or more microphones to receive the ambient sounds, and activating a speech analysis system for determining whether the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform the operation;
receiving data indicating that the speech analysis system has determined that the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform the operation; and
based at least on receiving the data indicating that the speech analysis system has determined that the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform the operation, providing an output that is responsive to the request.
13. The system of claim 12 , the operations including using the mobile computing device in conjunction with a separate computer system to monitor for voice input indicating the request from the user for the mobile computing device to perform an operation.
14. The system of claim 12 , the operations including processing the request from the user for the mobile computing device to perform an operation by the mobile computing device interacting with an information server system.
15. The system of claim 12 , the operations including providing the output on an output device separate from the mobile computing device.
16. The system of claim 12 , the operations including providing the output on a display.
17. A non-transitory computer-readable medium storing software comprising instructions executable by one or more computers which, upon such execution, cause the one or more computers to perform operations comprising:
detecting a context associated with a mobile computing device;
determining, based at least on the context associated with the mobile computing device, to automatically switch from a first mode of operation in which ambient sounds are not monitored to determine whether the ambient sounds include one or more trigger terms that correspond to a request from a user for the mobile computing device to perform an operation, to a second mode of operation in which the ambient sounds are monitored to determine whether the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform an operation;
in response to determining to automatically switch to the second mode of operation, activating one or more microphones to receive the ambient sounds, and activating a speech analysis system for determining whether the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform the operation;
receiving data indicating that the speech analysis system has determined that the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform the operation; and
based at least on receiving the data indicating that the speech analysis system has determined that the ambient sounds include the one or more trigger terms that correspond to the request from the user for the mobile computing device to perform the operation, providing an output that is responsive to the request.
18. The system of claim 17 , the operations including using the mobile computing device in conjunction with a separate computer system to monitor for voice input indicating the request from the user for the mobile computing device to perform an operation.
19. The system of claim 17 , the operations including processing the request from the user for the mobile computing device to perform an operation by the mobile computing device interacting with an information server system.
20. The system of claim 17 , the operations including providing the output on an output device separate from the mobile computing device.