Systems and methods for switching operational modes based on audio triggers
Systems and methods are provided for enabling different modes of operation based on a detected audio trigger. The systems and methods may generate an audio signature for a detected first sound and compare the audio signature with a plurality of registered audio signatures. In response to determining that the audio signature matches a first registered audio signature, the systems and methods may enable a first operational mode for a device that enables a first plurality of commands In response to determining that the audio signature matches a second registered audio signature, the systems and methods may enable a second operational mode for a device that enables a second plurality of commands, where the second plurality of commands are different from the first plurality of commands.
1. A method comprising:
operating a voice assistant device in a first mode, wherein: while operating the voice assistant device in the first mode,
the voice assistant device is constrained such that it is limited to detect and respond only to a first set of voice commands; and
receiving a first audio input while operating the voice assistant device in the first mode causes the voice assistant device to:
in response to determining the first audio input matches a voice command of the first set of voice commands, respond to the first audio input; and
in response to determining the first audio input does not match a voice command of the first set of voice commands, ignore the first audio input;
detecting a non-speech second audio input; and
in response to determining that the second audio input matches a stored audio signature associated with a second mode, switching the voice assistant device to operating in the second mode, wherein: while operating in the second mode,
the voice assistant device is constrained such that it is limited to detect and respond only to a second set of voice commands different from the first set of voice commands; and
receiving a third audio input while operating the voice assistant device in the second mode causes the voice assistant device to:
in response to determining the third audio input matches a voice command of the second set of voice commands, responding to the third audio input; and
in response to determining the third audio input does not match a voice command of the second set of voice commands, ignoring the third audio input.
2. The method of claim 1 , further comprising:
retrieving the second set of voice commands associated with the second mode, the second set of voice commands comprising voice commands related to an environment at which the voice assistant device is located.
3. The method of claim 1 , further comprising:
after determining that the voice assistant device is being operated in the first mode, receiving a voice command that is in the first set of voice commands; and
executing an action associated with the voice command that is in the first set of voice commands.
4. The method of claim 1 , further comprising:
determining a first spectrogram of the second audio input;
extracting a first peak point corresponding to a first frequency and a first average power from the first spectrogram;
retrieving a second spectrogram of the stored audio signature; and
extracting a second peak point corresponding to a second frequency and a second average power from the second spectrogram.
5. The method of claim 4 , further comprising:
determining a frequency difference value between the first frequency and the second frequency; and
determining whether the frequency difference value is less than a first threshold.
6. The method of claim 4 , further comprising:
determining a power difference value between the first average power and the second average power; and
determining whether the power difference value is less than a second threshold.
7. The method of claim 5 , further comprising:
based on determining that both the frequency difference value is less than the first threshold and a power difference value is less than a second threshold, determining that the second audio input matches the stored audio signature.
8. The method of claim 1 , wherein the second audio input comprises at least one of a microwave alarm sound or a subway announcement.
9. The method of claim 1 , wherein the second audio input is a trigger to switching from the first mode to the second mode.
10. The method of claim 1 , wherein the first set of voice commands is different than the stored audio signature associated with the second mode.
11. A system comprising:
control circuitry configured to:
operate a voice assistant device in a first mode, wherein: while operating the voice assistant device in the first mode
the voice assistant device is constrained such that it is limited to detect and respond only to a first set of voice commands; and
receiving a first audio input while operating the voice assistant device in the first mode causes the voice assistant device to:
in response to determining the first audio input matches a voice command of the first set of voice commands, respond to the first audio input; and
in response to determining the first audio input does not match a voice command of the first set of voice commands, ignore the first audio input; snd
input/output circuitry configured to:
detect a non-speech second audio input; and
wherein the control circuitry is further configured to:
in response to determining that the second audio input matches a stored audio signature associated with a second mode, switch the voice assistant device to operate in the second mode, wherein: while operating in the second mode
the voice assistant device is constrained such that it is limited to detect and respond only to a second set of voice commands different from the first set of voice commands; and
receiving a third audio input while operating the voice assistant device in the second mode causes the voice assistant device to:
in response to determining the third audio input matches a voice command of the second set of voice commands, respond to the third audio input; and
in response to determining the third audio input does not match a voice command of the second set of voice commands, ignore the third audio input.
12. The system of claim 11 , wherein the control circuitry is further configured to:
retrieve the second set of voice commands associated with the second mode, wherein the second set of voice commands comprises voice commands related to an environment at which the voice assistant device is located.
13. The system of claim 11 , wherein the control circuitry is further configured to:
after determining that the voice assistant device is being operated in the first mode, receive a voice command that is in the first set of voice commands; and
execute an action associated with the voice command that is in the first set of voice commands.
14. The system of claim 11 , wherein the control circuitry is further configured to:
determine a first spectrogram of the second audio input;
extract a first peak point corresponding to a first frequency and a first average power from the first spectrogram;
retrieve a second spectrogram of the stored audio signature; and
extract a second peak point corresponding to a second frequency and a second average power from the second spectrogram.
15. The system of claim 14 , wherein the control circuitry is further configured to:
determine a frequency difference value between the first frequency and the second frequency; and
determine whether the frequency difference value is less than a first threshold.
16. The system of claim 14 , wherein the control circuitry is further configured to:
determine a power difference value between the first average power and the second average power; and
determine whether the power difference value is less than a second threshold.
17. The system of claim 15 , wherein the control circuitry is further configured to:
based on determining that both the frequency difference value is less than the first threshold and a power difference value is less than a second threshold, determine that the second audio input matches the stored audio signature.
18. The system of claim 11 , wherein the second audio input comprises at least one of a microwave alarm sound or a subway announcement.
19. The system of claim 11 , wherein the second audio input is a trigger to switching from the first mode to the second mode.
20. The system of claim 11 , wherein the first set of voice commands is different than the stored audio signature associated with the second mode.