Noise classification for event detection
In one aspect, a network microphone device includes a plurality of microphones and is configured to detect sound via the one or more microphones. The network microphone device may capture sound data based on the detected sound in a first buffer, and capture metadata associated with the detected sound in a second buffer. The network microphone device may classify one or more noises in the detected sound and cause the network microphone device to perform an action based on the classification of the respective one or more noises.
1. A playback device, comprising:
one or more processors;
one or more microphones;
a first buffer;
a second buffer;
a tangible, non-transitory, computer-readable medium storing instructions executable by the one or more processors to cause the playback device to perform operations comprising:
detecting sound via one or more microphones of the playback device, wherein the detected sound incudes a voice utterance;
capturing sound data one or more buffers of the playback device based on the detected sound;
analyzing, via the playback device, the sound data to detect a wake word;
based on the analyzed first sound data, detecting the wake word;
after detecting the wake word, transmitting at least a first portion of the sound data associated with the voice utterance to one or more remote computing devices associated with a voice assistant service;
capturing metadata associated with a second portion of the sound data via the playback device, wherein the wake word is not detected based on the second portion of the sound data;
processing the metadata to classify one or more noises in the sound data; and
performing an action based on the classification of the respective one or more noises.
2. The playback device of claim 1 , wherein the second portion of the sound data does not include the voice utterance.
3. The playback device of claim 1 , wherein processing the metadata comprises locally analyzing the metadata and classifying the one or more noises via the NMD.
4. The playback device of claim 1 , wherein classifying the one or more noises comprises comparing the metadata to reference metadata associated with known noise events.
5. The playback device of claim 1 , wherein performing an action comprises at least one of: playing back a sound via the playback device, sending a notification to a user's mobile computing device, or flashing a light.
6. The playback device of claim 1 , wherein causing the playback device to perform an action is based on at least one of a sound pressure level or a directionality of the sound.
7. The playback device of claim 1 , wherein processing the metadata comprises transmitting the metadata to one or more other remote servers for analyzing the metadata.
8. The playback device of claim 1 , wherein: the first portion of the sound data transmitted to the one or more servers comprises recorded audio; and the metadata comprises spectral information that is temporally disassociated from the recorded audio.
9. A method comprising:
detecting sound via one or more microphones of a playback device, wherein the detected sound incudes a voice utterance;
capturing sound data in one or more buffers of the playback device based on the detected sound;
analyzing, via the playback device, the sound data to detect a wake word;
based on the analyzed sound data, detecting the wake word;
after detecting the wake word, transmitting a first portion of the sound data associated with the voice utterance to one or more remote computing devices associated with a voice assistant service;
capturing metadata associated with a second portion of the sound data via the playback device, wherein the wake word is not detected based on the second portion of the sound data;
processing the metadata to classify one or more noises in the sound data; and
causing the playback device to perform an action based on the classification of the respective one or more noises.
10. The method of claim 9 , wherein the second portion of the sound data does not include the voice utterance.
11. The method of claim 9 , wherein:
the first portion of the sound data transmitted to the one or more servers comprises recorded audio; and
the metadata comprises spectral information that is temporally disassociated from the recorded audio.
12. The method of claim 9 , wherein processing the metadata comprises transmitting the metadata to one or more other remote servers for analyzing the metadata.
13. The method of claim 9 , wherein processing the metadata comprises locally analyzing the metadata and classifying the one or more noises via the playback device.
14. The method of claim 9 , wherein classifying the one or more noises comprises comparing the metadata to reference metadata associated with known noise events.
15. The method of claim 9 , wherein causing the playback device to perform an action comprises at least one of: playing back a sound via the playback device, sending a notification to a user's mobile computing device, or flashing a light.
16. The method of claim 9 , wherein causing the playback device to perform an action is based on at least one of a sound pressure level or a directionality of the sound.
17. Tangible, non-transitory, computer-readable medium storing instructions executable by one or more processors to cause a playback device to perform operations comprising:
detecting sound via one or more microphones of the playback device, wherein the detected sound incudes a voice utterance;
capturing sound data one or more buffers of the playback device based on the detected sound;
analyzing the first sound data to detect a wake word;
based on the analyzed first sound data, detecting the wake word;
after detecting the wake word, transmitting at least a first portion of the sound data associated with the voice utterance to one or more remote computing devices associated with a voice assistant service;
capturing metadata associated with a second portion of the sound data via the playback device, wherein the wake word is not detected based on the second portion of the sound data;
processing the metadata to classify one or more noises in the sound data; and
performing an action based on the classification of the respective one or more noises.
18. The tangible, non-transitory, computer-readable medium of claim 17 , wherein the second portion of the sound data does not include the voice utterance.
19. The tangible, non-transitory, computer-readable medium of claim 17 , wherein:
the first portion of the sound data transmitted to the one or more servers comprises recorded audio; and
the metadata comprises spectral information that is temporally disassociated from the recorded audio.
20. The tangible, non-transitory, computer-readable medium of claim 17 , wherein processing the metadata comprises transmitting the metadata to one or more other remote servers for analyzing the metadata.
21. The tangible, non-transitory, computer-readable medium of claim 17 , wherein processing the metadata comprises locally analyzing the metadata and classifying the one or more noises via the playback device.