Granted Patent B2

US 12,230,291 · App. 18/460,141 · Granted Feb 18, 2025

Inventors: Connor Kristopher Smith (New Hudson, MI); Kurt Thomas Soto (Ventura, CA); Charles Conor Sleith (Waltham, MA)

Assignee: Sonos, Inc.

G10L25/84G10L21/0208G10L25/03H04R3/00G10L2021/02082

Abstract

Claims (85)

1. A network microphone device (NMD) comprising:

one or more processors;

one or more microphones; and

data storage having instructions thereon that, when executed by the one or more processors, cause the NMD to perform operations comprising:

detecting sound via the one or more microphones;

capturing sound data based on the detected sound, wherein the sound data includes a voice input;

analyzing the sound data to detect a wake word;

capturing metadata associated with the sound data, wherein the voice input is not derivable from the metadata;

obtaining an intent based on the voice input;

performing a command based on the intent; and

based on the metadata, modifying at least one performance parameter of the NMD.

2. The NMD of claim 1 , wherein obtaining the intent comprises:

transmitting the sound data to one or more remote computing devices associated with a voice assistant service (VAS) to determine the intent based on the voice input; and

receiving a response from at least one of the one or more remote computing devices associated with the VAS, wherein the response is indicative of the determined intent.

3. The NMD of claim 1 , wherein modifying the at least one performance parameter comprises modifying audio playback characteristics of the NMD.

4. The NMD of claim 1 , wherein modifying the at least one performance parameter comprises at least one of:

adjusting a fixed gain of the NMD;

adjusting a wake-word detection sensitivity parameter of the NMD;

adjusting a noise-reduction parameter of the NMD;

adjusting an acoustic echo cancellation parameter of the NMD;

adjusting a spatial processing algorithm of the NMD;

adjusting a localization algorithm of the NMD; or

disregarding input from a defective microphone.

5. The NMD of claim 1 , wherein the operations further comprise determining at least one characteristic of the sound data based on the metadata.

6. The NMD of claim 1 , wherein the metadata comprises one or more of:

microphone frequency response data,

microphone spectral data,

acoustic echo cancellation (AEC) data,

echo return loss enhancement (ERLE) data,

arbitration data,

signal level data, or

direction detection data.

7. The NMD of claim 1 , wherein modifying the at least one performance parameter comprises adjusting one or more parameters of a multi-channel Wiener filter spatial processing algorithm of the NMD.

8. A method to be performed by a network microphone device (NMD), the method comprising:

detecting sound via one or more microphones of the NMD;

capturing sound data based on the detected sound, wherein the sound data includes a voice input;

analyzing the sound data to detect a wake word;

capturing metadata associated with the sound data, wherein the voice input is not derivable from the metadata;

obtaining an intent based on the voice input;

performing a command based on the intent; and

based on the metadata, modifying at least one performance parameter of the NMD.

9. The method of claim 8 , wherein obtaining the intent comprises:

transmitting the sound data to one or more remote computing devices associated with a voice assistant service (VAS) to determine the intent based on the voice input; and

receiving a response from at least one of the one or more remote computing devices associated with the VAS, wherein the response is indicative of the determined intent.

10. The method of claim 8 , wherein modifying the at least one performance parameter comprises modifying audio playback characteristics of the NMD.

11. The method of claim 8 , wherein modifying the at least one performance parameter comprises at least one of:

adjusting a fixed gain of the NMD;

adjusting a wake-word detection sensitivity parameter of the NMD;

adjusting a noise-reduction parameter of the NMD;

adjusting an acoustic echo cancellation parameter of the NMD;

adjusting a spatial processing algorithm of the NMD;

adjusting a localization algorithm of the NMD; or

disregarding input from a defective microphone.

12. The method of claim 8 , further comprising determining at least one characteristic of the sound data based on the metadata.

13. The method of claim 8 , wherein the metadata comprises one or more of:

microphone frequency response data,

microphone spectral data,

acoustic echo cancellation (AEC) data,

echo return loss enhancement (ERLE) data,

arbitration data,

signal level data, or

direction detection data.

14. The method of claim 8 , wherein modifying the at least one performance parameter comprises adjusting one or more parameters of a multi-channel Wiener filter spatial processing algorithm of the NMD.

15. A tangible, non-transitory, computer-readable medium having stored therein instructions executable by one or more processors to cause a network microphone device (NMD) to perform operations comprising:

detecting sound via one or more microphones of the NMD;

capturing sound data based on the detected sound, wherein the sound data includes a voice input;

analyzing the sound data to detect a wake word;

capturing metadata associated with the sound data, wherein the voice input is not derivable from the metadata;

obtaining an intent based on the voice input;

performing a command based on the intent; and

based on the metadata, modifying at least one performance parameter of the NMD.

16. The computer-readable medium of claim 15 , wherein obtaining the intent comprises:

transmitting the sound data to one or more remote computing devices associated with a voice assistant service (VAS) to determine the intent based on the voice input; and

receiving a response from at least one of the one or more remote computing devices associated with the VAS, wherein the response is indicative of the determined intent.

17. The computer-readable medium of claim 15 , wherein modifying the at least one performance parameter comprises modifying audio playback characteristics of the NMD.

18. The computer-readable medium of claim 15 , wherein modifying the at least one performance parameter comprises at least one of:

adjusting a fixed gain of the NMD;

adjusting a wake-word detection sensitivity parameter of the NMD;

adjusting a noise-reduction parameter of the NMD;

adjusting an acoustic echo cancellation parameter of the NMD;

adjusting a spatial processing algorithm of the NMD;

adjusting a localization algorithm of the NMD; or

disregarding input from a defective microphone.

19. The computer-readable medium of claim 15 , wherein the operations further comprise determining at least one characteristic of the sound data based on the metadata.

20. The computer-readable medium of claim 15 , wherein modifying the at least one performance parameter comprises adjusting one or more parameters of a multi-channel Wiener filter spatial processing algorithm of the NMD.

Assignments (2)

Continuity (3)

References Cited (400)

Cited By (2)

US 12,437,776 US 12,730,606