IP Library › Granted Patent US 11,302,326
Granted Patent B2
US 11,302,326 · App. 16/845,946 · Granted Apr 12, 2022

Tone interference cancellation

Inventor: Saeed Bagheri Sereshki (Goleta, CA)
Assignee: Sonos, Inc.
G10L15/22G10L15/08G10L21/0208G10L21/0232G10L25/78G10L2015/088G10L2015/223G10L2021/02085H04M3/53H04S7/301
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,302,326
App. No.
16/845,946
Filed
Apr 10, 2020
Granted
Apr 12, 2022
Kind
B2
Art Unit
2657
USPC
704/233
Abstract

Example techniques involve systems with multiple acoustic echo cancellers. An example implementation captures first audio within an acoustic environment and detecting, within the captured first audio content, a wake-word. In response to the wake-word and before playing an acknowledgement tone, the implementation activates (a) a first sound canceller when one or more speakers are playing back audio content or (b) a second sound canceller when the one or more speakers are idle. In response to the wake-word and after activating either (a) the first sound canceller or (b) the second sound canceller, the implementation outputs the acknowledgement tone via the one or more speakers. The implementation captures second audio within the acoustic environment and cancelling the acoustic echo of the acknowledgement tone from the captured second audio using the activated sound canceller.

Claims (83)

1. A system comprising a playback device, wherein the playback device comprises at least one processor and at least one non-transitory computer-readable medium including instructions that are executable by the at least one processor such that the playback device is configured to:

based on one or more speakers of the playback device being currently idle, activate a tone canceller, wherein the playback device activates an echo canceller when the one or more speakers are playing audio other than a particular audible tone and no longer idle, and wherein, while activated, the echo canceller is configured to cancel audio output from the one or more speakers across a plurality of frequency bands;

capture, via one or more microphones, a first portion of a first voice input;

detect, within the first portion of the first voice input, a wake word for a voice assistant;

in response to detection of the wake word within the first portion of the first voice input and after activation of the tone canceller, output, via the one or more speakers, the particular audible tone in acknowledgement of the wake-word detection, wherein the particular audible tone has content in one or more known frequency bands which are a subset of the plurality of frequency bands, and wherein the one or more speakers are no longer idle when outputting the particular audible tone;

capture, via the one or more microphones, a second portion of the first voice input; and

cancel, via the activated tone canceller, the particular audible tone in acknowledgement of the wake-word detection from the captured second portion of the first voice input.

2. The system of claim 1 , wherein the instructions are executable by the at least one processor such that the playback device is further configured to:

based on the one or more speakers of the playback device being currently active in playing audio, activate the echo canceller, wherein the playback device deactivates the tone canceller when the one or more speakers are currently active in playing audio and no longer idle, and wherein the playback device is playing back particular audio content;

capture, via the one or more microphones, a first portion of a second voice input;

detect, within the first portion of the second voice input, a second wake word for the voice assistant;

in response to detection of the wake word within the first portion of the second voice input and after activation of the echo canceller, output, via the one or more speakers, the particular audible tone in acknowledgement of the acknowledgement of the wake-word detection within the first portion of the second voice input;

capture, via the one or more microphones, a second portion of the second voice input; and

cancel, via the activated echo canceller, speaker output within the captured second portion of the second voice input, wherein the speaker output comprises (a) the particular audible tone in acknowledgement of the wake-word detection within the first portion of the second voice input and (b) the particular audio content.

3. The system of claim 1 , wherein the instructions are executable by the at least one processor such that the playback device is further configured to:

detect input data representing a command to mute the one or more microphones; and

based on detection of the input data representing the command to mute the one or more microphones: (i) disable the one or more microphones and deactivate (a) the echo canceller and (b) the tone canceller.

4. The system of claim 1 , wherein the instructions are executable by the at least one processor such that the playback device is further configured to:

detect input data representing a command to de-activate the particular audible tone; and

based on one or more speakers of the playback device being currently idle and detection of the input data representing the command to de-activate the particular audible tone, disable the tone canceller.

5. The system of claim 1 , wherein the instructions that are executable by the at least one processor such that the playback device is configured to activate the tone canceller comprise instructions are executable by the at least one processor such that the playback device is configured to:

activate the tone canceller in response to detection of the wake word within the first portion of the first voice input.

6. The system of claim 1 , wherein the instructions that are executable by the at least one processor such that the playback device is configured to cancel the particular audible tone in acknowledgement of the wake-word detection from the captured second portion of the first voice input comprise instructions are executable by the at least one processor such that the playback device is configured to:

determining a sequence of frames representing the second portion of the first voice input, wherein the instructions are executable by the at least one processor such that the playback device is configured to activate the tone canceller comprise instructions are executable by the at least one processor such that the playback device is configured to:

activate the tone canceller at least one frame before output of the particular audible tone in acknowledgement of the wake-word detection within the first portion of the first voice input.

7. The system of claim 1 , wherein the instructions are executable by the at least one processor such that the playback device is further configured to:

determine whether the one or more speakers are (a) currently active in playing audio or (b) idle based on one or more state variables representing a current playback state of the playback device.

8. A playback device comprising:

one or more speakers;

a network interface;

at least one processor; and

data storage including instructions that are executable by the at least one processor such that the playback device is configured to:

based on the one or more speakers of the playback device being currently idle, activate a tone canceller, wherein the playback device activates an echo canceller when the one or more speakers are playing audio other than a particular audible tone and no longer idle, and wherein, while activated, the echo canceller is configured to cancel audio output from the one or more speakers across a plurality of frequency bands;

capture, via one or more microphones, a first portion of a first voice input;

detect, within the first portion of the first voice input, a wake word for a voice assistant;

in response to detection of the wake word within the first portion of the first voice input and after activation of the tone canceller, output, via the one or more speakers, the particular audible tone in acknowledgement of the wake-word detection, wherein the particular audible tone has content in one or more known frequency bands which are a subset of the plurality of frequency bands, and wherein the one or more speakers are no longer idle when outputting the particular audible tone;

capture, via the one or more microphones, a second portion of the first voice input; and

cancel, via the activated tone canceller, the particular audible tone in acknowledgement of the wake-word detection from the captured second portion of the first voice input.

9. The playback device of claim 8 , wherein the instructions are executable by the at least one processor such that the playback device is further configured to:

based on the one or more speakers of the playback device being currently active in playing audio, activate the echo canceller, wherein the playback device deactivates the tone canceller when the one or more speakers are currently active in playing audio, and wherein the playback device is playing back particular audio content;

capture, via the one or more microphones, a first portion of a second voice input;

detect, within the first portion of the second voice input, a second wake word for the voice assistant;

in response to detection of the wake word within the first portion of the second voice input and after activation of the echo canceller, output, via the one or more speakers, the particular audible tone in acknowledgement of the wake-word detection within the first portion of the second voice input;

capture, via the one or more microphones, a second portion of the second voice input; and

cancel, via the activated echo canceller, speaker output within the captured second portion of the second voice input, wherein the speaker output comprises (a) the particular audible tone in acknowledgement of the wake-word detection within the first portion of the second voice input and (b) the particular audio content.

10. The playback device of claim 8 , wherein the instructions are executable by the at least one processor such that the playback device is further configured to:

detect input data representing a command to mute the one or more microphones; and

based on detection of the input data representing the command to mute the one or more microphones: (i) disable the one or more microphones and deactivate (a) the echo canceller and (b) the tone canceller.

11. The playback device of claim 8 , wherein the instructions are executable by the at least one processor such that the playback device is further configured to:

detect input data representing a command to de-activate the particular audible tone; and

based on the one or more speakers of the playback device being currently idle and detection of the input data representing the command to de-activate the particular audible tone, disable the tone canceller.

12. The playback device of claim 8 , wherein the instructions that are executable by the at least one processor such that the playback device is configured to activate the tone canceller comprise instructions are executable by the at least one processor such that the playback device is configured to:

activate the tone canceller in response to detection of the wake word within the first portion of the first voice input.

13. The playback device of claim 8 , wherein the instructions that are executable by the at least one processor such that the playback device is configured to cancel the particular audible tone in acknowledgement of the wake-word detection from the captured second portion of the first voice input comprise instructions are executable by the at least one processor such that the playback device is configured to:

determining a sequence of frames representing the second portion of the first voice input, wherein the instructions are executable by the at least one processor such that the playback device is configured to activate the tone canceller comprise instructions are executable by the at least one processor such that the playback device is configured to:

activate the tone canceller at least one frame before output of the particular audible tone in acknowledgement of the wake-word detection within the first portion of the first voice input.

14. The playback device of claim 8 , wherein the instructions are executable by the at least one processor such that the playback device is further configured to:

determine whether the one or more speakers are (a) currently active in playing audio or (b) idle based on one or more state variables representing a current playback state of the playback device.

15. A tangible, non-transitory computer-readable medium storing instructions that are executable by at least one processor such that a playback device is configured to:

based on one or more speakers of the playback device being currently idle, activate a tone canceller, wherein the playback device activates an echo canceller when the one or more speakers are playing audio other than a particular audible tone and no longer idle, and wherein, while activated, the echo canceller is configured to cancel audio output from the one or more speakers across a plurality of frequency bands;

capture, via one or more microphones, a first portion of a first voice input;

detect, within the first portion of the first voice input, a wake word for a voice assistant;

in response to detection of the wake word within the first portion of the first voice input and after activation of the tone canceller, output, via the one or more speakers, the particular audible tone in acknowledgement of the wake-word detection, wherein the particular audible tone has content in one or more known frequency bands which are a subset of the plurality of frequency bands, and wherein the one or more speakers are no longer idle when outputting the particular audible tone;

capture, via the one or more microphones, a second portion of the first voice input; and

cancel, via the activated tone canceller, the particular audible tone in acknowledgement of the wake-word detection from the captured second portion of the first voice input.

16. The tangible, non-transitory computer-readable medium of claim 15 , wherein the instructions are executable by the at least one processor such that the playback device is further configured to:

based on the one or more speakers of the playback device being currently active in playing audio, activate the echo canceller, wherein the playback device deactivates the tone canceller when the one or more speakers are currently active in playing audio, and wherein the playback device is playing back particular audio content;

capture, via the one or more microphones, a first portion of a second voice input;

detect, within the first portion of the second voice input, a second wake word for the voice assistant;

in response to detection of the wake word within the first portion of the second voice input and after activation of the echo canceller, output, via the one or more speakers, the particular audible tone in acknowledgement of the wake-word detection within the first portion of the second voice input;

capture, via the one or more microphones, a second portion of the second voice input; and

cancel, via the activated echo canceller, speaker output within the captured second portion of the second voice input, wherein the speaker output comprises (a) the particular audible tone in acknowledgement of the wake-word detection within the first portion of the second voice input and (b) the particular audio content.

17. The tangible, non-transitory computer-readable medium of claim 15 , wherein the instructions are executable by the at least one processor such that the playback device is further configured to:

detect input data representing a command to mute the one or more microphones; and

based on detection of the input data representing the command to mute the one or more microphones: (i) disable the one or more microphones and deactivate (a) the echo canceller and (b) the tone canceller.

18. The tangible, non-transitory computer-readable medium of claim 15 , wherein the instructions that are executable by the at least one processor such that the playback device is further configured to:

detect input data representing a command to de-activate the particular audible tone; and

based on one or more speakers of the playback device being currently idle and detection of the input data representing the command to de-activate the particular audible tone, disable the tone canceller.

19. The tangible, non-transitory computer-readable medium of claim 15 , wherein the instructions that are executable by the at least one processor such that the playback device is configured to activate the tone canceller comprise instructions are executable by the at least one processor such that the playback device is configured to:

activate the tone canceller in response to detection of the wake word within the first portion of the first voice input.

20. The tangible, non-transitory computer-readable medium of claim 15 , wherein the instructions are executable by the at least one processor such that the playback device is configured to cancel the particular audible tone in acknowledgement of the wake-word detection from the captured second portion of the first voice input comprise instructions that are executable by the at least one processor such that the playback device is configured to:

determine a sequence of frames representing the second portion of the first voice input, wherein the instructions are executable by the at least one processor such that the playback device is configured to activate the tone canceller comprise instructions that are executable by the at least one processor such that the playback device is configured to:

activate the tone canceller at least one frame before output of the particular audible tone in acknowledgement of the wake-word detection within the first portion of the first voice input.

Assignments (2)
SECURITY AGREEMENT Recorded Oct 15, 2021
From: SONOS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 058123/0206 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 10, 2020
From: SERESHKI, SAEED BAGHERI
To: SONOS, INC.
Reel/Frame 052368/0446 →
Continuity (2)
Continuation 15718521 · Sep 28, 2017
Related Publication 20200380982A1 · Dec 3, 2020
Cited By (26)
US 12,192,713 US 12,210,801 US 12,211,490 US 12,231,859 US 12,236,932 US 12,288,558 US 12,314,633 US 12,322,390 US 12,340,802 US 12,360,734 US 12,374,334 US 12,375,052 US 12,424,220 US 12,438,977 US 12,462,802 US 12,498,899 US 12,505,832 US 12,513,479 US 12,518,755 US 12,518,756 US 12,562,167 US 12,579,978 US 12,699,543 US 12,711,962 US 12,732,547 US 12,749,486