IP Library Granted Patent US 11,212,612
Granted Patent B2
US 11,212,612 · App. 17/008,104 · Granted Dec 28, 2021

Voice control of a media playback system

Inventors: Jonathan P. Lang (Santa Barbara, CA); Mark Plagge (Santa Barbara, CA); Simon Jarvis (Cambridge, MA); Romi Kadri (Cambridge, CA); Yean-Nian Willy Chen (Santa Barbara, CA); Paul Andrew Bates (Santa Barbara, CA); Luis Vega-Zayas (Cambridge, CA); Chistopher Butts (Evanston, IL); Nicholas A. J. Millington (Santa Barbara, CA); Keith Corbin (Santa Barbara, CA)
Assignee: Sonos, Inc.
H04R3/00G06F3/162G06F3/165G06F3/167G10L15/14G10L15/22H04L12/2803H04L12/2809H04R3/12H04R27/00H04R29/007H04S7/301H04S7/303H04W8/005H04W8/24G10L21/02G10L2015/223H04L2012/2849H04R2227/003H04R2227/005H04R2420/07H04W84/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,212,612
App. No.
17/008,104
Granted
Dec 28, 2021
Kind
B2
Abstract

Multiple aspects of systems and methods for voice control and related features and functionality for various embodiments of media playback devices, networked microphone devices, microphone-equipped media playback devices, and speaker-equipped networked microphone devices are disclosed and described herein, including but not limited to designating and managing default networked devices, audio response playback, room-corrected voice detection, content mixing, music service selection, metadata exchange between networked playback systems and networked microphone systems, handling loss of pairing between networked devices, actions based on user identification, and other voice control of networked devices.

Claims (48)

1. A method comprising:

after receiving a voice command via a networked microphone device associated with a media playback system while one or more playback devices in the media playback system are playing audio content, selecting one playback device of the one or more playback devices of the media playback system to play an audio response to the voice command based on (i) a direction of the voice command relative to the networked microphone device and (ii) a proximity of the voice command relative to the networked microphone device;

determining a directionality for the audio response to the voice command based on the direction of the voice command relative to the networked microphone device; and

while the selected one playback device is playing the audio content at a first volume level, causing the selected one playback device to (i) reduce its volume to a second volume level lower than the first volume level and (ii) while playing the audio content at the second volume level, play the audio response according to the determined directionality for the audio response.

2. The method of claim 1 , wherein selecting one playback device of the one or more playback devices of the media playback system to play an audio response comprises causing the networked microphone device to select a determined audio response zone, and wherein playing the audio response according to the determined directionality for the audio response comprises causing the selected one playback device to play the audio response within the determined audio response zone.

3. The method of claim 1 , further comprising:

receiving, from a controller device, an indication of an audio response zone to which the networked microphone device is assigned.

4. The method of claim 1 , further comprising:

sending, to a computing device, an indication of an audio response zone to which the networked microphone device is assigned.

5. The method of claim 1 , further comprising:

applying acoustics of an environment in which the networked microphone device is placed to the received voice command.

6. The method of claim 1 , further comprising:

after receiving an indication of audio content, determining at least one music service from a plurality of music services that supports the audio content; and

causing the at least one music service to transmit the audio content to the media playback system.

7. The method of claim 1 , further comprising:

establishing a metadata exchange channel between the media playback system and the networked microphone device.

8. The method of claim 1 , wherein the media playback system comprises a fallback device, the method further comprising:

before causing the selected one playback device to play the audio response, determining that another playback device is not available to play the audio response.

9. The method of claim 1 , further comprising:

determining that the received voice command was received from a registered user of the media playback system; and

in response to determining that the received voice command was received from the registered user of the media playback system, configuring an instruction for the media playback system based on content from the voice command and information in a user profile for the registered user.

10. The method of claim 1 , wherein the received voice command comprises:

a command word, one or more media variable instances, and one or more zone variable instances.

11. A networked microphone device comprising:

one or more processors; and

tangible, non-transitory computer-readable media comprising instructions encoded therein, wherein the instructions, when executed, configure the networked microphone device to:

after receiving a voice command via a networked microphone device associated with a media playback system while one or more playback devices in the media playback system are playing audio content, select one playback device of the one or more playback devices of the media playback system to play an audio response to the voice command based on (i) a direction of the voice command relative to the networked microphone device and (ii) a proximity of the voice command relative to the networked microphone device;

determine a directionality for the audio response to the voice command based on the direction of the voice command relative to the networked microphone device; and

while the selected one playback device is playing the audio content at a first volume level, cause the selected one playback device to (i) reduce its volume to a second volume level lower than the first volume level and (ii) while playing the audio content at the second volume level, play the audio response according to the determined directionality for the audio response.

12. The networked microphone device of claim 11 , wherein the instructions that configure the networked microphone device to select one playback device of the one or more playback devices of the media playback system to play an audio response comprise instructions that, when executed by the one or more processors, configure the networked microphone device to cause the networked microphone device to select a determined audio response zone, and wherein the instructions that configure the networked microphone device to play the audio response according to the determined directionality for the audio response comprise instructions that, when executed by the one or more processors, configure the networked microphone device to cause the selected one playback device to play the audio response within the determined audio response zone.

13. The networked microphone device of claim 11 , wherein the instructions comprise further instructions that, when executed by the one or more processors, configure the networked microphone device to:

receive, via the networked microphone device from a controller device, an indication of a particular zone to which the networked microphone device is assigned.

14. The networked microphone device of claim 11 , wherein the instructions comprise further instructions that, when executed by the one or more processors, configure the networked microphone device to:

send, via the networked microphone device to a computing device, an indication of a particular zone to which the networked microphone device is assigned.

15. The networked microphone device of claim 11 , wherein the instructions comprise further instructions that, when executed by the one or more processors, configure the networked microphone device to:

apply acoustics of an environment in which the networked microphone device is placed to the received voice command.

16. The networked microphone device of claim 11 , wherein the instructions comprise further instructions that, when executed by the one or more processors, configure the networked microphone device to:

after receiving an indication of audio content, determine at least one music service from a plurality of music services that supports the audio content; and

cause the at least one music service to transmit the audio content to the media playback system.

17. The networked microphone device of claim 11 , wherein the instructions comprise further instructions that, when executed by the one or more processors, configure the networked microphone device to:

establish a metadata exchange channel between the media playback system and the networked microphone device.

18. The networked microphone device of claim 11 , wherein the selected one playback device comprises a fallback device, and wherein the instructions comprise further instructions that, when executed by the one or more processors, configure the networked microphone device to:

before causing the selected one playback device to play the audio response, determine that another playback device is not available to play the audio response.

19. The networked microphone device of claim 11 , wherein the instructions comprise further instructions that, when executed by the one or more processors, configure the networked microphone device to:

determine that the received voice command was received from a registered user of the media playback system; and

in response to determining that the received voice command was received from the registered user of the media playback system, configure an instruction for the media playback system based on content from the voice command and information in a user profile for the registered user.

20. The networked microphone device of claim 11 , wherein the received voice command comprises:

a command word, one or more media variable instances, and one or more zone variable instances.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2021
From: LANG, JONATHAN P.; PLAGGE, MARK; JARVIS, SIMON; KADRI, ROMI; CHEN, YEAN-NIAN WILLY; BATES, PAUL ANDREW; VEGA-ZAYAS, LUIS; BUTTS, CHRISTOPHER; MILLINGTON, NICHOLAS A.J.; CORBIN, KEITH
To: SONOS, INC.
Reel/Frame 058097/0797 →
SECURITY AGREEMENT Recorded Oct 15, 2021
From: SONOS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 058123/0206 →
Cited By (27)
US 12,192,713 US 12,211,490 US 12,212,945 US 12,217,748 US 12,230,291 US 12,236,932 US 12,277,368 US 12,279,096 US 12,283,269 US 12,288,558 US 12,322,390 US 12,327,549 US 12,327,556 US 12,360,734 US 12,375,052 US 12,387,716 US 12,424,220 US 12,438,977 US 12,505,832 US 12,513,479 US 12,518,755 US 12,518,756 US 12,579,978 US 12,626,717 US 12,640,148 US 12,699,543 US 12,711,962