IP Library Granted Patent US 11,514,898
Granted Patent B2
US 11,514,898 · App. 17/236,559 · Granted Nov 29, 2022

Voice control of a media playback system

Inventors: Nicholas A. J. Millington (Santa Barbara, CA); Keith Corbin (Boston, MA); Mark Plagge (Santa Barbara, CA)
Assignee: Sonos, Inc.
G10L15/1822G06F3/165G10L15/22G10L15/30H04R27/00G10L2015/088G10L2015/223H04R2227/003H04R2227/005
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,514,898
App. No.
17/236,559
Granted
Nov 29, 2022
Kind
B2
Abstract

An example system is configured to cause a first playback device in a first playback zone to operate in a given playback state including play back of media items identified in a playback queue associated with the first playback zone. The system is also configured to, while the first playback device is operating in the given playback state, (i) receive data corresponding to a detected voice input including an indication of (a) a command word and (b) one or more zone variable instances and (ii) determine, based on the command word and the one or more zone variable instances, an intent to transfer the given playback state to a second playback zone. The system is also configured to transfer the given playback state to the second playback zone, thereby causing a second playback device in the second playback zone to play back the media items identified in the playback queue.

Claims (98)

1. A system comprising:

at least one processor;

at least one microphone;

at least one non-transitory computer-readable medium; and

program instructions stored on the at least one non-transitory computer-readable medium that are executable by the at least one processor such that the system is configured to:

cause a first playback device to play back a media item;

while the first playback device is playing back the media item:

capture, via the at least one microphone, a first voice input comprising (i) a first command word and (ii) a first one or more zone variable instances; and

determine, based on the first command word and the first one or more zone variable instances, a command to transfer playback of the media item to a second playback device;

after determining the command to transfer playback of the media item to the second playback device, cause playback of the media item to be transferred to the second playback device such that the first playback device continues playing back the media item and coordinates with the second playback device to begin playing back the media item in synchrony with the second playback device;

while the first playback device is playing back the media item in synchrony with the second playback device:

capture, via the at least one microphone, a second voice input comprising (i) a second command word and (ii) a second one or more zone variable instances; and

determine, based on the second command word and the second one or more zone variable instances, a command to ungroup the first playback device from the second playback device; and

after determining the command to ungroup the first playback device from the second playback device, cause the first playback device to be ungrouped from the second playback device such that the first playback device discontinues playing back the media item and the second playback device continues playing back the media item.

2. The system of claim 1 , wherein the media item is identified in a playback queue.

3. The system of claim 2 , wherein at least a portion of the playback queue is stored on a remote computing device associated with a cloud-based computing system.

4. The system of claim 2 , wherein the determined command to transfer playback of the media item to the second playback device comprises a command for the second playback device to assume playback responsibility for the playback queue.

5. The system of claim 1 , wherein the first command word is associated with a media playback system command to transfer playback of the media item, at a current playback position, to one or more other playback devices, and wherein the program instructions that are executable by the at least one processor such that the system is configured to cause playback of the media item to be transferred to the second playback device comprise program instructions that are executable by the at least one processor such that the system is configured to cause playback of the media item to be transferred to the second playback device such that the first playback device continues playing back the media item and coordinates with the second playback device to begin playing back the media item in synchrony with the second playback device at the current playback position.

6. The system of claim 1 , wherein the first one or more zone variable instances corresponds to a playback zone that includes at least two playback devices, and wherein the program instructions that are executable by the at least one processor such that the system is configured to cause playback of the media item to be transferred to the second playback device comprise program instructions that are executable by the at least one processor such that the system is configured to cause playback of the media item to be transferred to the playback zone such that the first playback device continues playing back the media item and coordinates with one or more playback devices in the playback zone to begin playing back the media item in synchrony with each playback device in the playback zone.

7. The system of claim 1 , wherein the program instructions that are executable by the at least one processor such that the system is configured to determine, based on the first command word and the first one or more zone variable instances, the command to transfer playback of the media item to the second playback device comprise program instructions that are executable by the at least one processor such that the system is configured to:

convert the captured first voice input from speech to text; and

parse the text to identify the command to transfer playback of the media item to the second playback device.

8. The system of claim 1 , wherein the program instructions that are executable by the at least one processor such that the system is configured to cause playback of the media item to be transferred to the second playback device such that the first playback device coordinates with the second playback device such that the second playback device begins playing back the media item in synchrony with the first playback device comprise program instructions that are executable by the at least one processor such that the first playback device is configured to transmit (i) audio information corresponding to the media item and (ii) playback timing information to the second playback device.

9. The system of claim 1 , wherein the program instructions that are executable by the at least one processor such that the system is configured to cause playback of the media item to be transferred to the second playback device such that the first playback device coordinates with the second playback device such that the second playback device begins playing back the media item in synchrony with the first playback device comprise program instructions that are executable by the at least one processor such that the first playback device is configured to receive, from the second playback device, (i) audio information corresponding to the media item and (ii) playback timing information.

10. The system of claim 1 , wherein the program instructions that are executable by the at least one processor such that the system is configured to cause playback of the media item to be transferred to the second playback device comprise program instructions that are executable by the at least one processor such that system is configured to cause the second playback device to receive an instruction from at least one of the first playback device or a remote computing device, thereby causing the second playback device to play back the media item.

11. The system of claim 1 , wherein one of the first playback device and the second playback device comprises the at least one processor, the at least one microphone, and the at least one non-transitory computer-readable medium.

12. The system of claim 1 , further comprising a third playback device, wherein the third playback device comprises the at least one processor, the at least one microphone, and the at least one non-transitory computer-readable medium.

13. The system of claim 1 , further comprising program instructions stored on the at least one non-transitory computer-readable medium that are executable by the at least one processor such that the system is configured to:

capture, via the at least one microphone, a third voice input comprising (i) a third command word and (ii) a third one or more zone variable instances; and

determine, based on the third command word and the third one or more zone variable instances, a command to begin playback of the media item via the first playback device in a standalone playback mode, wherein the program instructions that are executable by the at least one processor such that the system is configured to cause the first playback device to play back the media item comprise program instructions that are executable by the at least one processor such that the system is configured to:

based on the determined command to begin playback, cause the first playback device to play back the media item in a standalone playback mode.

14. A system comprising:

a first playback device configured to communicate over at least one data network, wherein the first playback device comprises:

at least one processor;

at least one non-transitory computer-readable medium; and

program instructions stored on the at least one non-transitory computer-readable medium that are executable by the at least one processor such that the first playback device is configured to play back a media item; and

at least one computing device configured to communicate over the at least one data network, wherein the at least one computing device comprises:

at least one processor;

at least one non-transitory computer-readable medium;

program instructions stored on the at least one non-transitory computer-readable medium that are executable by the at least one processor of the at least one computing device such that the at least one computing device is configured to:

while the first playback device is playing back the media item:

receive data corresponding to a detected first voice input, wherein the data comprises an indication within the voice input of (i) a first command word and (ii) a first one or more zone variable instances; and

determine, based on the first command word and the first one or more zone variable instances, a command to transfer playback of the media item to a second playback device;

after determining the command to transfer playback of the media item to the second playback device, cause playback of the media item to be transferred to the second playback device such that the first playback device continues playing back the media item and coordinates with the second playback device to begin playing back the media item in synchrony with the second playback device;

while the first playback device is playing back the media item in synchrony with the second playback device:

receive data corresponding to a detected second voice input, wherein the data comprises (i) a second command word and (ii) a second one or more zone variable instances; and

determine, based on the second command word and the second one or more zone variable instances, a command to ungroup the first playback device from the second playback device; and

after determining the command to ungroup the first playback device from the second playback device, cause the first playback device to be ungrouped from the second playback device such that the first playback device discontinues playing back the media item and the second playback device continues playing back the media item.

15. A system comprising:

a first playback device configured to communicate over at least one data network, wherein the first playback device comprises:

at least one processor;

at least one microphone;

at least one non-transitory computer-readable medium; and

program instructions stored on the at least one non-transitory computer-readable medium that are executable by the at least one processor such that the first playback device is configured to:

play back a media item;

while the first playback device is playing back the media item:

capture, via the at least one microphone, a first voice input comprising (i) a first command word and (ii) a first one or more zone variable instances;

determine, based on the first command word and the first one or more zone variable instances, a command to transfer playback of the media item to a second playback device;

after determining the command to transfer playback of the media item to the second playback device, cause playback of the media item to be transferred to the second playback device such that the first playback device continues playing back the media item and coordinates with the second playback device to begin playing back the media item in synchrony with the second playback device;

while the first playback device is playing back the media item in synchrony with the second playback device:

capture, via the at least one microphone, a second voice input comprising (i) a second command word and (ii) a second one or more zone variable instances; and

determine, based on the second command word and the second one or more zone variable instances, a command to ungroup the first playback device from the second playback device; and

after determining the command to ungroup the first playback device from the second playback device, cause the first playback device to be ungrouped from the second playback device such that the first playback device discontinues playing back the media item and the second playback device continues playing back the media item; and

the second playback device configured to communicate over the at least one data network, wherein the second playback device comprises:

at least one processor;

at least one non-transitory computer-readable medium; and

program instructions stored on the at least one non-transitory computer-readable medium of the second playback device that are executable by the at least one processor such that the second playback device is configured to begin playing back the media item.

16. A first playback device comprising:

at least one processor;

at least one microphone;

at least one non-transitory computer-readable medium; and

program instructions stored on the at least one non-transitory computer-readable medium that are executable by the at least one processor such that the first playback device is configured to:

play back a media item;

while the first playback device is playing back the media item:

capture, via the at least one microphone, a first voice input comprising (i) a first command word and (ii) a first one or more zone variable instances; and

determine, based on the first command word and the first one or more zone variable instances, a command to transfer playback of the media item to a second playback device;

after determining the command to transfer playback of the media item to the second playback device, cause playback of the media item to be transferred to the second playback device such that the first playback device continues playing back the media item and coordinates with the second playback device to begin playing back the media item in synchrony with the second playback device;

while the first playback device is playing back the media item in synchrony with the second playback device:

capture, via the at least one microphone, a second voice input comprising (i) a second command word and (ii) a second one or more zone variable instances; and

determine, based on the second command word and the second one or more zone variable instances, a command to ungroup the first playback device from the second playback device; and

after determining the command to ungroup the first playback device from the second playback device, cause the first playback device to be ungrouped from the second playback device such that the first playback device discontinues playing back the media item and the second playback device continues playing back the media item.

17. The first playback device of claim 16 , wherein the media item is identified in a playback queue.

18. The first playback device of claim 17 , wherein at least a portion of the playback queue is stored on a remote computing device associated with a cloud-based computing system.

19. The first playback device of claim 17 , wherein the determined command to transfer playback of the media item to the second playback device comprises a command for the second playback device to assume playback responsibility for the playback queue.

20. The first playback device of claim 16 , wherein the first command word is associated with a media playback system command to transfer playback of the media item, at a current playback position, to one or more other playback devices, and wherein the program instructions that are executable by the at least one processor such that the first playback device is configured to cause playback of the media item to be transferred to the second playback device comprise program instructions that are executable by the at least one processor such that the first playback device is configured to cause playback of the media item to be transferred to the second playback device such that the first playback device continues playing back the media item and coordinates with the second playback device to begin playing back the media item in synchrony with the second playback device at the current playback position.

21. The first playback device of claim 16 , wherein the first one or more zone variable instances corresponds to a playback zone that includes at least two playback devices, and wherein the program instructions that are executable by the at least one processor such that the first playback device is configured to cause playback of the media item to be transferred to the second playback device comprise program instructions that are executable by the at least one processor such that the first playback device is configured to cause playback of the media item to be transferred to the playback zone such that the first playback device continues playing back the media item and coordinates with one or more playback devices in the playback zone to begin playing back the media item in synchrony with each playback device in the playback zone.

22. The first playback device of claim 16 , wherein the program instructions that are executable by the at least one processor such that the first playback device is configured to determine, based on the first command word and the first one or more zone variable instances, the command to transfer playback of the media item to the second playback device comprise program instructions that are executable by the at least one processor such that the first playback device is configured to:

transmit data corresponding to the captured first voice input to a remote computing device over at least one data network; and

receive, from the remote computing device, an indication of the command to transfer playback of the media item to the second playback device such that the first playback device continues playing back the media item and coordinates with the second playback device to begin playing back the media item in synchrony with the second playback device.

23. The first playback device of claim 16 , wherein the program instructions that are executable by the at least one processor such that the first playback device is configured to determine, based on the first command word and the first one or more zone variable instances, the command to transfer playback of the media item to the second playback device comprise program instructions that are executable by the at least one processor such that the first playback device is configured to:

convert the captured first voice input from speech to text; and

parse the text to identify the command to transfer playback of the media item to the second playback device.

24. The first playback device of claim 16 , wherein the program instructions that are executable by the at least one processor such that the first playback device is configured to cause playback of the media item to be transferred to the second playback device such that the first playback device coordinates with the second playback device such that the second playback device begins playing back the media item in synchrony with the first playback device comprise program instructions that are executable by the at least one processor such that the first playback device is configured to transmit (i) audio information corresponding to the media item and (ii) playback timing information to the second playback device.

25. The first playback device of claim 16 , wherein the program instructions that are executable by the at least one processor such that the first playback device is configured to cause playback of the media item to be transferred to the second playback device such that the first playback device coordinates with the second playback device such that the second playback device begins playing back the media item in synchrony with the first playback device comprise program instructions that are executable by the at least one processor such that the first playback device is configured to receive, from the second playback device, (i) audio information corresponding to the media item and (ii) playback timing information.

26. The first playback device of claim 16 , further comprising program instructions stored on the at least one non-transitory computer-readable medium that are executable by the at least one processor such that the first playback device is configured to:

capture, via the at least one microphone, a third voice input comprising (i) a third command word and (ii) a third one or more zone variable instances; and

determine, based on the third command word and the third one or more zone variable instances, a command to begin playback of the media item via the first playback device in a standalone playback mode, wherein the program instructions that are executable by the at least one processor such that the first playback device is configured to play back the media item comprise program instructions that are executable by the at least one processor such that the first playback device is configured to:

based on the determined command to begin playback, play back the media item in a standalone playback mode.

Assignments (2)
SECURITY AGREEMENT Recorded Oct 15, 2021
From: SONOS, INC.
To: JPMORGAN CHASE BANK, N.A.
Reel/Frame 058123/0206 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 30, 2021
From: MILLINGTON, NICHOLAS A.J.; CORBIN, KEITH; PLAGGE, MARK
To: SONOS, INC.
Reel/Frame 057323/0892 →
Continuity (10)
Continuation 17222950 · Apr 5, 2021
Continuation 17087423 · Nov 2, 2020
Continuation 15948541 · Apr 9, 2018
Continuation 15223218 · Jul 29, 2016
Provisional Application 62312350 · Mar 23, 2016
Provisional Application 62298388 · Feb 22, 2016
Provisional Application 62298425 · Feb 22, 2016
Provisional Application 62298350 · Feb 22, 2016
Provisional Application 62298418 · Feb 22, 2016
Related Publication 20210241757A1 · Aug 5, 2021
Cited By (28)
US 12,192,713 US 12,211,490 US 12,212,945 US 12,217,748 US 12,230,291 US 12,236,932 US 12,277,368 US 12,279,096 US 12,283,269 US 12,288,558 US 12,322,390 US 12,327,549 US 12,327,556 US 12,360,734 US 12,375,052 US 12,387,716 US 12,424,220 US 12,438,977 US 12,489,654 US 12,505,832 US 12,513,479 US 12,518,755 US 12,518,756 US 12,579,978 US 12,626,717 US 12,640,148 US 12,699,543 US 12,711,962