Granted Patent B2

US 12,395,952 · App. 17/734,804 · Granted Aug 19, 2025

Inventors: Lee Keyser-Allen (Medford, MA); Thomas Higdon (Boston, MA); Luis Vega-Zayas (Arlington, MA); Ted Lin (Ayer, MA); Andrej Sarkic (Cambridge, MA)

Assignee: Sonos, Inc.

H04W56/0015H04L43/106H04L65/60H04N21/4307H04N21/43076H04N21/43615H04N21/4392H04N21/8113H04R27/00H04R2227/003H04R2227/005H04R2420/07

Abstract

Claims (92)

1. A media playback system comprising:

a control device comprising:

a network interface configured to wirelessly communicate using a BLUETOOTH communication protocol;

a user interface configured to detect input from a user;

at least one processor;

at least one first non-transitory computer-readable medium;

first program instructions stored on the at least one first non-transitory computer-readable medium that are executable by the at least one processor such that the control device is configured to:

receive, via the user interface, user input indicating a command to initiate playback of media content, wherein the media content comprises (i) video content and (ii) corresponding audio content; and

transmit, via the network interface, at least one message to a video playback device based on the command; and

the video playback device comprising:

a first network interface configured to wirelessly communicate using the BLUETOOTH communication protocol;

a second network interface configured to communicate over at least one local area network (LAN);

at least one processor;

at least one second non-transitory computer-readable medium; and

second program instructions stored on the at least one second non-transitory computer-readable medium that are executable by the at least one processor such that the video playback device is configured to:

operate as part of a synchrony group with at least one audio playback device;

receive, via the first network interface, the at least one message from the control device;

obtain, via the second network interface, the media content based on the at least one message;

determine a time at which to begin playback of the media content;

transmit, via the second network interface, an indication of the determined time at which to begin playback of the media content to the at least one audio playback device;

based on the determined time at which to begin playback of the media content, play back the video content in lip-synchrony with playback of the corresponding audio content by the at least one audio playback device; and

while playing back the video content in lip-synchrony with the playback of the corresponding audio content by the at least one audio playback device, transmit, via the second network interface, timing information to the at least one audio playback device to facilitate playback of the corresponding audio content in lip-synchrony with the playback of the video content by the video playback device.

2. The media playback system of claim 1 , wherein the transmitted timing information causes the at least one audio playback device to modify a playback rate of the corresponding audio content to continue playing back the corresponding audio content in lip-synchrony with the playback of the video content by the video playback device.

3. The media playback system of claim 2 , wherein the transmitted timing information further causes the at least one audio playback device to update a respective local clock of the at least one audio playback device.

4. The media playback system of claim 1 , wherein the video playback device is a television comprising a display and wherein the second program instructions that are executable by the at least one processor such that the video playback device is configured to play back the video content comprise program instructions that are executable by the at least one processor such that the video playback device is configured to:

present the video content via the display of the television.

5. The media playback system of claim 1 , wherein the control device is a first control device, the command is a first command, and wherein the media playback system further comprises a second control device comprising:

a network interface configured to communicate over at least one LAN;

a user interface configured to detect input from a user;

at least one processor;

at least one third non-transitory computer-readable medium; and

third program instructions stored on the at least one third non-transitory computer-readable medium that are executable by the at least one processor such that the second control device is configured to:

receive, via the user interface, user input indicating a second command to modify the synchrony group; and

cause the synchrony group to be modified based on the second command to modify the synchrony group.

6. The media playback system of claim 5 , wherein the third program instructions that are executable by the at least one processor such that the second control device is configured to cause the synchrony group to be modified comprise program instructions that are executable by the at least one processor such that the second control device is configured to:

transmit at least one message to the video playback device.

7. The media playback system of claim 6 , wherein the second program instructions that are executable by the at least one processor such that the video playback device is configured to operate as part of the synchrony group with the at least one audio playback device comprise program instructions that are executable by the at least one processor such that the video playback device is configured to:

join the synchrony group with the at least one audio playback device based on the at least one message from the second control device.

8. The media playback system of claim 1 , wherein the media content comprises a plurality of frames, and wherein the second program instructions that are executable by the at least one processor such that the video playback device is configured to transmit the timing information to the at least one audio playback device comprise program instructions that are executable by the at least one processor such that the video playback device is configured to:

transmit, to the at least one audio playback device, at least one packet comprising an amount of time until when playback of at least one of the plurality of frames is to begin.

9. The media playback system of claim 1 , wherein the media content comprises a plurality of frames, and wherein the second program instructions that are executable by the at least one processor such that the video playback device is configured to transmit the timing information to the at least one audio playback device comprise program instructions that are executable by the at least one processor such that the video playback device is configured to:

transmit, to the at least one audio playback device, at least one packet comprising a presentation timestamp for at least one of the plurality of frames indicating when playback of the at least one of the plurality of frames is to begin.

10. The media playback system of claim 1 , wherein:

the second program instructions further comprise program instructions that are executable by the at least one processor such that the video playback device is configured to determine a network latency for a connection between the video playback device and the at least one audio playback device; and

the second program instructions that are executable by the at least one processor such that the video playback device is configured to determine the time at which to begin playback of the media content comprise program instructions that are executable by the at least one processor such that the video playback device is configured to determine the time at which to begin playback of the media content based on the determined network latency.

11. The media playback system of claim 10 , wherein the second program instructions that are executable by the at least one processor such that the video playback device is configured to determine the network latency comprise program instructions that are executable by the at least one processor such that the video playback device is configured to:

send a test packet to the at least one audio playback device at a first time based on a local clock of the video playback device;

receive an acknowledgement packet indicating receipt of the test packet from the at least one audio playback device at a second time based on the local clock of the video playback device;

determine a test packet delay calculation based on a difference between the second time and the first time; and

determine the network latency based on the test packet delay calculation.

12. The media playback system of claim 1 , wherein the video playback device further comprises:

an audio amplifier; and

a speaker coupled to the audio amplifier.

13. The media playback system of claim 1 , wherein the at least one audio playback device comprises a first playback device, and wherein the media playback system further comprises the first playback device.

14. The media playback system of claim 13 , wherein the first playback device comprises:

a network interface configured to communicate over the LAN;

an audio amplifier;

a speaker coupled to the audio amplifier;

at least one processor;

at least one third non-transitory computer-readable medium; and

third program instructions stored on the at least one third non-transitory computer-readable medium that are executable by the at least one processor such that the first playback device is configured to:

receive, via the network interface, the indication of the determined time at which to begin playback of the media content from the video playback device;

based on the indication of the determined time at which to begin playback of the media content, play back, via the audio amplifier and the speaker, the corresponding audio content in lip-synchrony with the playback of the video content by the video playback device; and

while playing back the corresponding audio content in lip-synchrony with the playback of the video content by the video playback device:

receive, via the second network interface, the timing information from the video playback device; and

modify a playback rate of the corresponding audio content based on the timing information to continue playing back the corresponding audio content in lip-synchrony with the playback of the video content by the video playback device.

15. At least one non-transitory computer-readable medium, wherein the at least one non-transitory computer-readable medium is provisioned with program instructions that, when executed by at least one processor, cause a media playback system to:

receive, via a user interface of a control device, user input indicating a command to initiate playback of media content, wherein the media content comprises (i) video content and (ii) corresponding audio content;

based on the command, transmit, via a first network interface of the control device configured to wirelessly communicate using a BLUETOOTH communication protocol, at least one message to a video playback device that is configured to operate as part of a synchrony group with at least one audio playback device;

receive, via a second network interface of the video playback device configured to wirelessly communicate using the BLUETOOTH communication protocol, the at least one message from the control device;

obtain, via a third network interface of the video playback device configured to communicate over at least one local area network (LAN), the media content based on the at least one message;

determine a time at which to begin playback of the media content;

transmit, via the third network interface of the video playback device, an indication of the determined time at which to begin playback of the media content to the at least one audio playback device;

based on the determined time at which to begin playback of the media content, play back, at the video playback device, the video content in lip-synchrony with playback of the corresponding audio content by the at least one audio playback device; and

while the video playback device is playing back the video content in lip-synchrony with the playback of the corresponding audio content by the at least one audio playback device, transmit, via the third network interface of the video playback device, timing information to the at least one audio playback device to facilitate playback of the corresponding audio content in lip-synchrony with the playback of the video content by the video playback device.

16. The at least one non-transitory computer-readable medium of claim 15 , wherein the transmitted timing information causes the at least one audio playback device to modify a playback rate of the corresponding audio content to continue playing back the corresponding audio content in lip-synchrony with the playback of the video content by the video playback device.

17. The at least one non-transitory computer-readable medium of claim 15 , wherein the media content comprises a plurality of frames, and wherein the program instructions that, when executed by at least one processor, cause the media playback system to transmit, via the third network interface of the video playback device, the timing information to the at least one audio playback device comprise program instructions that, when executed by at least one processor, cause the media playback system to:

transmit, via the third network interface of the video playback device to the at least one audio playback device, at least one packet comprising an amount of time until when playback of at least one of the plurality of frames is to begin.

18. The at least one non-transitory computer-readable medium of claim 15 , wherein the media content comprises a plurality of frames, and wherein the program instructions that, when executed by at least one processor, cause the media playback system to transmit, via the third network interface of the video playback device, the timing information to the at least one audio playback device comprise program instructions that, when executed by at least one processor, cause the media playback system to:

transmit, via the third network interface of the video playback device to the at least one audio playback device, at least one packet comprising a presentation timestamp for at least one of the plurality of frames indicating when playback of the at least one of the plurality of frames is to begin.

19. The at least one non-transitory computer-readable medium of claim 15 , wherein:

the at least one non-transitory computer-readable medium is also provisioned with program instructions that, when executed by at least one processor, cause the media playback system to determine a network latency for a connection between the video playback device and the at least one audio playback device; and

the program instructions that, when executed by at least one processor, cause the media playback system to determine the time at which to begin playback of the media content comprise program instructions that, when executed by at least one processor, cause the media playback system to determine the time at which to begin playback of the media content based on the determined network latency.

20. A method carried out by a media playback system comprising a control device and a video playback device, the method comprising:

receiving, via a user interface of the control device, user input indicating a command to initiate playback of media content, wherein the media content comprises (i) video content and (ii) corresponding audio content;

based on the command, transmitting, via a first network interface of the control device configured to wirelessly communicate using a BLUETOOTH communication protocol, at least one message to a video playback device that is configured to operate as part of a synchrony group with at least one audio playback device;

receiving, via a second network interface of the video playback device configured to wirelessly communicate using the BLUETOOTH communication protocol, the at least one message from the control device;

obtaining, via a third network interface of the video playback device configured to communicate over at least one local area network (LAN), the media content based on the at least one message;

determining a time at which to begin playback of the media content;

transmitting, via the third network interface of the video playback device, an indication of the determined time at which to begin playback of the media content to the at least one audio playback device;

based on the determined time at which to begin playback of the media content, playing back, at the video playback device, the video content in lip-synchrony with playback of the corresponding audio content by the at least one audio playback device; and

while the video playback device is playing back the video content in lip-synchrony with the playback of the corresponding audio content by the at least one audio playback device, transmitting, via the third network interface of the video playback device, timing information to the at least one audio playback device to facilitate playback of the corresponding audio content in lip-synchrony with the playback of the video content by the video playback device.

Assignments (2)

Continuity (5)

References Cited (253)