IP Library Granted Patent US 11,194,542
Granted Patent B2
US 11,194,542 · App. 16/868,473 · Granted Dec 7, 2021

Wireless coordination of audio sources

Inventors: Gaylord Yu (San Francisco, CA); Steven Stupp (Foster City, CA)
Assignee: B&W Group Ltd.
G06F3/165G06F1/12G11B27/10H04L7/02H04L65/60H04N21/4305H04N21/43615H04N21/8106H04N21/8547H04R27/00H04S7/301H04S7/307H04W4/023H04W56/005H04L29/06027H04R3/12H04R2227/005H04R2420/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,194,542
App. No.
16/868,473
Granted
Dec 7, 2021
Kind
B2
Abstract

An audio/video (A/V) hub that coordinates playback of audio content is described. In particular, the A/V hub may calculate current time offsets between clocks in electronic devices and a clock in the A/V hub based on differences between transmit times of frames from the electronic devices and receive times when the frames were received. For example, the current time offsets may be calculated using wireless ranging by ignoring distances between the A/V hub and the electronic devices. Then, the A/V hub may transmit, to the electronic devices, one or more frames that include audio content and playback timing information, which may specify playback times when the electronic devices are to playback the audio content based on the current time offsets. Furthermore, the playback times of the electronic devices may have a temporal relationship so that the playback of the audio content by the electronic devices is coordinated.

Claims (59)

1. An integrated circuit, comprising:

one or more nodes configured to communicatively couple to one or more antennas, wherein the integrated circuit is configured to:

receive, from the one or more nodes, input frames associated with electronic devices, wherein a given input frame comprises a transmit time when a given electronic device transmitted the given input frame;

store receive times when the input frames were received, wherein the receive times are based on a clock in the integrated circuit and are determined in a physical layer in the integrated circuit;

calculate current time offsets between clocks in the electronic devices and the clock in the integrated circuit based on the receive times and transmit times of the input frames, wherein the calculation of a given current time offset is based at least in part on a given difference between a given transmit time and a given receive time for a given frame; and

transmit, via the one or more nodes, one or more output frames that comprise audio content and playback timing information intended for the electronic devices, wherein the playback timing information specifies playback times when the electronic devices are to playback the audio content based on the current time offsets,

wherein the playback times of the electronic devices have a temporal relationship so that the playback of the audio content by the electronic devices is coordinated, and

wherein the integrated circuit is configured to receive the input frames and the transmit the one or more output frames using wireless communication.

2. The integrated circuit of claim 1 , wherein the temporal relationship has a non-zero value, so that at least some of the electronic devices are instructed to playback the audio content with a phase relative to each other by using different values of the playback times.

3. The integrated circuit of claim 2 , wherein the different playback times are based on acoustic characterization of an environment.

4. The integrated circuit of claim 2 , wherein the different playback times are based on a desired acoustic characteristic in an environment.

5. The integrated circuit of claim 2 , wherein the electronic devices are located at vector distances from the integrated circuit;

wherein the integrated circuit is configured to determine magnitudes of the vector distances based on the transmit times and the receive times using wireless ranging, and is configured to determine angles of the vector distances based on the angle of arrival of wireless signals associated with the input frames; and

wherein the different playback times are based on the determined vector distances.

6. The integrated circuit of claim 2 , wherein the different playback times are based on an estimated location of a listener relative to the electronic devices.

7. The integrated circuit of claim 6 , wherein the integrated circuit is further configured to:

receive, from the one or more nodes, a frame associated with another electronic device; and

calculate the estimated location of the listener based on the received frame.

8. The integrated circuit of claim 6 , wherein the integrated circuit further comprises an acoustic transducer configured to perform sound measurements of an environment; and

wherein the integrated circuit is configured to calculate the estimated location of the listener based on the sound measurements.

9. The integrated circuit of claim 6 , wherein the integrated circuit is further configured to receive, from the one or more nodes, additional sound measurements of the environment associated with the other electronic devices in the environment; and

wherein the integrated circuit is configured to calculate the estimated location of the listener based on the additional sound measurements.

10. The integrated circuit of claim 6 , wherein the integrated circuit is configured to:

perform time-of-flight measurements; and

calculate the estimated location of the listener based on the time-of-flight measurements.

11. The integrated circuit of claim 1 , wherein the electronic devices are located at non-zero distances from the integrated circuit; and

wherein the current time offsets are calculated based on the transmit times and the receive times using wireless ranging by ignoring the distances.

12. The integrated circuit of claim 1 , wherein the current time offsets are further based on models of clock drift in the electronic devices.

13. A non-transitory computer-readable storage medium for use with an integrated circuit, the computer-readable storage medium storing program instructions that, when executed by the integrated circuit, cause the integrated circuit to coordinate playback of audio content by carrying out one or more operations that comprise:

receiving, from one or more nodes in the integrated circuit that are communicatively coupled to one or more antennas, input frames associated with electronic devices, wherein a given input frame comprises a transmit time when a given electronic device transmitted the given input frame;

storing receive times when the input frames were received, wherein the receive times are based on a clock in the integrated circuit and are determined in a physical layer in the integrated circuit;

calculating current time offsets between clocks in the electronic devices and the clock in the integrated circuit based on the receive times and transmit times of the input frames, wherein the calculation of a given current time offset is based at least in part on a given difference between a given transmit time and a given receive time for a given frame; and

transmitting, via the one or more nodes, one or more output frames that comprise the audio content and playback timing information intended for the electronic devices, wherein the playback timing information specifies playback times when the electronic devices are to playback the audio content based on the current time offsets,

wherein the playback times of the electronic devices have a temporal relationship so that the playback of the audio content by the electronic devices is coordinated, and

wherein the integrated circuit is configured to receive the input frames and the transmit the one or more output frames using wireless communication.

14. The non-transitory computer-readable storage medium of claim 13 , wherein the temporal relationship has a non-zero value, so that at least some of the electronic devices are instructed to playback the audio content with a phase relative to each other by using different values of the playback times; and

wherein the different playback times are based on acoustic characterization of an environment.

15. The non-transitory computer-readable storage medium of claim 14 , wherein the temporal relationship has a non-zero value, so that at least some of the electronic devices are instructed to playback the audio content with a phase relative to each other by using different values of the playback times; and

wherein the different playback times are based on a desired acoustic characteristic in the environment.

16. The non-transitory computer-readable storage medium of claim 14 , wherein the temporal relationship has a non-zero value, so that at least some of the electronic devices are instructed to playback the audio content with a phase relative to each other by using different values of the playback times;

wherein the electronic devices are located at vector distances from the integrated circuit;

wherein the one or more operations comprise:

determining magnitudes of the vector distances based on the transmit times and the receive times using wireless ranging; and

determining angles of the vector distances based on the angle of arrival of wireless signals associated with the input frames; and

wherein the different playback times are based on the determined vector distances.

17. The non-transitory computer-readable storage medium of claim 14 , wherein the temporal relationship has a non-zero value, so that at least some of the electronic devices are instructed to playback the audio content with a phase relative to each other by using different values of the playback times; and

wherein the different playback times are based on an estimated location of a listener relative to the electronic devices.

18. The non-transitory computer-readable storage medium of claim 13 , wherein the one or more operations comprise:

performing time-of-flight measurements; and

calculating the estimated location of the listener based on the time-of-flight measurements.

19. The non-transitory computer-readable storage medium of claim 13 , wherein the current time offsets are further based on models of clock drift in the electronic devices.

20. A method for coordinating playback of audio content, comprising:

by an integrated circuit:

receiving, from one or more nodes in the integrated circuit that are communicatively coupled to one or more antennas, input frames associated with electronic devices, wherein a given input frame comprises a transmit time when a given electronic device transmitted the given input frame;

storing receive times when the input frames were received, wherein the receive times are based on a clock in the integrated circuit and are determined in a physical layer in the integrated circuit;

calculating current time offsets between clocks in the electronic devices and the clock in the integrated circuit based on the receive times and transmit times of the input frames, wherein the calculation of a given current time offset is based at least in part on a given difference between a given transmit time and a given receive time for a given frame; and

transmitting, via the one or more nodes, one or more output frames that comprise audio content and playback timing information intended for the electronic devices, wherein the playback timing information specifies playback times when the electronic devices are to playback the audio content based on the current time offsets,

wherein the playback times of the electronic devices have a temporal relationship so that the playback of the audio content by the electronic devices is coordinated, and

wherein the receiving of the input frames and the transmitting of the one or more output frames involves wireless communication.

Assignments (8)
RELEASE OF SECURITY INTEREST IN PATENT COLLATERAL (REEL/FRAME 057187/0613) Recorded Apr 12, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: B & W GROUP LTD
Reel/Frame 059988/0688 →
RELEASE OF SECURITY INTEREST IN PATENT COLLATERAL (REEL/FRAME 057187/0572) Recorded Apr 12, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: B & W GROUP LTD
Reel/Frame 059988/0738 →
ABL PATENT SECURITY AGREEMENT Recorded Aug 16, 2021
From: B & W GROUP LTD
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 057187/0572 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Aug 16, 2021
From: B & W GROUP LTD
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 057187/0613 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2021
From: EVA AUTOMATION, INC.; EVA HOLDING, CORP.; EVA OPERATIONS CORP.
To: DEI SALES, INC.
Reel/Frame 055222/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 29, 2021
From: DEI SALES, INC.
To: B&W GROUP LTD
Reel/Frame 055174/0024 →
RELEASE OF SECURITY INTEREST Recorded Jan 29, 2021
From: LUCID TRUSTEE SERVICES LIMITED
To: EVA AUTOMATION, INC.; EVA HOLDING, CORP.; EVA OPERATIONS CORP.
Reel/Frame 055174/0064 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 6, 2020
From: YU, GAYLORD; STUPP, STEVEN
To: EVA AUTOMATION, INC.
Reel/Frame 052595/0199 →
Continuity (4)
Continuation 16266099 · Feb 3, 2019
Continuation 15678043 · Aug 15, 2017
Provisional Application 62433237 · Dec 13, 2016
Related Publication 20200264838A1 · Aug 20, 2020
Cited By (1)
US 50,946