IP Library Granted Patent US 10,956,114
Granted Patent B2
US 10,956,114 · App. 15/790,000 · Granted Mar 23, 2021

Environmental characterization based on a change condition

Inventors: Gaylord Yu (San Francisco, CA); Steven Stupp (Foster City, CA)
Assignee: B&W Group Ltd.
G06F3/165G06F1/12G11B27/10H04L7/02H04L65/60H04N21/4305H04N21/43615H04N21/8106H04N21/8547H04R27/00H04S7/301H04S7/307H04W4/023H04W56/005H04L29/06027H04R3/12H04R2227/005H04R2420/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,956,114
App. No.
15/790,000
Granted
Mar 23, 2021
Kind
B2
Abstract

An audio/video (A/V) hub that selectively determines one or more acoustic characteristics of an environment that includes the A/V hub is described. In particular, the A/V hub may detect, using wireless communication, an electronic device (such as a speaker) in the environment. Then, the A/V hub may determine a change condition, such as when the electronic device was not previously detected in the environment and/or a change in a location of the electronic device. In response to determining the change condition, the A/V hub may transition into a characterization mode. During the characterization mode, the A/V hub may: provide instructions to the electronic device to playback audio content at a specified playback time; determine one or more acoustic characteristics of the environment based on acoustic measurements in the environment; and store the one or more acoustic characteristics and/or a location of the electronic device in memory.

Claims (55)

1. A coordination device, comprising:

memory configured to store characterization information of an environment;

one or more nodes configured to communicatively couple to one or more antennas;

an interface circuit communicatively coupled to the one or more nodes, wherein the coordination device is configured to:

detect an electronic device in the environment;

determine a change condition, wherein the change condition includes one of: the electronic device was not previously detected in the environment, and a change in a location of the electronic device, and wherein the change condition is determined based at least in part on wireless communication associated with the electronic device;

transition into a characterization mode when the change condition is determined, wherein, when in the characterization mode, the coordination device is configured to:

provide, to the one or more nodes, instructions intended for the electronic device to playback audio content at a specified playback time;

determine one or more acoustic characteristics of the environment based on acoustic measurements in the environment; and

store the characterization information in the memory, wherein the characterization information includes the one or more acoustic characteristics, and wherein, while in the characterization mode, the coordination device does not transmit the audio content or additional audio content intended for the electronic device; and

transition into a normal mode after determining the one or more acoustic characteristics, wherein in the normal mode, the coordination device is configured to transmit, to one or more nodes, one or more frames comprising the additional audio content and playback timing information intended for the electronic device, and

wherein the playback timing information specifies a playback time when the electronic device is to playback the additional audio content based on the one or more acoustic characteristics.

2. The coordination device of claim 1 , wherein the characterization information further includes: an identifier of the electronic device; and the location of the electronic device.

3. The coordination device of claim 1 , wherein the location includes a distance between the coordination device and the electronic device, and an angle of arrival of wireless signals associated with the electronic device.

4. The coordination device of claim 3 , wherein the change in the location includes one of a change in: the distance, the angle of arrival, and the distance and the angle of arrival.

5. The coordination device of claim 3 , wherein the distance is determined using wireless ranging.

6. The coordination device of claim 1 , wherein the one or more acoustic characteristics include information specifying at least one of: an acoustic transfer function in at least a first band of frequencies, acoustic loss, acoustic delay, acoustic noise in the environment, ambient sound in the environment, a reverberation time of the environment, and a spectral response in at least a second band of frequencies.

7. The coordination device of claim 1 , wherein the coordination device is further configured to calculate the location of the electronic device in the environment based on one or more frames, associated with the electronic device, which are received from the one or more nodes.

8. The coordination device of claim 1 , wherein the acoustic measurements associated with other electronic device are received from the one or more nodes.

9. The coordination device of claim 8 , wherein the one or more acoustic characteristics are further determined based on locations of the other electronic devices in the environment.

10. The coordination device of claim 9 , wherein the coordination device is further configured to perform one of: receive the locations of the other electronic devices from the one or more nodes; access predetermined locations of the other electronic devices stored in the memory; and determine the locations of the other electronic devices based on one or more frames, associated with the other electronic devices, which are received from the one or more nodes.

11. The coordination device of claim 1 , further comprising one or more acoustic transducers, wherein the coordination device is further configured to perform the acoustic measurements using the one or more acoustic transducers.

12. The coordination device of claim 1 , wherein the coordination device is configured to:

receive a user input; and

transition into the characterization mode based on the user input.

13. A non-transitory computer-readable storage medium for use with a coordination device, the computer-readable storage medium storing a program module that, when executed by the coordination device, causes the coordination device to selectively determine one or more acoustic characteristics by carrying out one or more operations comprising:

detecting, based on wireless communication, an electronic device in an environment;

determining a change condition, wherein the change condition includes one of: the electronic device was not previously detected in the environment, and a change in a location of the electronic device, and wherein the change condition is determined based at least in part on the wireless communication;

transitioning into a characterization mode when the change condition is determined, wherein, when in the characterization mode, the one or more operations comprise:

providing, to one or more nodes in the coordination device that are communicatively coupled to one or more antennas, instructions intended for the electronic device to playback audio content at a specified playback time;

determining the one or more acoustic characteristics of the environment based on acoustic measurements in the environment; and

storing the characterization information in the memory, wherein the characterization information includes the one or more acoustic characteristics, and wherein, while in the characterization mode, the coordination device does not transmit the audio content or the additional audio content intended for the electronic device; and

transitioning into a normal mode after determining the one or more acoustic characteristics, wherein in the normal mode, the one or more operations comprise transmitting, to one or more nodes, one or more frames comprising the additional audio content and playback timing information intended for the electronic device, and

wherein the playback timing information specifies a playback time when the electronic device is to playback the additional audio content based on the one or more acoustic characteristics.

14. The computer-readable storage medium of claim 13 , wherein the location includes a distance between the coordination device and the electronic device, and an angle of arrival of wireless signals associated with the electronic device.

15. The computer-readable storage medium of claim 14 , wherein the change in the location includes one of a change in: the distance, the angle of arrival, and the distance and the angle of arrival.

16. The computer-readable storage medium of claim 13 , wherein, when in the characterization mode, the one or more operations comprise communicating, to or from the one or more nodes, frames associated with other electronic devices in the environment;

wherein the acoustic measurements associated with the other electronic devices are received from one or more nodes; and

wherein the one or more acoustic characteristics are further determined based on locations of the other electronic devices in the environment.

17. The computer-readable storage medium of claim 13 , wherein the one or more operations comprise performing the acoustic measurements using one or more acoustic transducers in the coordination device.

18. A method for selectively determining one or more acoustic characteristics of an environment, comprising:

by a coordination device:

detecting, based on wireless communication, an electronic device in the environment;

determining a change condition, wherein the change condition includes one of: the electronic device was not previously detected in the environment, and a change in a location of the electronic device, and wherein the change condition is determined based at least in part on the wireless communication;

when the change condition is determined:

transitioning into a characterization mode;

providing, to one or more nodes in the coordination device that are communicatively coupled to one or more antennas, instructions intended for the electronic device to playback audio content at a specified playback time;

determining the one or more acoustic characteristics of the environment based on acoustic measurements in the environment; and

storing the characterization information in the memory, wherein the characterization information includes the one or more acoustic characteristics, and wherein, while in the characterization mode, the coordination device does not transmit the audio content or the additional audio content intended for the electronic device; and

transitioning into a normal mode after determining the one or more acoustic characteristics, wherein in the normal mode, the one or more operations comprise transmitting, to one or more nodes, one or more frames comprising the additional audio content and playback timing information intended for the electronic device; and

wherein the playback timing information specifies a playback time when the electronic device is to playback the additional audio content based on the one or more acoustic characteristics.

19. The method of claim 18 , wherein the location includes a distance between the coordination device and the electronic device, and an angle of arrival of wireless signals associated with the electronic device; and

wherein the distance is determined using wireless ranging.

20. The method of claim 18 , wherein the location includes a distance between the coordination device and the electronic device, and an angle of arrival of wireless signals associated with the electronic device; and

wherein the change in the location includes one of a change in: the distance, the angle of arrival, and the distance and the angle of arrival.

Assignments (11)
RELEASE OF SECURITY INTEREST IN PATENT COLLATERAL (REEL/FRAME 057187/0572) Recorded Apr 12, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: B & W GROUP LTD
Reel/Frame 059988/0738 →
RELEASE OF SECURITY INTEREST IN PATENT COLLATERAL (REEL/FRAME 057187/0613) Recorded Apr 12, 2022
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: B & W GROUP LTD
Reel/Frame 059988/0688 →
ABL PATENT SECURITY AGREEMENT Recorded Aug 16, 2021
From: B & W GROUP LTD
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 057187/0572 →
FIRST LIEN PATENT SECURITY AGREEMENT Recorded Aug 16, 2021
From: B & W GROUP LTD
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 057187/0613 →
RELEASE OF SECURITY INTEREST (SEE DOCUMENT FOR DETAILS) Recorded Dec 16, 2020
From: LUCID TRUSTEE SERVICES LIMITED
To: EVA AUTOMATION, INC.; EVA HOLDING, CORP.; EVA OPERATIONS CORP.
Reel/Frame 054791/0087 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 15, 2020
From: LUCID TRUSTEE SERVICES LIMITED, ACTING AS ATTORNEY-IN-FACT FOR EVA AUTOMATION INC., EVA HOLDING CORP. AND EVA OPERATIONS CORP., AND AS SECURITY AGENT
To: B&W GROUP LTD
Reel/Frame 054765/0526 →
RELEASE OF PATENT COLLATERAL SECURITY AND PLEDGE AGREEMENT Recorded Oct 9, 2020
From: LUCID TRUSTEE SERVICES LIMITED
To: EVA AUTOMATION, INC.
Reel/Frame 054288/0568 →
ASSIGNMENT OF PATENT COLLATERAL SECURITY AND PLEDGE AGREEMENT Recorded Oct 1, 2020
From: BANK OF AMERICA, N.A.
To: LUCID TRUSTEE SERVICES LIMITED
Reel/Frame 053968/0953 →
SECURITY INTEREST Recorded Feb 28, 2019
From: EVA AUTOMATION, INC.
To: LUCID TRUSTEE SERVICES LIMITED
Reel/Frame 048473/0646 →
PATENT COLLATERAL SECURITY AND PLEDGE AGREEMENT Recorded Feb 11, 2019
From: EVA AUTOMATION, INC.
To: BANK OF AMERICA, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 048301/0213 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 22, 2017
From: YU, GAYLORD; STUPP, STEVEN
To: EVA AUTOMATION, INC.
Reel/Frame 043918/0434 →
Continuity (2)
Provisional Application 62433237 · Dec 13, 2016
Related Publication 20180166101A1 · Jun 14, 2018