IP Library Granted Patent US 10,694,285
Granted Patent B2
US 10,694,285 · App. 16/017,472 · Granted Jun 23, 2020

Microphone array with automated adaptive beam tracking

Inventors: Iain Alexander McCowan (Ashmore, AU); Richard S. Juszkiewicz (Portland, OR); Nicholas William Metzar (Beaverton, OR); Matthew V. Kotvis (Portland, OR)
Assignee: Biamp Systems, LLC
H04R1/406G10L21/0216H04R3/005G10L2021/02166H04R2410/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,694,285
App. No.
16/017,472
Granted
Jun 23, 2020
Kind
B2
Abstract

An example method of operation may include initializing a microphone array in a defined space to receive one or more sound instances based on a preliminary beamform tracking configuration, detecting the one or more sound instances within the defined space via the microphone array, modifying the preliminary beamform tracking configuration, based on a location of the one or more sound instances, to create a modified beamform tracking configuration, and saving the modified beamform tracking configuration in a memory of a microphone array controller.

Claims (57)

1. A method, comprising:

initializing a microphone array in a defined space, including a plurality of sub-regions which collectively provide the defined space, to receive one or more sound instances based on a preliminary beamform tracking configuration;

scanning each of the plurality of sub-regions for the one or more sound instances via the microphone array;

calculating a local acoustic energy map for each sub-region of the plurality of sub-regions based on the scanning;

combining the local acoustic energy map for each of the sub-regions into an acoustic energy map representative of the defined space;

identifying locations local acoustic energy map for each sub-region based on the acoustic energy map representative of the defined space;

modifying the preliminary beamform tracking configuration, based on the locations, to create a modified beamform tracking configuration; and

saving the modified beamform tracking configuration in a memory of a microphone array controller.

2. The method of claim 1 , further comprising:

designating each of the plurality of sub-regions as a desired sound sub-region or an unwanted noise sub-region based on the sound instances received by the plurality of microphone arrays during the scanning of the plurality of sub-regions.

3. The method of claim 1 , wherein the one or more sound instances comprise a human voice.

4. The method of claim 2 , further comprising:

subsequently re-scanning each of the plurality of sub-regions for new desired sound instances.

5. The method of claim 4 , further comprising:

creating a new modified beamform tracking configuration based on new locations of the new desired sound instances; and

saving the new modified beamform tracking configuration in the memory of the microphone array controller.

6. The method of claim 1 , wherein the preliminary beamform tracking configuration for each sub-region and the modified beamform tracking configuration comprise a beamform center steering location and a beamforming steering region range.

7. The method of claim 1 , further comprising:

determining estimated locations of the detected one or more sound instances, as detected by the microphone array, by performing microphone array localization based on time delay of arrival (TDOA) or steered response power (SRP).

8. An apparatus, comprising:

a processor configured to:

initialize a microphone array in a defined space, including a plurality of sub-regions which collectively provide the defined space, to receive one or more sound instances based on a preliminary beamform tracking configuration;

scan each of the plurality of sub-regions for the one or more sound instances via the microphone array;

calculate a local acoustic energy map for each sub-region of the plurality of sub-regions based on the scanning;

combine the local acoustic energy map for each of the sub-regions into an acoustic energy map representative of the defined space;

identify locations local acoustic energy map for each sub-region based on the acoustic energy map representative of the defined space;

modify the preliminary beamform tracking configuration, based on the locations of the one or more sound instances, to create a modified beamform tracking configuration; and

a memory configured to store the modified beamform tracking configuration in a microphone array controller.

9. The apparatus of claim 8 , wherein the processor is further configured to:

designate each of the plurality of sub-regions as a desired sound sub-region or an unwanted noise sub-region based on the sound instances received by the plurality of microphone arrays during the scanning of the plurality of sub-regions.

10. The apparatus of claim 8 , wherein the one or more sound instances comprise a human voice.

11. The apparatus of claim 9 , wherein the processor is further configured to:

subsequently re-scan each of the plurality of sub-regions for new desired sound instances.

12. The apparatus of claim 11 , wherein the processor is further configured to:

create a new modified beamform tracking configuration based on new locations of the new desired sound instances; and

save the new modified beamform tracking configuration in the memory of the microphone array controller.

13. The apparatus of claim 8 , wherein the preliminary beamform tracking configuration for each sub-region and the modified beamform tracking configuration comprise a beamform center steering location and a beamforming steering region range.

14. The apparatus of claim 8 , wherein the processor is further configured to:

determine estimated locations of the detected one or more sound instances, as detected by the microphone array, by being further configured to perform microphone array localization based on time delay of arrival (TDOA) or steered response power (SRP).

15. A non-transitory computer readable storage medium configured to store at least one instruction that when executed by a processor causes the processor to perform:

initializing a microphone array in a defined space, including a plurality of sub-regions which collectively provide the defined space, to receive one or more sound instances based on a preliminary beamform tracking configuration;

scanning each of the plurality of sub-regions for the one or more sound instances via the microphone array;

calculating a local acoustic energy map for each sub-region of the plurality of sub-regions based on the scanning;

combining the local acoustic energy map for each of the sub-regions into an acoustic energy map representative of the defined space;

identifying locations local acoustic energy map for each sub-region based on the acoustic energy map representative of the defined space;

modifying the preliminary beamform tracking configuration, based on the locations, to create a modified beamform tracking configuration; and

saving the modified beamform tracking configuration in a memory of a microphone array controller.

16. The non-transitory computer readable storage medium of claim 15 , further configured to store at least one instruction that when executed by the processor causes the processor to perform:

designating each of the plurality of sub-regions as a desired sound sub-region or an unwanted noise sub-region based on the sound instances received by the plurality of microphone arrays during the scanning of the plurality of sub-regions.

17. The non-transitory computer readable storage medium of claim 15 , wherein the one or more sound instances comprise a human voice.

18. The non-transitory computer readable storage medium of claim 16 , further configured to store at least one instruction that when executed by the processor causes the processor to perform:

subsequently re-scanning each of the plurality of sub-regions for new desired sound instances.

19. The non-transitory computer readable storage medium of claim 18 , further configured to store at least one instruction that when executed by the processor causes the processor to perform:

creating a new modified beamform tracking configuration based on new locations of the new desired sound instances; and

saving the new modified beamform tracking configuration in the memory of the microphone array controller.

20. The non-transitory computer readable storage medium of claim 15 , further configured to store at least one instruction that when executed by the processor causes the processor to perform:

determining estimated locations of the detected one or more sound instances, as detected by the microphone array, by performing microphone array localization based on time delay of arrival (TDOA) or steered response power (SRP), and wherein the preliminary beamform tracking configuration for each sub-region and the modified beamform tracking configuration comprise a beamform center steering location and a beamforming steering region range.

Assignments (4)
RELEASE OF SECURITY INTEREST Recorded May 23, 2024
From: REGIONS BANK
To: BIAMP SYSTEMS, LLC
Reel/Frame 067509/0967 →
SECURITY INTEREST Recorded May 3, 2024
From: BIAMP SYSTEMS, LLC
To: MIDCAP FINANCIAL TRUST, AS COLLATERAL AGENT
Reel/Frame 067308/0631 →
NOTICE OF GRANT OF SECURITY INTEREST IN PATENTS Recorded Dec 19, 2018
From: BIAMP SYSTEMS, LLC
To: REGIONS BANK, AS ADMINISTRATIVE AGENT
Reel/Frame 049142/0849 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2018
From: MCCOWAN, IAIN ALEXANDER; JUSZKIEWICZ, RICHARD S.; METZAR, NICHOLAS WILLIAM; KOTVIS, MATTHEW V.
To: BIAMP SYSTEMS, LLC
Reel/Frame 046194/0235 →