IP Library Granted Patent US 9,769,563
Granted Patent B2
US 9,769,563 · App. 14/806,625 · Granted Sep 19, 2017

Audio enhancement via opportunistic use of microphones

Inventors: James M. Kirsch (Salt Lake City, UT); Brant D. Thomsen (Sandy, UT)
Assignee: HARMAN INTERNATIONAL INDUSTRIES, INCORPORATED
H04R1/406H04M3/568H04R3/005H04M2203/509
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,769,563
App. No.
14/806,625
Granted
Sep 19, 2017
Kind
B2
Abstract

An audio processing system includes a group of microphones associated with a dynamic network of microphones and a receiver. The receiver is configured to identify a first signal received by a microphone in the plurality of microphones that is designated as a primary microphone, and identify a subset of microphones included in the plurality of microphones, where each microphone in the subset is associated with a respective signal corresponding to the first signal. The receiver is further configured to calculate a weighting factor for each microphone included in the subset based on the first signal and the respective signal and opportunistically establish a connection with a microphone associated with the dynamic network of microphones that is not included in the plurality of microphones; and, based on a signal received from this microphone, adjust a weighting factor for at least one of the microphones in the subset.

Claims (44)

1. An audio processing system, comprising:

a plurality of microphones associated with a dynamic network of microphones; and

a receiver coupled to the plurality of microphones and configured to:

identify a first signal received by a microphone included in the plurality of microphones that is designated as a primary microphone;

identify a subset of microphones included in the plurality of microphones, wherein each microphone in the subset of microphones is associated with a respective signal that corresponds to the first signal;

calculate a weighting factor for each microphone included in the subset of microphones based at least in part on a strength of a correlation between the first signal and the respective signal associated with the microphone;

establish a connection with a first microphone associated with the dynamic network of microphones that is not included in the plurality of microphones; and

adjust a weighting factor for at least one of the microphones included in the subset of microphones based on a signal received from the first microphone.

2. The audio processing system of claim 1 , wherein the receiver is further configured to perform a time-align operation on microphone signals received from each microphone included in the subset of microphones.

3. The audio processing system of claim 1 , wherein the receiver is further configured to select, as the primary microphone, a microphone included in the plurality of microphones that outputs a signal having an amplitude greater than an amplitude of an output signal generated by each of the other microphones included in the plurality of microphones for a threshold amount of time.

4. The audio processing system of claim 1 , wherein the receiver is further configured to select a primary microphone, comprising:

pre-selecting a first microphone included in the plurality of microphones that outputs a signal having an amplitude greater than an amplitude of an output signal generated by each of the other microphones included in the plurality of microphones for a threshold amount of time; and

selecting a second microphone included in the plurality of microphones that presents a signal portion at an earlier time than a corresponding signal portion presented by the first microphone.

5. The audio processing system of claim 1 , wherein the receiver is further configured to adjust the weighting factor for a second microphone included in the subset of microphones based on a sensitivity rating of the second microphone.

6. The audio processing system of claim 1 , wherein the receiver is further configured to adjust the weighting factor for a second microphone included in the subset of microphones based on detecting a motion associated with the second microphone.

7. The audio processing system of claim 1 , wherein the receiver is further configured to adjust the weighting factor for a second microphone included in the subset of microphones based on a wireless transmission latency associated with the second microphone.

8. The audio processing system of claim 1 , wherein the receiver is further configured to adjust the weighting factor for a second microphone included in the subset of microphones based on a distance between the second microphone and the primary microphone.

9. The audio processing system of claim 1 , further comprising a plurality of receiving antennas, and wherein selecting a microphone as the primary microphone comprises:

receiving an orientation signal from each receiving antenna included in the plurality of receiving antennas;

calculating an orientation angle based on the orientation signals; and

selecting the primary microphone based on the orientation angle.

10. A non-transitory computer-readable storage medium including instructions that, when executed by a processor, cause the processor to enhance audio via opportunistic use of one or more microphones included in a plurality of microphones, by performing the steps of:

identifying a first signal received by a microphone included in the plurality of microphones that is designated as a primary microphone, wherein the plurality of microphones is associated with a dynamic network of microphones;

identifying a subset of microphones included in the plurality of microphones, wherein each microphone in the subset of microphones is associated with a respective signal that corresponds to the first signal;

calculating a weighting factor for each microphone included in the subset of microphones based at least in part on a strength of a correlation between the first signal and the respective signal associated with the microphone;

establishing a connection with a first microphone that is not included in the plurality of microphones; and

adjusting a weighting factor for at least one of the microphones included in the subset of microphones based on a signal received from the first microphone.

11. The computer-readable storage medium of claim 10 , further including instructions that, when executed by the processor, cause the processor to perform the step of performing a time-align operation on microphone signals received from each microphone included in the subset of microphones.

12. The computer-readable storage medium of claim 10 , further including instructions that, when executed by the processor, cause the processor to perform the step of performing a mix operation on the microphone signals from the at least a first subset of microphones based on the weighting factors to generate a mixed microphone signal.

13. The computer-readable storage medium of claim 10 , further including instructions that, when executed by the processor, cause the processor to perform the step of adjusting the weighting factor for a second microphone included in the subset of microphones based on a sensitivity rating of the second microphone.

14. The computer-readable storage medium of claim 10 , further including instructions that, when executed by the processor, cause the processor to perform the step of adjusting the weighting factor for a second microphone included in the subset of microphones based on detecting a motion associated with the second microphone.

15. The computer-readable storage medium of claim 10 , further including instructions that, when executed by the processor, cause the processor to perform the step of adjusting the weighting factor for a second microphone included in the subset of microphones based on a wireless transmission latency associated with the second microphone.

16. The computer-readable storage medium of claim 10 , further including instructions that, when executed by the processor, cause the processor to perform the step of adjusting the weighting factor for a second microphone included in the subset of microphones based on a distance between the other microphone and the second microphone.

17. A method for enhancing audio via opportunistic use of one or more microphones included in a plurality of microphones, the method comprising:

identifying a first signal received by a microphone included in the plurality of microphones that is designated as a primary microphone;

identifying a subset of microphones included in the plurality of microphones, wherein each microphone in the subset of microphones is associated with a respective signal that corresponds to the first signal;

calculating a weighting factor for each microphone included in the subset of microphones based at least in part on a strength of a correlation between the first signal and the respective signal associated with the microphone;

establishing a connection with a first microphone that is not included in the plurality of microphones; and

adjusting a weighting factor for at least one of the microphones included in the subset of microphones based on a signal received from the first microphone.

18. The method of claim 17 , further comprising performing a time-align operation on microphone signals received from each microphone included in the subset of microphones.

19. The method of claim 17 , wherein calculating a weighting factor for each microphone comprises performing a cross-correlation of each of the other microphones included in the plurality of microphones relative to the primary microphone.

20. The method of claim 19 , wherein performing a cross-correlation of each of the other microphones relative to the primary microphone comprises searching a time window of a microphone signal associated with the other microphone, wherein the time window is based on a first delay associated with a maximum acoustic delay between any two microphones included in the plurality of microphones.

21. The method of claim 20 , wherein the time window is further based on a second delay associated with a wireless transmission latency associated with the other microphone.

22. The method of claim 17 , further comprising performing a mix operation on microphone signals received from each microphone included in the subset of microphones based on the weighting factors to generate a mixed microphone signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 22, 2015
From: KIRSCH, JAMES M.; THOMSEN, BRANT D.
To: HARMAN INTERNATIONAL INDUSTRIES, INC.
Reel/Frame 036158/0346 →
Continuity (1)
Related Publication 20170026740A1 · Jan 26, 2017