IP Library › Granted Patent US 11,234,072
Granted Patent B2
US 11,234,072 · App. 15/999,764 · Granted Jan 25, 2022

Processing of microphone signals for spatial playback

Inventor: David S. McGrath (Rose Bay, AU)
Assignee: Dolby Laboratories Licensing Corporation
H04R3/005H04R1/406H04R5/04H04R2499/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,234,072
App. No.
15/999,764
Filed
Aug 20, 2018
Granted
Jan 25, 2022
Kind
B2
Examiner
MEI, XU
Art Unit
2654
USPC
381/92
Abstract

Disclosed are methods and systems which convert a multi-microphone input signal to a multichannel output signal making use of a time- and frequency-varying matrix. For each time and frequency tile, the matrix is derived as a function of a dominant direction of arrival and a steering strength parameter. Likewise, the dominant direction and steering strength parameter are derived from characteristics of the multi-microphone signals, where those characteristics include values representative of the inter-channel amplitude and group-delay differences.

Claims (32)

1. A method for determining a multichannel audio output signal, composed of two or more output audio channels, from a multi-microphone input signal, composed of at least two microphone signals, comprising:

determining a mixing matrix, based on characteristics of the multi-microphone input signal, wherein the multi-microphone input signal is mixed according to the mixing matrix to produce the multichannel audio output signal, wherein the method for determining the mixing matrix further comprises:

determining a vector u representative of a dominant direction of arrival and a steering strength parameter s representative of a degree to which the multi-microphone input signal can be represented by a single direction of arrival, based on characteristics of said multi-microphone input signal; and

determining the mixing matrix, based on said vector u representative of the dominant direction of arrival and said steering strength parameter s,

wherein the mixing matrix is formed by a sum of a matrix Q which is independent of the dominant direction of arrival, multiplied by a first weighting factor, and a matrix R(u) which varies for different vectors u representative of the dominant direction of arrival, multiplied by a second weighting factor, wherein the second weighting factor increases for an increase in the degree to which the multi-microphone input signal can be represented by the single direction of arrival, as represented by the steering strength parameter s, whereas the first weighting factor decreases for an increase in the degree to which the multi-microphone input signal can be represented by the single direction of arrival, as represented by the steering strength parameter s.

2. The method according to claim 1 , further comprising:

determining a set of W candidate direction of arrival vectors û a ;

determining an estimated multi-microphone input signal for each of the candidate direction of arrival vectors û a ;

determining estimated characteristics for each of the candidate direction of arrival vectors û a , on the basis of the corresponding estimated multi-microphone input signal; and

determining a direction of arrival vector u on the basis of the characteristics of the multi-microphone input signal, the candidate direction of arrival vectors û a , and the corresponding estimated characteristics.

3. The method according to claim 2 , wherein determining the direction of arrival vector u comprises:

comparing the characteristics of the multi-microphone input signal to the estimated characteristics of the candidate direction of arrival vectors û a ; and

determining the direction of arrival vector u on the basis of said comparison, by selecting as the direction of arrival vector u the candidate direction of arrival vector û a , of which the estimated characteristics match the characterstics of the multi-microphone input signals most closely.

4. The method according to claim 2 , wherein determining the direction of arrival vector u comprises:

determining, for each component of the direction of arrival vector u, a polynomial function which maps characteristics of a multi-microphone signal to said component of the direction of arrival vector u, by fitting coefficient of the polynomial function to the corresponding component of each of the W candidate direction vectors and the corresponding estimated characteristics; and

determining the components of the direction of arrival vector u by applying the polynomial function for each component with the determined coefficients to the characteristics of the multi-microphone input signal.

5. The method according to claim 1 , wherein the characteristics of the multi-microphone input signal includes an amplitude difference between one or more pairs of said microphone signals.

6. The method according to claim 1 , wherein said characteristics of said multi-microphone input signal includes a group-delay between one or more pairs of said microphone signals.

7. The method according to claim 6 , the method further comprising:

calculating a covariance matrix of a frequency representation of the multi-microphone input signal, wherein the covariance matrix is smoothed over a predetermined time window, the method further comprising:

calculating the product of the covariance matrix to which a frequency offset of ω+δ ω has been applied and the complex conjugate of the covariance matrix to which a frequency offset of ω−δ ω has been applied.

8. The method according to claim 1 , wherein said matrix is modified as a function of time, according to characteristics of said multi-microphone input signal at various times.

9. The method according to claim 1 , wherein said matrix is modified as a function of frequency, according to characteristics of said multi-microphone input signal in various frequency bands.

10. The method according to claim 1 , wherein the mixing matrix A(k, b) is determined at each time interval k, and at each frequency band b of B frequency bands, so that for each frequency ω within band b: Out(k, ω)=A(k, b)×Mic(k, ω), wherein Mic(k, ω) is a frequency representation of the multi-microphone input signal and Out(k, ω) is a frequency representation of the multichannel audio output signal for band b.

11. The method according to claim 1 , wherein determining the vector u representative of the dominant direction of arrival comprises determining a normalization factor for representing the vector u as a unit vector, and wherein the steering parameter s b is representative for the degree to which the normalization factor corresponds to 1.

12. A computer program product for processing an audio signal, comprising a computer program tangibly embodied on a machine readable medium, the computer program containing program code for performing the method according to claim 1 .

13. A device comprising:

a processing unit; and

a memory storing instructions that, when executed by the processing unit, cause the device to perform the method according to claim 1 .

14. An apparatus, comprising:

circuitry adapted to cause the apparatus to perform the method according to claim 1 .

15. A program storage device readable by a machine, tangibly embodying a program of instructions executable by the machine for causing performance of operations according to the method of 1.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2018
From: MCGRATH, DAVID S.
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 046900/0744 →
Priority Claims (1)
EP 16169658 · May 13, 2016 · regional
Continuity (2)
Provisional Application 62297055 · Feb 18, 2016
Related Publication 20210219052A1 · Jul 15, 2021
Cited By (1)
US 12,707,197