Processing of microphone signals for spatial playback
Disclosed are methods and systems which convert a multi-microphone input signal to a multichannel output signal making use of a time- and frequency-varying matrix. For each time and frequency tile, the matrix is derived as a function of a dominant direction of arrival and a steering strength parameter. Likewise, the dominant direction and steering strength parameter are derived from characteristics of the multi-microphone signals, where those characteristics include values representative of the inter-channel amplitude and group-delay differences.
1. A method of processing audio, comprising:
receiving a plurality of microphone signals;
analyzing the microphone signals to determine, for each of a plurality of time and frequency tiles, a dominant direction of arrival and a steering strength parameter indicative of a degree to which the microphone signals correspond to the dominant direction of arrival;
determining, for each of the plurality of time and frequency tiles, a mixing matrix based on the dominant direction of arrival and the steering strength parameter,
wherein determining the mixing matrix for a respective time and frequency tile comprises determining a weighted sum of a first matrix that is independent of the dominant direction of arrival for the respective time and frequency tile and a second matrix that correlates to the dominant direction of arrival for the respectively time and frequency tile, wherein the first matrix is weighted by a first weight that decreases for an increase in value of the steering strength parameter, and wherein the second matrix is weighted by a second weight that increases for an increase in value of the steering strength parameter; and
mixing, for each of the plurality of time and frequency tiles, the plurality of microphone signals according to the mixing matrix for the time and frequency tile to produce a multichannel audio output signal including a plurality of output channels.
2. The method of claim 1 , wherein one or more of the dominant direction of arrival and the steering strength parameter are determined based on an amplitude difference between one or more pairs of the microphone signals.
3. The method of claim 1 , wherein one or more of the dominant direction of arrival and the steering strength parameter are determined based on a group-delay between one or more pairs of the microphone signals.
4. A system comprising:
one or more processors; and
a non-transitory computer readable medium storing instructions that, when executed by the one or more processors, cause the one or more processors to perform operations of processing audio, the operations comprising:
receiving a plurality of microphone signals;
analyzing the microphone signals to determine, for each of a plurality of time and frequency tiles, a dominant direction of arrival and a steering strength parameter indicative of a degree to which the microphone signals correspond to the dominant direction of arrival;
determining, for each of a plurality of time and frequency tiles, a mixing matrix based on the dominant direction of arrival and the steering strength parameter,
wherein determining the mixing matrix for a respective time and frequency tile comprises determining a weighted sum of a first matrix that is independent of the dominant direction of arrival for the respective time and frequency tile and a second matrix that correlates to the dominant direction of arrival for the respectively time and frequency tile, wherein the first matrix is weighted by a first weight that decreases for an increase in value of the steering strength parameter, and wherein the second matrix is weighted by a second weight that increases for an increase in value of the steering strength parameter; and
mixing, for each of the plurality of time and frequency tiles, the plurality of microphone signals according to the mixing matrix for the time and frequency tile to produce a multichannel audio output signal including a plurality of output channels.