Granted Patent B2

US 12,382,234 · App. 18/008,431 · Granted Aug 5, 2025

Inventors: Aaron Steven Master (San Francisco, CA); Lie Lu (San Francisco, CA); Heiko Purnhagen (San Francisco, CA)

Assignees: Dolby Laboratories Licensing Corporation; DOLBY INTERNATIONAL AB

H04S7/30G10L21/0308G10L25/18H04S1/007H04S2400/11

Abstract

Claims (59)

1. A method comprising:

obtaining softmask values for frequency bins of time-frequency tiles representing an audio signal, the audio signal including a target source and one or more backgrounds;

reducing the softmask values; and

applying the reduced softmask values to the frequency bins to create a time-frequency representation of an estimated target source,

wherein reducing the softmask values comprises:

estimating a bulk reduction threshold, the bulk reduction threshold representing a balance point between softmask values that correlate with target dominant time-frequency tiles and softmask values that correlate with background dominant time-frequency tiles; and

multiplying each softmask value that falls below the bulk reduction threshold by a fractional value.

2. The method of claim 1 , further comprising, prior to obtaining the softmask values,

transforming, using one or more processors, one or more frames of a time domain audio signal into a time-frequency domain representation including the time-frequency tiles, wherein the time-frequency domain representation includes the target source and the one or more backgrounds, and wherein the frequency domain of the time-frequency domain representation includes the frequency bins grouped into a plurality of subbands.

3. The method of claim 2 , wherein the time domain audio signal is a multiple-channel audio signal, further comprising:

for each time-frequency tile:

calculating spatial parameters and a level for the time-frequency tile, and

obtaining the softmask values using the spatial parameters, the level and a subband information.

4. The method of claim 1 , further comprising:

setting to zero or near-zero the softmask values in the frequency bins that are outside a specified frequency range.

5. A method comprising:

obtaining softmask values for frequency bins of time-frequency tiles representing an audio signal, the audio signal including a target source and one or more backgrounds;

expanding and limiting the softmask values; and

applying the expanded and limited, softmask values to the frequency bins to create a time-frequency representation of an estimated target source,

wherein expanding and limiting the softmask values, further comprises:

adding a fixed expansion addition value to the softmask values;

multiplying the softmask values by an expansion multiplier constant; and

limiting any softmask values that are above 1.0 to 1.0.

6. The method of claim 5 , further comprising, prior to obtaining the softmask values,

transforming, using one or more processors, one or more frames of a time domain audio signal into a time-frequency domain representation including the time-frequency tiles, wherein the time-frequency domain representation includes the target source and the one or more backgrounds, and wherein the frequency domain of the time-frequency domain representation includes the frequency bins grouped into a plurality of subbands.

7. The method of claim 6 , wherein the time domain audio signal is a multiple-channel audio signal, further comprising:

for each time-frequency tile:

calculating spatial parameters and a level for the time-frequency tile, and obtaining the softmask values using the spatial parameters, the level and a subband information.

8. The method of claim 5 , further comprising:

setting to zero or near-zero the softmask values in the frequency bins that are outside a specified frequency range.

9. A method comprising:

obtaining softmask values for frequency bins of time-frequency tiles representing an audio signal, the audio signal including a target source and one or more backgrounds, wherein the time-frequency tiles represent a multiple channels audio signal and the frequency bins of the time-frequency tiles are organized into a plurality of subbands, the method further comprising, for each time-frequency tile:

obtaining softmask values for frequency bins of time-frequency tiles representing the multiple channels audio signal;

applying the softmask values to the frequency bins to create a time-frequency domain representation of an estimated target source; wherein the method further comprises:

obtaining a panning parameter estimate for the target source;

obtaining a source phase concentration estimate for the target source, wherein the source phase concentration estimate is obtained by estimating a statistical distribution of phase differences between the multiple channels in the time-frequency tiles for capturing a predetermined amount of audio energy of the target source;

determining, using the panning parameter estimate and the softmask values, a magnitude for the time-frequency domain representation of the estimated target source;

determining, using the panning parameter estimate and the source phase concentration estimate, a phase for the time-frequency domain representation of the estimated target source based; and

combining the magnitude and the phase to create a modified time-frequency domain representation of the estimated target source.

10. The method of claim 9 , further comprising, prior to obtaining the softmask values,

transforming, using one or more processors, one or more frames of a time domain audio signal into a time-frequency domain representation including the time-frequency tiles, wherein the time-frequency domain representation includes the target source and the one or more backgrounds, and wherein the frequency domain of the time-frequency domain representation includes the frequency bins grouped into the plurality of subbands.

11. The method of claim 10 , further comprising:

for each time-frequency tile:

calculating spatial parameters and a level for the time-frequency tile, and

obtaining the softmask values using the spatial parameters, the level and a subband information.

12. The method of claim 9 , wherein determining, using the panning parameter estimate and the source phase concentration estimate, a phase for the time-frequency domain representation of the estimated target source based, further comprises:

computing, using the panning parameter estimate, a first weight for a left channel phase and a second weight for a right channel phase;

computing a weighted average of the left and right channel phases using the first weight and the second weight, respectively; and

adjusting a phase parameter of the time-frequency tile for the time-frequency domain representation of the estimated target source to be the weighted average of the left and right channel phases.

13. The method of claim 9 , wherein determining, using the panning parameter estimate and the softmask values, a magnitude for the time-frequency domain representation of the estimated target source, further comprises:

computing a left channel ratio as a function of the panning parameter estimate;

computing a right channel ratio as a function the panning parameter estimate;

computing a left channel magnitude for the left channel based on a product of the left channel ratio, a softmask value and a level of the frequency bin; and

computing a right channel magnitude based on the product of the right channel ratio, the softmask value for the frequency bin and the level of the frequency bin.

14. The method of claim 9 , wherein estimating the statistical distribution of the phase differences between the multiple channels in the time-frequency tiles further comprises:

determining a peak value of the statistical distribution;

determining a phase difference corresponding to the peak value; and

determining a width of the statistical distribution around the peak value for capturing the amount of audio energy.

15. The method of claim 9 , wherein the predetermined amount of audio energy is at least eighty percent of a total energy in the statistical distribution of the phase differences.

Assignments (1)

Priority Claims (1)

Continuity (2)

References Cited (84)