Methods and systems for far-field denoise and dereverberation
Method and system for use with audible signals that analyzes the signals into time-frequency frames over first and second time periods. Estimates of the noise and/or reverberation are derived from the frames. Gains are derived from the estimates and raised to a power to create modified gains. The modified gains are applied to the frames in the appropriate time periods. Modified audible signals are output after being processed by the modified gains.
1. A method to adjust suppression of one or more of reverberation and noise from an audible digital signal comprising:
analyzing the audible digital signal into a plurality of time-frequency frames;
deriving a first estimation of one or more of reverberation and noise from one or more of the frames from a first time instant;
deriving a first suppression gain from the first estimation and selecting a first exponent from a predetermined set of exponents;
deriving a modified first suppression gain based on the first suppression gain raised to a power equal to the first exponent;
wherein the modified first suppression gain is applied to one or more of the frames in the first time instant;
deriving a second estimation of one or more of reverberation and noise from one or more of the frames in a second time instant;
deriving a second suppression gain from the second estimation and selecting a second exponent from a predetermined set of exponents;
deriving a modified second suppression gain based on the second suppression gain raised to a power equal to the second exponent;
wherein the modified second suppression gain is applied to one or more of the frames in the second time instant;
outputting an audible signal that involves processing the frames in the first time instant utilizing the first modified suppression gain;
and outputting an audible signal that involves processing the frames in the second time instant utilizing the second modified suppression gain;
wherein the first exponent and the second exponent are different from one another; and
wherein the second time instant is subsequent to the first time instant.
2. The method of claim 1 , wherein said first and second time instants partially overlap one another.
3. The method of claim 1 , wherein said audible signal is single channel or multi-channel or stereo or binaural.
4. The method of claim 1 , wherein the selection of at least one of the first and second exponent is made by a user based upon audible information.
5. The method of claim 1 , wherein the time-frequency frames are derived using a short-time Fourier transform (STFT) or a wavelet transform or a polyphase filterbank or a multi rate filterbank or a quadrature mirror filterbank or a warped filterbank or an auditory-inspired filterbank.
6. The method of claim 1 , wherein the audible digital signal is the audible portion of a multimedia signal.
7. A system to adjust suppression of one or more of reverberation and noise from an audible digital signal comprising:
a signal processing system connectable to one or more microphones and adapted to:
analyze the audible digital signal into a plurality of time-frequency frames;
derive a first estimation of one or more of reverberation and noise from one or more of the frames from a first time instant;
derive a first suppression gain from the first estimation and selecting a first exponent from a predetermined set of exponents;
derive a modified first suppression gain based on the first suppression gain raised to a first power equal to the first exponent;
wherein the modified first suppression gain is applied to one or more of the frames in the first time instant;
derive a second estimation of one or more of reverberation and noise from one or more of the frames in a second time instant;
derive a second suppression gain from the second estimation and selecting a second exponent from a predetermined set of exponents;
deriving a modified second suppression gain based on the second suppression gain raised to a second power equal to the second exponent;
wherein the modified second suppression gain is applied to one or more of the frames in the second time instant;
output an audible signal that involves processing the frames in the first time instant utilizing the first modified suppression gain; and
output an audible signal that involves processing the frames in the second time instant utilizing the second modified suppression gain;
wherein the first exponent and the second exponent are different from one another; and
wherein the second time instant is subsequent to the first time instant.
8. The system of claim 7 , wherein the modified first suppression gain is determined by raising the first suppression gain to a power related to the first exponent.
9. The system of claim 7 , wherein the modified second suppression gain is determined by raising the second suppression gain to a power related to the second exponent.
10. The system of claim 7 , wherein the selection of at least one of the first and second exponent is made by a user based upon audible information.
11. The system of claim 7 , wherein the time-frequency frames are derived using a short-time Fourier transform (STFT) or a wavelet transform or a polyphase filterbank or a multi rate filterbank or a quadrature mirror filterbank or a warped filterbank or an auditory-inspired filterbank.
12. The system of claim 7 , wherein the audible digital signal is the audible portion of a multimedia signal.
13. A method to adjust suppression of one or more of reverberation and noise from a multimedia digital signal comprising:
analyzing at least the audible portion of the multimedia digital signal into a plurality of time-frequency frames;
deriving a first estimation of one or more of reverberation and noise from one or more of the frames from a first time instant;
deriving a first suppression gain from the first estimation and selecting a first exponent from a predetermined set of exponents;
deriving a modified first suppression gain based on the first suppression gain raised to a first power equal to the first exponent;
wherein the modified first suppression gain is applied to one or more of the frames in the first time instant;
deriving a second estimation of one or more of reverberation and noise from one or more of the frames in a second time instant;
deriving a second suppression gain from the second estimation and selecting a second exponent from a predetermined set of exponents;
deriving a modified second suppression gain based on the second suppression gain raised to a second power equal to the second exponent;
wherein the modified second suppression gain is applied to one or more of the frames in the second time instant;
outputting at least the audible portion of the multimedia digital signal that involves processing the frames in the first time instant utilizing the first modified suppression gain;
and outputting at least the audible portion of the multimedia digital signal that involves processing the frames in the second time instant utilizing the second modified suppression gain;
wherein the first exponent and the second exponent are different from one another; and
wherein the second time instant is subsequent to the first time instant.
14. The method of claim 13 , wherein said first and second time instants partially overlap one another.
15. The method of claim 13 , wherein said audible signal is single channel or multi-channel or stereo or binaural.
16. The method of claim 13 , wherein the selection of at least one of the first and second exponent is made by a user based upon audible information.
17. A system to adjust suppression of one or more of reverberation and noise from multimedia digital signal comprising:
a multimedia signal processing system connectable to one or more microphones and adapted to:
analyze at least the audible portion of the multimedia digital signal into a plurality of time-frequency frames;
derive a first estimation of one or more of reverberation and noise from one or more of the frames from a first time instant;
derive a first suppression gain from the first estimation and selecting a first exponent from a predetermined set of exponents;
derive a modified first suppression gain based on the first suppression gain raised to a first power equal to the first exponent;
wherein the modified first suppression gain is applied to one or more of the frames in the first time instant;
derive a second estimation of one or more of reverberation and noise from one or more of the frames in a second time instant;
derive a second suppression gain from the second estimation and selecting a second exponent from a predetermined set of exponents;
derive a modified second suppression gain based on the second suppression gain raised to a second power equal to the second exponent;
wherein the modified second suppression gain is applied to one or more of the frames in the second time instant;
output at least the audible portion of the multimedia signal that involves processing the frames in the first time
instant utilizing the first modified suppression gain; and
output at least the audible portion of the multimedia digital signal that involves processing the frames in the second time instant utilizing the second modified suppression gain;
wherein the first exponent and the second exponent are different from one another; and
wherein the second time instant is subsequent to the first time instant.
18. The system of claim 17 , wherein the modified first suppression gain is determined by raising the first suppression gain to a power related to the first exponent.
19. The system of claim 17 , wherein the modified second suppression gain is determined by raising the second suppression gain to a power related to the second exponent.
20. The system of claim 17 , wherein the selection of at least one of the first and second exponent is made by a user based upon audible information.