System and method for noise estimation with music detection
In a system and method for noise estimation with music detection described herein provides for generating a music classification for music content in an audio signal. The music detector may classify the audio signal as music or non-music. The non-music signal may be considered to be signal and noise. An adaption rate may be adjusted responsive to the generated music classification. A noise estimate is calculated applying the adjusted adaption rate. The system and method may mitigate the noise modeling algorithms being misled by the music components.
1. A method, executable on one or more processors, for noise estimation with music detection, the method comprising:
generating a music classification for music content in an audio signal comprising a value selected from a range of values indicating a proportion of an amount of music content to an amount of non-music content in the audio signal and a voice classification for voice content in an audio signal;
adjusting an adaption rate responsive to the generated music classification and the generated voice classification; and
calculating a noise estimate applying the adjusted adaption rate;
where the adaption rate varies inversely with the strength of the music content detected in the audio signal.
2. The method of claim 1 , wherein generating the music classification comprises applying one or more of the following music detectors to the audio signal: an autocorrelation based periodicity detector, a beat detector and a high frequency harmonic detector.
3. The method of claim 2 , wherein the autocorrelation based periodicity detector further comprises a downsampler and a low frequency filter.
4. The method of claim 3 , wherein the downsampler discards a repeating pattern of audio samples.
5. The method of claim 1 , the method further comprising:
adjusting the adaption rate responsive to the generated voice classification comprising an estimated proportion of voice content.
6. The method of claim 1 , wherein adjusting the adaption rate comprises a proportional adjustment to the adaption rate responsive to changes of the generated music classification.
7. The method of claim 1 , where the generated music classification further comprises smoothing over time and frequency.
8. The method of claim 1 , wherein calculating the noise estimate comprises updating the calculation according to a continuous, a periodic or an aperiodic schedule.
9. A system for noise estimation with music detection comprising:
a music detector to generate a music classification for music content in an audio signal, the generated music classification comprising a value selected from a range of values indicating a proportion of an amount of music content to an amount of non-music content in the audio signal;
a voice detector to generate a voice classification for voice content in the audio signal;
a rate adaptor to adjust an adaption rate that once actuated is based on and responsive to the generated music classification and the voice classification; and
a noise estimator to calculate a noise estimate applying the adjusted adaption rate;
where the adaption rate varies proportionally with the music content detected in the audio signal.
10. The system for noise estimation with music detection of claim 9 , wherein the music detector further comprises one or more of: an autocorrelation based periodicity detector, a beat detector and a high frequency harmonic detector.
11. The system for noise estimation with music detection of claim 10 , wherein the autocorrelation based periodicity detector further comprises a downsampler and a low frequency filter.
12. The system for noise estimation with music detection of claim 11 , wherein the downsampler discards a repeating pattern of audio samples.
13. The system for noise estimation with music detection of claim 9 , the method further comprising:
wherein the voice detector generates a noise classification for noise content in the audio signal.
14. The system for noise estimation with music detection of claim 9 , wherein adjusting the adaption rate comprises a proportional adjustment to the adaption rate responsive to changes of the generated music classification.
15. The system for noise estimation with music detection of claim 9 , wherein the music detector further smoothes the generated music classification over time and frequency.
16. The system for noise estimation with music detection of claim 9 , wherein the noise estimator further updates the calculated noise estimate according to a continuous, a periodic or an aperiodic schedule.
17. The method of claim 1 , where the generated music classification comprises multiple music classification values.
18. The method of claim 1 , where the generated music classification comprises a music classification value for steady-state music components of the music content and a music classification value for transient music components of the music content.