Amplitude masking of spectra for speech recognition method and apparatus
View Patent ↗In a speech recognition platform, a masking unit 17 can be utilized to mask noisy content within an audio sample. By masking such noise in a dynamic but predictable manner, valid content can be preserved while largely overcoming the random and detrimental presence of noise. In one embodiment, speech recognition features are extracted pursuant to a hierarchical process that localizes, at least to some extent, some of the resultant features from other resultant features. As a result, noisy or otherwise unreliable information corresponding to the audio sample will not be leveraged unduly across the entire feature set. In another embodiment, an average energy value for processed samples is calculated with individual energy values that are downwardly weighted when such individual energy values are likely representative of noise.
1. A method comprising:
providing information having varying amplitude in a spectral domain to be speech-recognized;
adding masking information to the provided information as a function, at least in part, of the amplitude of the provided information to provide modified information;
extracting at least some speech recognition features from the modified information by processing the modified information to obtain localized speech recognition coefficients wherein at least some of the localized speech recognition coefficients are determined independent of other of the speech recognition coefficients.
2. The method of claim 1 wherein providing information includes providing digitized information that corresponds to an original analog audio input signal.
3. The method of claim 1 wherein providing information having varying amplitude in a spectral domain includes providing information that includes harmonics, which harmonics have corresponding amplitudes that vary in the spectral domain.
4. The method of claim 1 wherein providing information includes using a fast Fourier transform.
5. The method of claim 1 wherein extracting at least some speech recognition features from the modified information comprises processing the modified information to obtain cepstral coefficients corresponding to the modified information.
6. The method of claim 1 wherein processing the modified information to obtain localized speech recognition coefficients wherein at least some of the localized speech recognition coefficients are determined independent of other of the localized speech recognition coefficients includes processing the modified information to obtain localized speech recognition coefficients wherein substantially half of the localized speech recognition coefficients are determined independent of substantially half of the localized speech recognition coefficients.
7. A method comprising:
providing information having varying amplitude in a spectral domain to be speech-recognized;
adding masking information to the provided information as a function, at least in part, of the amplitude of the provided information to provide modified information;
conditioning an average value representing energy of the provided information by downwardly scaling energy amplitude levels in a temporal domain when such energy amplitude levels fall below a predetermined threshold.
8. The method of claim 7 wherein the predetermined threshold represents, at least in part, an average noise level plus an amount that corresponds to peak noise variances.
9. The method of claim 8 wherein conditioning an average value representing energy of the provided information by downwardly scaling energy amplitude levels in a temporal domain when such energy amplitude levels fall below a predetermined threshold includes estimating average energy m of a first N frames of a non-speech signal input and an upper bound M thereof, and for at least some speech frames that follow, scaling the energy amplitude level E by a factor of β wherein:
β
=
{
f
(
1
-
m
/
E
)
+
s
if
E
>
m
&
E
<
M
s
if
E
<=
m
1
if
E
>=
M
where f(.) comprises a monotonically increasing function and s comprises a floor value.
10. The method of claim 7 wherein providing information includes providing digitized information that corresponds to an original analog audio input signal.
11. The method of claim 7 wherein providing information having varying amplitude in a spectral domain includes providing information that includes harmonics, which harmonics have corresponding amplitudes that vary in the spectral domain.
12. The method of claim 7 wherein providing information includes using a fast Fourier transform.
13. A device comprising:
an information signal input;
a spectral transformation unit having an input operably coupled to the information signal input and having an output providing a spectrally transformed information signal; and
a masking unit having an input operably coupled to the output of the spectral transformation unit and having an output providing a modified spectrally transformed information signal wherein at least some amplitude valleys are at least partially masked;
a speech recognition feature extraction unit having an input operably coupled to the output of the masking unit and having an output providing speech recognition features that correspond to an information signal as input at the information signal input and wherein the speech recognition feature extraction unit comprises a localized speech feature extraction unit having an output providing channel energy ratios that correspond to a hierarchical split of a speech spectrum that corresponds to the output of the masking unit.
14. The device of claim 13 wherein the spectral transformation unit comprises a fast Fourier transform unit.
15. The device of claim 13 wherein the speech recognition feature extraction unit comprises a cepstral coefficient extraction unit.
16. The device of claim 13 wherein the masking unit includes masking means for masking portions of the spectrally transformed information signal that correspond to substantially deep valleys as compared to adjacent peaks.
17. The device of claim 16 wherein the masking means further masks portions of the spectrally transformed information signal that correspond to substantially deep valleys as a function of at least the adjacent peaks.
18. A device comprising:
an information signal input;
a spectral transformation unit having an input operably coupled to the information signal input and having an output providing a spectrally transformed information signal; and
a masking unit having an input operably coupled to the output of the spectral transformation unit and having an output providing a modified spectrally transformed information signal wherein at least some amplitude valleys are at least partially masked;
an energy measurement unit having an input operably coupled to the information signal input and an output providing a value that corresponds to information signal energy over a period of time and that is modified to reduce portions of the information signal energy that are less than a predetermined threshold.
19. The device of claim 18 wherein the predetermined threshold corresponds to an average value of noise.
20. The device of claim 19 wherein the average value of noise is modified as a function of noise peaks.