Integrated speech intelligibility enhancement system and acoustic echo canceller

1. A system, comprising:

estimation logic configured to calculate characteristics associated with at least a near-end speech signal to be transmitted by an audio device, the calculated characteristics including an estimated level of near-end background noise that is associated with the near-end speech signal, the estimated level including a plurality of estimations of the near-end background noise corresponding to a plurality of respective sub-band components of the near-end speech signal;

a processing module configured to receive the calculated characteristics and to modify a far-end speech signal, which is received for playback by the audio device, based on at least the calculated characteristics to increase the intelligibility thereof by boosting the far-end speech signal over the near-end background noise by performing spectral shaping on the far-end speech signal based on one or more of the estimations corresponding to one or more of the sub-band components; and

an acoustic echo canceller configured to receive the calculated characteristics and to suppress acoustic echo present in the near-end speech signal based on at least the calculated characteristics.

2. The system of claim 1 , wherein the estimated level of the near-end background noise that is associated with the near-end speech signal comprises a measure of loudness obtained by applying a weight to one or more estimations of the plurality of estimations of the near-end background noise corresponding to one or more respective sub-band components of the plurality of sub-band components of the near-end speech signal.

3. The system of claim 1 , wherein the calculated characteristics comprise a determination of whether voice activity is present in the far-end speech signal; and

wherein the processing module is configured to control the operation of a level estimator based on the determination, the level estimator being configured to calculate an estimated signal level associated with the far-end speech signal, and to apply a gain to the far-end speech signal wherein the amount of gain applied is based on the estimated signal level.

4. The system of claim 3 , wherein the estimation logic is configured to determine whether voice activity is present in the far-end speech signal by analyzing one or more sub-band components of the far-end speech signal.

5. The system of claim 1 , wherein the calculated characteristics comprise a determination of whether voice activity is present in the near-end speech signal; and

wherein the processing module is configured to control the operation of a level estimator based on the determination, the level estimator being configured to calculate an estimated signal level associated with the far-end speech signal, and to apply a gain to the far-end speech signal wherein the amount of gain applied is based on the estimated signal level.

6. The system of claim 5 , wherein the estimation logic is configured to determine whether voice activity is present in the near-end speech signal by analyzing the one or more sub-band components of the near-end speech signal.

7. The system of claim 1 , further comprising:

a plurality of microphones; and

a beamformer connected to the plurality of microphones, the beamformer being configured to perform spatial filtering on signals received from the plurality of microphones to generate the near-end speech signal;

wherein the estimation logic is configured to calculate the estimated level of the near-end background noise that is associated with the near-end speech signal by calculating an estimated level of the near-end background noise one or more estimations of the plurality of estimations of the near-end background noise corresponding to one or more respective sub-band components of the plurality of sub-band components of the near-end speech signal at one or more of the microphones in the plurality of microphones.

8. The system of claim 7 , wherein the estimation logic is configured to calculate the estimated level of the near-end background noise at one or more of the microphones in the plurality of microphones by modifying one or more estimations of the plurality of estimations of the near-end background noise corresponding to one or more respective sub-band components of the plurality of sub-band components of the near-end speech signal to account for a noise changing effect produced by the beamformer.

9. A method, comprising:

calculating characteristics associated with at least a near-end speech signal to be transmitted by an audio device, said calculating comprising:

calculating an estimated level of near-end background noise that is associated with the near-end speech signal, the estimated level including a plurality of estimations of the near-end background noise corresponding to a plurality of respective sub-band components of the near-end speech signal;

modifying a far-end speech signal, which is received for playback by the audio device, based on at least the calculated characteristics to increase the intelligibility thereof by boosting the far-end speech signal over the near-end background noise, said modifying comprising:

performing spectral shaping on the far-end speech signal based on one or more of the estimations of the near-end background noise corresponding to one or more of the sub-band components; and

suppressing acoustic echo present in the near-end speech signal based on at least the calculated characteristics.

10. The method of claim 9 , wherein calculating the estimated level of the near-end background noise that is associated with the near-end speech signal comprises calculating a measure of loudness by applying a weight to one or more estimations of the plurality of estimations of the near-end background noise corresponding to one or more respective sub-band components of the plurality of sub-band components of the near-end speech signal.

11. The method of claim 9 , wherein calculating characteristics associated with at least the near-end speech signal comprises determining whether voice activity is present in the far-end speech signal; and

wherein modifying the far-end speech signal based on at least the calculated characteristics comprises controlling the operation of a level estimator based on the determination, wherein the level estimator calculates an estimated signal level associated with the far-end speech signal, and applying a gain to the far-end speech signal wherein the amount of gain applied is based on the estimated signal level.

12. The method of claim 11 , wherein determining whether voice activity is present in the far-end speech signal comprises analyzing one or more sub-band components of the far-end speech signal.

13. The method of claim 9 , wherein calculating characteristics associated with at least the near-end speech signal comprises determining whether voice activity is present in the near-end speech signal; and

wherein modifying the far-end speech signal based on at least the calculated characteristics comprises controlling the operation of a level estimator based on the determination, wherein the level estimator calculates an estimated signal level associated with the far-end speech signal, and applying a gain to the far-end speech signal wherein the amount of gain applied is based on the estimated signal level.

14. The method of claim 13 , wherein determining whether voice activity is present in the near-end speech signal comprises analyzing the one or more sub-band components of the near-end speech signal.

15. The method of claim 9 , wherein calculating characteristics associated with at least the near-end speech signal comprises:

calculating the estimated level of the near-end background noise by calculating one or more estimations of the plurality of estimations of the near-end background noise at one or more microphones in a plurality of microphones associated with the audio device.

16. The method of claim 15 , wherein calculating the estimated level of the near-end background noise at one or more microphones in the plurality of microphones associated with the audio device comprises:

modifying one or more estimations of the plurality of estimations of the near-end background noise corresponding to one or more respective sub-band components of the plurality of sub-band components of the near-end speech signal to account for a noise changing effect produced by a beamformer coupled to the plurality of microphones.

17. A system, comprising:

estimation logic configured to calculate characteristics associated with at least a far-end speech signal received for playback by an audio device, the calculated characteristics including an estimated level of near-end background noise that is associated with a near-end speech signal, the estimated level including a plurality of estimations of the near-end background noise corresponding to a plurality of respective sub-band components of the near-end speech signal;

a processing module configured to receive the calculated characteristics and to modify the far-end speech signal based on at least the calculated characteristics to increase the intelligibility thereof by boosting the far-end speech signal over the near-end background noise by performing spectral shaping on the far-end speech signal based on one or more of the estimations of the near-end background noise corresponding to one or more of the sub-band components; and

an acoustic echo canceller configured to receive the calculated characteristics and to suppress acoustic echo present in the near-end speech signal, which is to be transmitted by the audio device, based on at least the calculated characteristics.

18. The system of claim 17 , wherein the estimated level of the near-end background noise that is associated with the near-end speech signal comprises a measure of loudness obtained by applying a weight to one or more estimations of the plurality of estimations of the near-end background noise corresponding to one or more respective sub-band components of the plurality of sub-band components of the near-end speech signal.

19. The system of claim 17 , wherein the calculated characteristics comprise a determination of whether voice activity is present in the near-end speech signal; and

wherein the processing module is configured to control the operation of a level estimator based on the determination, the level estimator being configured to calculate an estimated signal level associated with the far-end speech signal, and to apply a gain to the far-end speech signal wherein the amount of gain applied is based on the estimated signal level.

20. The system of claim 19 , wherein the estimation logic is configured to determine whether voice activity is present in the near-end speech signal by analyzing the one or more sub-band components of the near-end speech signal.

21. The system of claim 17 , further comprising:

a plurality of microphones; and

a beamformer connected to the plurality of microphones, the beamformer being configured to perform spatial filtering on signals received from the plurality of microphones to generate the near-end speech signal;

wherein the estimation logic is configured to calculate the estimated level of the near-end background noise that is associated with the near-end speech signal by calculating one or more estimations of the plurality of estimations of the near-end background noise corresponding to one or more respective sub-band components of the plurality of sub-band components of the near-end speech signal at one or more of the microphones in the plurality of microphones.

22. The system of claim 21 , wherein the estimation logic is configured to calculate the estimated level of the near-end background noise at one or more of the microphones in the plurality of microphones by modifying one or more estimations of the plurality of estimations of the near-end background noise corresponding to one or more respective sub-band components of the plurality of sub-band components of the near-end speech signal to account for a noise changing effect produced by the beamformer.

23. A method, comprising:

calculating characteristics associated with at least a far-end speech signal received for playback by an audio device, said calculating comprising:

calculating an estimated level of near-end background noise that is associated with a near-end speech signal, the estimated level including a plurality of estimations of the near-end background noise corresponding to a plurality of respective sub-band components of the near-end speech signal;

modifying the far-end speech signal based on at least the calculated characteristics to increase the intelligibility thereof by boosting the far-end speech signal over the near-end background noise, said modifying comprising:

performing spectral shaping on the far-end speech signal based on one or more of the estimations of the near-end background noise corresponding to one or more of the sub-band components; and

suppressing acoustic echo present in the near-end speech signal based on at least the calculated characteristics.

24. The method of claim 23 , wherein calculating characteristics associated with at least the far-end speech signal comprises determining whether voice activity is present in the far-end speech signal; and

wherein modifying the far-end speech signal based on at least the calculated characteristics comprises controlling the operation of a level estimator based on the determination, wherein the level estimator calculates an estimated signal level associated with the far-end speech signal, and applying a gain to the far-end speech signal wherein the amount of gain applied is based on the estimated signal level.

25. The method of claim 24 , wherein determining whether voice activity is present in the far-end speech signal comprises analyzing one or more sub-band components of the far-end speech signal.

26. The method of claim 23 , wherein calculating characteristics associated with at least the far-end speech signal comprises determining whether voice activity is present in the near-end speech signal; and

wherein modifying the far-end speech signal based on at least the calculated characteristics comprises controlling the operation of a level estimator based on the determination, wherein the level estimator calculates an estimated signal level associated with the far-end speech signal, and applying a gain to the far-end speech signal wherein the amount of gain applied is based on the estimated signal level.

27. The method of claim 26 , wherein determining whether voice activity is present in the near-end speech signal comprises analyzing the one or more sub-band components of the near-end speech signal.

28. The method of claim 23 , wherein calculating characteristics associated with at least the far-end speech signal comprises:

calculating the estimated level of the near-end background noise by calculating one or more estimations of the plurality of estimations of the near-end background noise at one or more microphones in a plurality of microphones associated with the audio device.

29. The method of claim 28 , wherein calculating the estimated level of the near-end background noise at one or more microphones in the plurality of microphones associated with the audio device comprises:

modifying one or more estimations of the plurality of estimations of the near-end background noise corresponding to one or more respective sub-band components of the plurality of sub-band components of the near-end speech signal to account for a noise changing effect produced by a beamformer coupled to the plurality of microphones.

30. The method of claim 23 , wherein calculating the estimated level of the near-end background noise that is associated with the near-end speech signal comprises calculating a measure of loudness by applying a weight to one or more estimations of the plurality of estimations of the near-end background noise corresponding to one or more respective sub-band components of the plurality of sub-band components of the near-end speech signal.

31. The method of claim 23 , wherein calculating characteristics associated with at least the near-end speech signal comprises determining whether voice activity is present in the near-end speech signal; and

wherein modifying the far-end speech signal based on at least the calculated characteristics comprises controlling the operation of a level estimator based on the determination, wherein the level estimator calculates an estimated signal level associated with the far-end speech signal, and applying a gain to the far-end speech signal wherein the amount of gain applied is based on the estimated signal level.

32. A system, comprising:

estimation logic configured to calculate characteristics associated with at least one of a near-end speech signal to be transmitted by an audio device or a far-end speech signal received for playback by the audio device, the calculated characteristics including an estimated level of near-end background noise that is associated with the near-end speech signal, the estimated level including a plurality of estimations of the near-end background noise corresponding to a plurality of respective sub-band components of the near-end speech signal;

a processing module configured to receive the calculated characteristics and to modify the far-end speech signal based on at least the calculated characteristics to increase the intelligibility thereof by applying at least one of automatic volume boosting, amplitude compression, dispersion filtering or spectral shaping to the far-end speech signal based on one or more of the estimations corresponding to one or more of the sub-band components; and

an acoustic echo canceller configured to suppress acoustic echo present in the near-end speech signal based on at least the calculated characteristics.

33. The system of claim 32 , wherein the calculated characteristics include a measure of loudness of the near-end background noise that is associated with the near-end speech signal, the measure of loudness obtained by applying a weight to one or more estimated levels of the near-end background noise corresponding to one or more sub-band components of the near-end speech signal.

34. The system of claim 32 , wherein the calculated characteristics comprise a determination of whether voice activity is present in the far-end speech signal; and

wherein the processing module is configured to control the operation of a level estimator based on the determination, the level estimator being configured to calculate an estimated signal level associated with the far-end speech signal, and to apply a gain to the far-end speech signal wherein the amount of gain applied is based on the estimated signal level.

35. The system of claim 34 , wherein the estimation logic is configured to determine whether voice activity is present in the far-end speech signal by analyzing one or more sub-band components of the far-end speech signal.

36. The system of claim 32 , wherein the calculated characteristics comprise a determination of whether voice activity is present in the near-end speech signal; and

wherein the processing module is configured to control the operation of a level estimator based on the determination, the level estimator being configured to calculate an estimated signal level associated with the far-end speech signal, and to apply a gain to the far-end speech signal wherein the amount of gain applied is based on the estimated signal level.

37. The system of claim 36 , wherein the estimation logic is configured to determine whether voice activity is present in the near-end speech signal by analyzing one or more sub-band components of the near-end speech signal.

38. The system of claim 32 , further comprising:

a plurality of microphones; and

a beamformer connected to the plurality of microphones, the beamformer being configured to perform spatial filtering on signals received from the plurality of microphones to generate the near-end speech signal;

wherein the calculated characteristics include an estimated level of the near-end background noise that is associated with the near-end speech signal and wherein the estimation logic is configured to calculate the estimated level of the near-end background noise that is associated with the near-end speech signal by calculating an estimated level of the near-end background noise at one or more of the microphones in the plurality of microphones.

39. The system of claim 38 , wherein the estimation logic is configured to calculate the estimated level of the near-end background noise at one or more of the microphones in the plurality of microphones by modifying the estimated level of the near-end background noise that is associated with the near-end speech signal to account for a noise changing effect produced by the beamformer.