Granted Patent B2

US 9,767,826 · App. 15/024,543 · Granted Sep 19, 2017

Abstract

Claims (40)

1. A method, comprising:

receiving signals from speaker-dedicated first and second microphones;

computing, using a computer processor, an energy-based characteristic of the signals for the first and second microphones;

determining a speaker activity detection measure from the energy-based characteristics of the signals for the first and second microphones;

detecting acoustic events using power spectra for the signals from the first and second microphones, wherein the acoustic events include double talk determined using a smoothed measure of speaker activity that is thresholded; and

determining a robust speaker activity detection measure from the speaker activity measure and the detected acoustic events.

2. The method according to claim 1 , wherein the signal from the speaker-dedicated first microphone includes signals from a plurality of microphones for a first speaker.

3. The method according 1 , wherein the energy-based characteristics include one or more of power ratio, log power ratio, comparison of powers, and adjusting powers with coupling factors prior to comparison.

4. The method according to claim 1 , further including providing the robust speaker activity detection measure to a speech enhancement module.

5. The method according to claim 1 , further including using the robust speaker activity measure to control microphone selection.

6. The method according to claim 5 , further including using only the selected microphone in signal speech enhancement.

7. The method according to claim 5 , further including using SNR of the signals for the microphone selection.

8. The method according to claim 1 , further including using the robust speaker detection activity measure to control a signal mixer.

9. The method according to claim 1 , wherein the acoustic events include one or more of local noise, wind noise, diffuse sound, double-talk.

10. The method according to claim 1 , excluding use of a signal from a first microphone based on detection of an event local to the first microphone.

11. The method according to claim 1 , further including selecting a first signal of the signals from the first and second microphones based on SNR.

12. The method according to claim 1 , further including receiving the signal from at least one microphone on a seat belt of a vehicle.

13. The method according to claim 1 , further including performing a microphone signal pair-wise comparison of power or spectra.

14. The method according to claim 1 , further including computing the energy-based characteristic of the signals for the first and second microphones by:

determining a speech signal power spectral density (PSD) for a plurality of microphone channels;

determining a logarithmic signal to power ratio (SPR) from the determined PSD for the plurality of microphones;

adjusting the logarithmic SPR for the plurality of microphones by using a first threshold;

determining a signal to noise ratio (SNR) for the plurality of microphone channels;

counting a number of times per sample quantity the adjusted logarithmic SPR is above and below a second threshold;

determining speaker activity detection (SAD) values for the plurality of microphone channels weighted by the SNR; and

comparing the SAD values against a third threshold to select a first one of the plurality of microphone channels for the speaker.

15. A system, comprising:

a speaker activity detection means for detecting speech in a first speaker-dedicated microphone and/or a second speaker-dedicated microphone;

an acoustic event detection means for detecting acoustic events, wherein the acoustic event detection means is coupled to the speaker activity means,

wherein the acoustic events include double talk determined using a smoothed measure of speaker activity that is thresholded,

a robust speaker activity detection means for detecting speech based on information from the speaker activity detection means and the acoustic event detection means; and

a speech enhancement means for enhancing a speech signal from the robust speaker activity detection means.

16. The system according to claim 15 , further including a SNR means and a channel selection means coupled to the SNR means, the robust speaker identification means, and the event detection means.

17. An article, comprising:

a non-transitory computer readable medium having stored instructions that enable a machine to:

receive signals from speaker-dedicated first and second microphones;

compute an energy-based characteristic of the signals for the first and second microphones;

determine a speaker activity detection measure from the energy-based characteristics of the signals for the first and second microphones;

detect acoustic events using power spectra for the signals from the first and second microphones, wherein the acoustic events include double talk determined using a smoothed measure of speaker activity that is thresholded; and

determine a robust speaker activity detection measure from the speaker activity measure and the detected acoustic events.

Assignments (8)