IP Library Granted Patent US 8,494,177
Granted Patent B2
US 8,494,177 · App. 12/139,355 · Granted Jul 23, 2013

Virtual microphone array systems using dual omindirectional microphone array (DOMA)

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,494,177
App. No.
12/139,355
Granted
Jul 23, 2013
Kind
B2
Abstract

A dual omnidirectional microphone array noise suppression is described. Compared to conventional arrays and algorithms, which seek to reduce noise by nulling out noise sources, the array of an embodiment is used to form two distinct virtual directional microphones which are configured to have very similar noise responses and very dissimilar speech responses. The only null formed is one used to remove the speech of the user from V 2 . The two virtual microphones may be paired with an adaptive filter algorithm and VAD algorithm to significantly reduce the noise without distorting the speech, significantly improving the SNR of the desired speech over conventional noise suppression systems.

Claims (73)

1. A system comprising:

a microphone array including a first physical microphone outputting a first microphone signal and a second physical microphone outputting a second microphone signal;

a processing component coupled to the microphone array and generating a virtual microphone array comprising a first virtual microphone and a second virtual microphone, the first virtual microphone comprising a first combination of the first microphone signal and the second microphone signal and having a first linear response to speech and a first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a speech source located within a predetermined angle relative to an axis of the microphone array, the second virtual microphone comprising a second combination of the first microphone signal and the second microphone signal, the second virtual microphone having a second linear response to speech and a second linear response to noise, the second linear response to noise being substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech being substantially dissimilar to the first linear response to speech, wherein the second combination is different from the first combination; and

an adaptive noise removal application coupled to the processing component and generating denoised output signals by forming a plurality of combinations of signals output from the first virtual microphone and the second virtual microphone, wherein the denoised output signals include less acoustic noise than acoustic signals received at the microphone array.

2. The system of claim 1 , wherein the first and second physical microphones are omnidirectional.

3. The system of claim 1 , wherein the first linear response to speech is devoid of a null, wherein the speech is human speech.

4. The system of claim 3 , wherein the second linear response to speech includes a single null oriented in a direction toward a source of the speech.

5. The system of claim 4 , wherein the single null is a region of the second linear response to speech having a measured response level that is lower than the measured response level of any other region of the second linear response to speech.

6. The system of claim 4 , wherein the second linear response to speech includes a primary lobe oriented in a direction away from the source of the speech.

7. The system of claim 6 , wherein the primary lobe is a region of the second linear response to speech having a measured response level that is greater than the measured response level of any other region of the second linear response to speech.

8. The system of claim 4 , wherein the first physical microphone and the second physical microphone are positioned along an axis and separated by a first distance.

9. The system of claim 8 , wherein a midpoint of the axis is a second distance from the speech source that generates the speech, wherein the speech source is located in a direction defined by an angle relative to the midpoint.

10. The system of claim 9 , wherein the first virtual microphone comprises the second microphone signal subtracted from the first microphone signal.

11. The system of claim 10 , wherein the first microphone signal is delayed.

12. The system of claim 11 , wherein the delay is raised to a power that is proportional to a time difference between arrival of the speech at the first virtual microphone and arrival of the speech at the second virtual microphone.

13. The system of claim 11 , wherein the delay is raised to a power that is proportional to a sampling frequency multiplied by a quantity equal to a third distance subtracted from a fourth distance, the third distance being between the first physical microphone and the speech source and the fourth distance being between the second physical microphone and the speech source.

14. The system of claim 10 , wherein the second microphone signal is multiplied by a ratio, wherein the ratio is a ratio of a third distance to a fourth distance, the third distance being between the first physical microphone and the speech source and the fourth distance being between the second physical microphone and the speech source.

15. The system of claim 9 , wherein the second virtual microphone comprises the first microphone signal subtracted from the second microphone signal.

16. The system of claim 15 , wherein the first microphone signal is delayed.

17. The system of claim 16 , wherein the delay is raised to a power that is proportional to a time difference between arrival of the speech at the first virtual microphone and arrival of the speech at the second virtual microphone.

18. The system of claim 16 , wherein the power is proportional to a sampling frequency multiplied by a quantity equal to a third distance subtracted from a fourth distance, the third distance being between the first physical microphone and the speech source and the fourth distance being between the second physical microphone and the speech source.

19. The system of claim 18 , wherein the first microphone signal is multiplied by a ratio, wherein the ratio is a ratio of the third distance to the fourth distance.

20. The system of claim 1 , wherein the first virtual microphone comprises the second microphone signal subtracted from a delayed version of the first microphone signal.

21. The system of claim 20 , wherein the second virtual microphone comprises a delayed version of the first microphone signal subtracted from the second microphone signal.

22. The system of claim 1 , comprising a voice activity detector (VAD) coupled to the processing component, the VAD generating voice activity signals.

23. The system of claim 1 , comprising a communication channel coupled to the processing component, the communication channel comprising at least one of a wireless channel, a wired channel, and a hybrid wireless/wired channel.

24. The system of claim 23 , comprising a communication device coupled to the processing component via the communication channel, the communication device comprising one or more of cellular telephones, satellite telephones, portable telephones, wireline telephones, Internet telephones, wireless transceivers, wireless communication radios, personal digital assistants (PDAs), and personal computers (PCs).

25. A system comprising:

a first virtual microphone formed from a first combination of a first microphone signal and a second microphone signal, wherein the first microphone signal is generated by a first physical microphone and the second microphone signal is generated by a second physical microphone;

a second virtual microphone formed from a second combination of the first microphone signal and the second microphone signal, wherein the second combination is different from the first combination,

wherein the first virtual microphone has a first linear response to speech and first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a speech source located within a predetermined angle relative to an axis of the microphone array and devoid of a null, wherein the second virtual microphone has a second linear response to speech that has a single null oriented in a direction toward a source of the speech and a second linear response to noise, wherein the second linear response to noise is substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech is substantially dissimilar to the first linear response to speech, wherein the speech is human speech; and

an adaptive noise removal application coupled to the first and second virtual microphones and generating denoised output signals by forming a plurality of combinations of signals output from the first virtual microphone and the second virtual microphone, wherein the denoised output signals include less acoustic noise than acoustic signals received at the first and second physical microphones.

26. The system of claim 25 , wherein the single null is a region of the second linear response to speech having a measured response level that is lower than the measured response level of any other region of the second linear response to speech.

27. The system of claim 25 , wherein the second linear response to speech includes a primary lobe oriented in a direction away from the source of the speech.

28. The system of claim 27 , wherein the primary lobe is a region of the second linear response to speech having a measured response level that is greater than the measured response level of any other region of the second linear response to speech.

29. A system comprising:

a first microphone outputting a first microphone signal and a second microphone outputting a second microphone signal, wherein the first microphone and the second microphone are omnidirectional microphones;

a virtual microphone array comprising a first virtual microphone and a second virtual microphone, wherein the first virtual microphone comprises a first combination of the first microphone signal and the second microphone signal and has a first linear response to speech and a first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a speech source located within a predetermined angle relative to an axis of the microphone array, wherein the second virtual microphone comprises a second combination of the first microphone signal and the second microphone signal and has a second linear response to speech and a second linear response to noise, the second linear response to noise being substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech being substantially dissimilar to the first linear response to speech, wherein the second combination is different from the first combination, wherein the first virtual microphone and the second virtual microphone are distinct virtual directional microphones; and

an adaptive noise removal application coupled to the virtual microphone array and generating denoised output signals by forming a plurality of combinations of signals output from the first virtual microphone and the second virtual microphone, wherein the denoised output signals include less acoustic noise than acoustic signals received at the first microphone and the second microphone.

30. A system comprising:

a first physical microphone generating a first microphone signal;

a second physical microphone generating a second microphone signal;

a processing component coupled to the first microphone signal and the second microphone signal, the processing component generating a virtual microphone array comprising a first virtual microphone and a second virtual microphone, the first virtual microphone having a first linear response to speech and a first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a speech source located within a predetermined angle relative to an axis of the microphone array, the second virtual microphone having a second linear response to speech and second linear response to noise, the second linear response to noise being substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech being substantially dissimilar to the first linear response to speech,

wherein the first virtual microphone comprises the second microphone signal subtracted from a delayed version of the first microphone signal,

wherein the second virtual microphone comprises a delayed version of the first microphone signal subtracted from the second microphone signal; and

an adaptive noise removal application coupled to the processing component and generating denoised output signals, wherein the denoised output signals include less acoustic noise than acoustic signals received at the first physical microphone and the second physical microphone.

31. The system of claim 30 , wherein the first linear response to speech is devoid of a null, wherein the speech is human speech.

32. The system of claim 31 , wherein the second linear response to speech includes a single null oriented in a direction toward a source of the speech.

33. The system of claim 32 , wherein the single null is a region of the second linear response to speech having a measured response level that is lower than the measured response level of any other region of the second linear response to speech.

34. The system of claim 32 , wherein the second linear response to speech includes a primary lobe oriented in a direction away from the source of the speech.

35. The system of claim 34 , wherein the primary lobe is a region of the second linear response to speech having a measured response level that is greater than the measured response level of any other region of the second linear response to speech.

36. The system of claim 32 , wherein the first physical microphone and the second physical microphone are positioned along an axis and separated by a first distance.

37. The system of claim 36 , wherein a midpoint of the axis is a second distance from the speech source that generates the speech, wherein the speech source is located in a direction defined by an angle relative to the midpoint.

38. The system of claim 37 , wherein one or more of the first microphone signal and the second microphone signal is delayed.

39. The system of claim 38 , wherein the delay is raised to a power that is proportional to a time difference between arrival of the speech at the first virtual microphone and arrival of the speech at the second virtual microphone.

40. The system of claim 39 , wherein the power is proportional to a sampling frequency multiplied by a quantity equal to a third distance subtracted from a fourth distance, the third distance being between the first physical microphone and the speech source and the fourth distance being between the second physical microphone and the speech source.

41. The system of claim 37 , wherein one or more of the first microphone signal and the second microphone signal is multiplied by a gain factor.

42. The system of claim 30 , comprising a voice activity detector (VAD) coupled to the processing component, the VAD generating voice activity signals.

43. The system of claim 30 , comprising a communication channel coupled to the processing component, the communication channel comprising at least one of a wireless channel, a wired channel, and a hybrid wireless/wired channel.

44. The system of claim 43 , comprising a communication device coupled to the processing component via the communication channel, the communication device comprising one or more of cellular telephones, satellite telephones, portable telephones, wireline telephones, Internet telephones, wireless transceivers, wireless communication radios, personal digital assistants (PDAs), and personal computers (PCs).

45. A system comprising:

a physical microphone array including a first physical microphone and a second physical microphone, the first physical microphone outputting a first microphone signal and the second physical microphone outputting a second microphone signal;

a virtual microphone array comprising a first virtual microphone and a second virtual microphone, the first virtual microphone comprising a first combination of the first microphone signal and the second microphone signal and having a first linear response to speech and a first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a source of speech located within a predetermined angle relative to an axis of the microphone array, the second virtual microphone comprising a second combination of the first microphone signal and the second microphone signal and having a second linear response to speech and a second linear response to noise, the second linear response to noise being substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech being substantially dissimilar to the first linear response to speech, wherein the second combination is different from the first combination and the virtual microphone array includes a single null oriented in a direction toward the source of speech of a human speaker; and

an adaptive noise removal application coupled to the virtual microphone array and generating denoised output signals by forming a plurality of combinations of signals output from the virtual microphone array, wherein the denoised output signals include less acoustic noise than acoustic signals received at the physical microphone array.

46. The system of claim 45 , wherein the first linear response to speech is devoid of a null, wherein the second linear response to speech includes the single null.

47. The system of claim 46 , wherein the single null is a region of the second linear response to speech having a measured response level that is lower than the measured response level of any other region of the second linear response to speech.

48. The system of claim 46 , wherein the second linear response to speech includes a primary lobe oriented in a direction away from the source of the speech.

49. The system of claim 48 , wherein the primary lobe is a region of the second linear response to speech having a measured response level that is greater than the measured response level of any other region of the second linear response to speech.

50. The system of claim 45 , wherein the single null is located at a distance from the physical microphone array where the source of the speech is expected to be.

51. A system comprising:

a first virtual microphone comprising a first combination of a first microphone signal and a second microphone signal, the first virtual microphone having a first linear response to speech and a first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a speech source located within a predetermined angle relative to an axis of the microphone array, wherein the first microphone signal is output from a first physical microphone and the second microphone signal is output from a second physical microphone;

a second virtual microphone comprising a second combination of the first microphone signal and the second microphone signal, the second virtual microphone having a second linear response to speech and a second linear response to noise, the second linear response to noise being substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech being substantially dissimilar to the first linear response to speech, wherein the second combination is different from the first combination, wherein the first virtual microphone and the second virtual microphone are distinct virtual directional microphones; and

a processing component coupled to the first and second virtual microphones, the processing component including an adaptive noise removal application receiving acoustic signals from the first virtual microphone and the second virtual microphone and generating an output signal, wherein the output signal is a denoised acoustic signal.

Assignments (18)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2021
From: JI AUDIO HOLDINGS LLC
To: JAWBONE INNOVATIONS, LLC
Reel/Frame 056323/0728 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2021
From: JAWB ACQUISITION LLC
To: JI AUDIO HOLDINGS LLC
Reel/Frame 056320/0195 →
RELEASE OF SECURITY INTEREST Recorded Feb 2, 2021
From: BLACKROCK ADVISORS, LLC
To: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 055207/0593 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPL. NO. 13/982,956 PREVIOUSLY RECORDED AT REEL: 035531 FRAME: 0554. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Nov 2, 2017
From: SILVER LAKE WATERMAN FUND, L.P., AS ADMINISTRATIVE AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
Reel/Frame 045167/0597 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2017
From: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
To: JAWB ACQUISITION LLC
Reel/Frame 043746/0693 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2017
From: ALIPHCOM
To: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 043711/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: ALIPHCOM DBA JAWBONE
To: ALIPHCOM, LLC
Reel/Frame 043637/0796 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: ALIPHCOM, LLC
To: JAWB ACQUISITION, LLC
Reel/Frame 043638/0025 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. 13870843 PREVIOUSLY RECORDED ON REEL 036500 FRAME 0173. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jan 26, 2017
From: ALIPHCOM; MACGYVER ACQUISITION, LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 041793/0347 →
SECURITY INTEREST Recorded Aug 27, 2015
From: ALIPHCOM; MACGYVER ACQUISITION LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 036500/0173 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNMENT PREVIOUSLY RECORDED ON REEL 021540 FRAME 0495. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNEE NAME WAS TYPOGRAPHICALLY INCORRECT AS "ALIPHCOM, INC." AND SHOULD BE CORRECTED TO "ALIPHCOM" WITHOUT THE "INC.,". Recorded May 19, 2015
From: BURNETT, GREGORY C.
To: ALIPHCOM
Reel/Frame 035727/0892 →
SECURITY INTEREST Recorded Apr 28, 2015
From: ALIPHCOM; MACGYVER ACQUISITION LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 035531/0312 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2015
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
Reel/Frame 035531/0419 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2015
From: SILVER LAKE WATERMAN FUND, L.P., AS ADMINISTRATIVE AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION, LLC
Reel/Frame 035531/0554 →
NOTICE OF SUBSTITUTION OF ADMINISTRATIVE AGENT IN PATENTS Recorded Dec 3, 2014
From: DBD CREDIT FUNDING LLC, AS RESIGNING AGENT
To: SILVER LAKE WATERMAN FUND, L.P., AS SUCCESSOR AGENT
Reel/Frame 034523/0705 →
PATENT SECURITY AGREEMENT Recorded Dec 4, 2013
From: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 031764/0100 →
SECURITY AGREEMENT Recorded Aug 8, 2013
From: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.
To: DBD CREDIT FUNDING LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 030968/0051 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2008
From: BURNETT, GREGORY C.
To: ALIPHCOM, INC.
Reel/Frame 021540/0495 →