IP Library Granted Patent US 8,503,692
Granted Patent B2
US 8,503,692 · App. 12/139,361 · Granted Aug 6, 2013

Forming virtual microphone arrays using dual omnidirectional microphone array (DOMA)

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,503,692
App. No.
12/139,361
Granted
Aug 6, 2013
Kind
B2
Abstract

A dual omnidirectional microphone array noise suppression is described. Compared to conventional arrays and algorithms, which seek to reduce noise by nulling out noise sources, the array of an embodiment is used to form two distinct virtual directional microphones which are configured to have very similar noise responses and very dissimilar speech responses. The only null formed is one used to remove the speech of the user from V 2 . The two virtual microphones may be paired with an adaptive filter algorithm and VAD algorithm to significantly reduce the noise without distorting the speech, significantly improving the SNR of the desired speech over conventional noise suppression systems.

Claims (60)

1. A method comprising:

forming a first virtual microphone by generating a first combination of a first microphone signal and a second microphone signal, the first virtual microphone having a first linear response to speech and a first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a speech source located within a predetermined angle relative to an axis of the microphone array, wherein the first microphone signal is generated by a first physical microphone and the second microphone signal is generated by a second physical microphone; and

forming a second virtual microphone by generating a second combination of the first microphone signal and the second microphone signal, the second virtual microphone having a second linear response to speech and a second linear response to noise, the second linear response to noise being substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech being substantially dissimilar to the first linear response to speech, wherein the second combination is different from the first combination.

2. The method of claim 1 , wherein the first linear response to speech is devoid of a null, wherein the speech is human speech.

3. The method of claim 2 , wherein the second linear response to speech includes a single null oriented in a direction toward a source of the speech.

4. The method of claim 3 , wherein the single null is a region of the second linear response to speech having a measured response level that is lower than the measured response level of any other region of the second linear response to speech.

5. The method of claim 3 , wherein the second linear response to speech includes a primary lobe oriented in a direction away from the source of the speech.

6. The method of claim 5 , wherein the primary lobe is a region of the second linear response to speech having a measured response level that is greater than the measured response level of any other region of the second linear response to speech.

7. The method of claim 3 , comprising positioning the first physical microphone and the second physical microphone along an axis and separating the first and second physical microphones by a first distance.

8. The method of claim 7 , wherein a midpoint of the axis is a second distance from the speech source that generates the speech, wherein the speech source is located in a direction defined by an angle relative to the midpoint.

9. The method of claim 8 , wherein forming the first virtual microphone comprises subtracting the second microphone signal from the first microphone signal.

10. The method of claim 9 , comprising delaying the first microphone signal.

11. The method of claim 10 , comprising raising the delay to a power that is proportional to a time difference between arrival of the speech at the first virtual microphone and arrival of the speech at the second virtual microphone.

12. The method of claim 10 , comprising raising the delay to a power that is proportional to a sampling frequency multiplied by a quantity equal to a third distance subtracted from a fourth distance, the third distance being between the first physical microphone and the speech source and the fourth distance being between the second physical microphone and the speech source.

13. The method of claim 9 , comprising multiplying the second microphone signal by a ratio, wherein the ratio is a ratio of a third distance to a fourth distance, the third distance being between the first physical microphone and the speech source and the fourth distance being between the second physical microphone and the speech source.

14. The method of claim 8 , wherein forming the second virtual microphone comprises subtracting the first microphone signal from the second microphone signal.

15. The method of claim 14 , comprising delaying the first microphone signal.

16. The method of claim 15 , comprising raising the delay to a power that is proportional to a time difference between arrival of the speech at the first virtual microphone and arrival of the speech at the second virtual microphone.

17. The method of claim 15 , comprising raising the delay to a power that is proportional to a sampling frequency multiplied by a quantity equal to a third distance subtracted from a fourth distance, the third distance being between the first physical microphone and the speech source and the fourth distance being between the second physical microphone and the speech source.

18. The method of claim 17 , comprising multiplying the first microphone signal by a ratio, wherein the ratio is a ratio of the third distance to the fourth distance.

19. The method of claim 1 , wherein forming the first virtual microphone comprises subtracting the second microphone signal from a delayed version of the first microphone signal.

20. The method of claim 19 , wherein forming the second virtual microphone comprises:

forming a quantity by delaying the first microphone signal; and

subtracting the quantity from the second microphone signal.

21. The method of claim 1 , wherein the first and second physical microphones are omnidirectional.

22. A method comprising:

receiving a first microphone signal from a first omnidirectional microphone and receiving a second microphone signal from a second omnidirectional microphone;

generating a first virtual directional microphone by generating a first combination of the first microphone signal and the second microphone signal, the first virtual directional microphone having a first linear response to speech and a first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a speech source located within a predetermined angle relative to an axis of the microphone array;

generating a second virtual directional microphone by generating a second combination of the first microphone signal and the second microphone signal and has a second linear response to speech and a second linear response to noise, the second linear response to noise being substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech being substantially dissimilar to the first linear response to speech, wherein the second combination is different from the first combination, wherein the first virtual directional microphone and the second virtual directional microphone are distinct virtual directional microphones.

23. A method of forming a microphone array comprising:

forming a first virtual microphone by generating a first combination of a first microphone signal and a second microphone signal, wherein the first microphone signal is generated by a first omnidirectional microphone and the second microphone signal is generated by a second omnidirectional microphone; and

forming a second virtual microphone by generating a second combination of the first microphone signal and the second microphone signal, wherein the second combination is different from the first combination;

wherein the first virtual microphone has a first linear response to speech and a first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a speech source within a predetermined angle relative to an axis of the microphone array and devoid of a null, wherein the second virtual microphone has a second linear response to speech that has a single null oriented in a direction toward a source of the speech and a second linear response to noise, the second linear response to noise being substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech being substantially dissimilar to the first linear response to speech, wherein the speech is human speech.

24. The method of claim 23 , wherein the single null is a region of the second linear response to speech having a measured response level that is lower than the measured response level of any other region of the second linear response to speech.

25. The method of claim 23 , wherein the second linear response to speech includes a primary lobe oriented in a direction away from the source of the speech.

26. The method of claim 25 , wherein the primary lobe is a region of the second linear response to speech having a measured response level that is greater than the measured response level of any other region of the second linear response to speech.

27. A method comprising:

receiving acoustic signals at a first physical microphone and a second physical microphone;

outputting a first microphone signal from the first physical microphone and outputting a second microphone signal from the second physical microphone;

forming a first virtual microphone by generating a first combination of the first microphone signal and the second microphone signal, the first virtual microphone having a first linear response to speech and a first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a speech source located within a predetermined angle relative to an axis of the microphone array;

forming a second virtual microphone by generating a second combination of the first microphone signal and the second microphone signal, the second virtual microphone having a second linear response to speech and a second linear response to noise, the second linear response to noise being substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech being substantially dissimilar to the first linear response to speech, wherein the second combination is different from the first combination, wherein the first virtual microphone and the second virtual microphone are distinct virtual directional microphones;

generating output signals by combining signals from the first virtual microphone and the second virtual microphone, wherein the output signals include less acoustic noise than the acoustic signals.

28. The method of claim 27 , wherein the first and second physical microphones are omnidirectional microphones.

29. The method of claim 27 , wherein the first linear response to speech is devoid of a null, wherein the speech is human speech.

30. The method of claim 29 , wherein the second linear response to speech includes a single null oriented in a direction toward a source of the speech.

31. The method of claim 30 , wherein the single null is a region of the second linear response to speech having a measured response level that is lower than the measured response level of any other region of the second linear response to speech.

32. The method of claim 30 , wherein the second linear response to speech includes a primary lobe oriented in a direction away from the source of the speech.

33. The method of claim 32 , wherein the primary lobe is a region of the second linear response to speech having a measured response level that is greater than the measured response level of any other region of the second linear response to speech.

34. The method of claim 27 , wherein forming the first virtual microphone comprises subtracting the second microphone signal from a delayed version of the first microphone signal.

35. The method of claim 34 , wherein forming the second virtual microphone comprises:

forming a quantity by delaying the first microphone signal; and

subtracting the quantity from the second microphone signal.

36. A method comprising:

forming a physical microphone array including a first physical microphone and a second physical microphone, the first physical microphone outputting a first microphone signal and the second physical microphone outputting a second microphone signal; and

forming a virtual microphone array comprising a first virtual microphone and a second virtual microphone, the first virtual microphone comprising a first combination of the first microphone signal and the second microphone signal and having a first linear response to speech and a first linear response to noise, the first linear response to speech being substantially similar across a plurality of frequencies for a source of speech located within a predetermined angle relative to an axis of the microphone array, the second virtual microphone comprising a second combination of the first microphone signal and the second microphone signal and having a second linear response to speech and a second linear response to noise, the second linear response to noise being substantially similar to the first linear response to noise, one or both of the first linear response to noise and the second linear response to noise being non-zero in a direction toward a source of noise, and the second linear response to speech being substantially dissimilar to the first linear response to speech, wherein the second combination is different from the first combination,

wherein the virtual microphone array includes a single null oriented in a direction toward the source of speech of a human speaker.

37. The method of claim 36 , wherein the single null is a region of the second linear response to speech having a measured response level that is lower than the measured response level of any other region of the second linear response to speech.

38. The method of claim 36 , wherein the second linear response to speech includes a primary lobe oriented in a direction away from the source of the speech.

39. The method of claim 38 , wherein the primary lobe is a region of the second linear response to speech having a measured response level that is greater than the measured response level of any other region of the second linear response to speech.

40. The method of claim 36 , wherein the single null is located at a distance from the physical microphone array where the source of the speech is expected to be.

Assignments (18)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2021
From: JI AUDIO HOLDINGS LLC
To: JAWBONE INNOVATIONS, LLC
Reel/Frame 056323/0728 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2021
From: JAWB ACQUISITION LLC
To: JI AUDIO HOLDINGS LLC
Reel/Frame 056320/0195 →
RELEASE OF SECURITY INTEREST Recorded Feb 2, 2021
From: BLACKROCK ADVISORS, LLC
To: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 055207/0593 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPL. NO. 13/982,956 PREVIOUSLY RECORDED AT REEL: 035531 FRAME: 0554. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Nov 2, 2017
From: SILVER LAKE WATERMAN FUND, L.P., AS ADMINISTRATIVE AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
Reel/Frame 045167/0597 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2017
From: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
To: JAWB ACQUISITION LLC
Reel/Frame 043746/0693 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2017
From: ALIPHCOM
To: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 043711/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: ALIPHCOM, LLC
To: JAWB ACQUISITION, LLC
Reel/Frame 043638/0025 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: ALIPHCOM DBA JAWBONE
To: ALIPHCOM, LLC
Reel/Frame 043637/0796 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. 13870843 PREVIOUSLY RECORDED ON REEL 036500 FRAME 0173. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jan 26, 2017
From: ALIPHCOM; MACGYVER ACQUISITION, LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 041793/0347 →
SECURITY INTEREST Recorded Aug 27, 2015
From: ALIPHCOM; MACGYVER ACQUISITION LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 036500/0173 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE'S NAME PREVIOUSLY RECORDED AT REEL: 021540 FRAME: 0520. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 30, 2015
From: BURNETT, GREGORY C
To: ALIPHCOM
Reel/Frame 035552/0377 →
SECURITY INTEREST Recorded Apr 28, 2015
From: ALIPHCOM; MACGYVER ACQUISITION LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 035531/0312 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2015
From: SILVER LAKE WATERMAN FUND, L.P., AS ADMINISTRATIVE AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION, LLC
Reel/Frame 035531/0554 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2015
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
Reel/Frame 035531/0419 →
NOTICE OF SUBSTITUTION OF ADMINISTRATIVE AGENT IN PATENTS Recorded Dec 3, 2014
From: DBD CREDIT FUNDING LLC, AS RESIGNING AGENT
To: SILVER LAKE WATERMAN FUND, L.P., AS SUCCESSOR AGENT
Reel/Frame 034523/0705 →
PATENT SECURITY AGREEMENT Recorded Dec 4, 2013
From: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 031764/0100 →
SECURITY AGREEMENT Recorded Aug 8, 2013
From: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.
To: DBD CREDIT FUNDING LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 030968/0051 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 15, 2008
From: BURNETT, GREGORY C.
To: ALIPHCOM, INC.
Reel/Frame 021540/0520 →