IP Library Granted Patent US 8,019,091
Granted Patent B2
US 8,019,091 · App. 10/667,207 · Granted Sep 13, 2011

Voice activity detector (VAD) -based multiple-microphone acoustic noise suppression

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,019,091
App. No.
10/667,207
Granted
Sep 13, 2011
Kind
B2
Abstract

Acoustic noise suppression is provided in multiple-microphone systems using Voice Activity Detectors (VAD). A host system receives acoustic signals via multiple microphones. The system also receives information on the vibration of human tissue associated with human voicing activity via the VAD. In response, the system generates a transfer function representative of the received acoustic signals upon determining that voicing information is absent from the received acoustic signals during at least one specified period of time. The system removes noise from the received acoustic signals using the transfer function, thereby producing a denoised acoustic data stream.

Claims (38)

1. A method for removing noise from acoustic signals, comprising:

receiving at least two acoustic signals using at least two acoustic microphones positioned in a plurality of locations;

receiving a voice activity signal that includes information on vibration of human tissue associated with human voicing activity of a user;

generating a voice activity detection (VAD) signal using the voice activity signal;

generating at least two transfer functions representative of a ratio of energy of the acoustic signal received using at least two different acoustic microphones of the at least two acoustic microphones when the VAD indicates that user voicing activity is absent, wherein the at least two transfer functions comprise a first transfer function and a second transfer function; and

removing acoustic noise from at least one of the acoustic signals by applying the first transfer function and at least one combination of the first transfer function and the second transfer function to the acoustic signals and generating denoised acoustic signals.

2. The method of claim 1 , wherein removing noise further comprises:

generating one transfer function of the at least two transfer functions to be representative of a ratio of energy of the acoustic signal received when the VAD indicates that user voice activity is present; and

removing noise from the acoustic signals using at least one combination of the at least two transfer functions to generate the denoised acoustic signals.

3. The method of claim 1 , wherein the acoustic signals include at least one reflection of at least one associated noise source signal and at least one reflection of at least one acoustic source signal.

4. The method of claim 1 , wherein generating the at least two transfer functions comprises recalculating the at least two transfer functions during at least one prespecified interval.

5. The method of claim 1 , wherein generating the at least two transfer functions comprises use of at least one technique selected from a group consisting of adaptive techniques and recursive techniques.

6. The method of claim 1 , wherein information on the vibration of human tissue is provided by a sensor in contact with the skin.

7. The method of claim 1 , wherein information on the vibration of human tissue is provided via at least one sensor selected from among at least one of an accelerometer, a skin surface microphone in physical contact with skin of a user, a human tissue vibration detector, a radio frequency (RF) vibration detector, and a laser vibration detector.

8. The method of claim 1 , wherein the human tissue is at least one of on a surface of a head, near the surface of the head, on a surface of a neck, near the surface of the neck, on a surface of a chest, and near the surface of the chest.

9. The method of claim 1 , further comprising:

dividing acoustic data of the acoustic signals into a plurality of subbands;

generating a subband transfer function representative of the ratio of acoustic energies received in each microphone in each subband;

removing acoustic noise from each of the plurality of subbands using the subband transfer function, wherein a plurality of denoised acoustic subband signals are generated; and

combining the plurality of denoised acoustic subband signals to generate the denoised acoustic signal.

10. The method of claim 1 , wherein the at least two acoustic microphones comprise a first directional acoustic microphone and a second directional acoustic microphone, wherein the first directional acoustic microphone and the second directional acoustic microphone selectively attenuate the acoustic signals based on the direction of arrival.

11. A system for removing acoustic noise from the acoustic signals, comprising:

a receiver that receives at least two acoustic signals via at least two acoustic microphones positioned in a plurality of locations;

at least one sensor that receives human tissue vibration information associated with human voicing activity of a user;

a processor coupled among the receiver and the at least one sensor that generates a plurality of transfer functions, wherein the plurality of transfer functions includes a first transfer function representative of a ratio of energy of acoustic signals received using at least two different acoustic microphones of the at least two acoustic microphones, wherein the first transfer function is generated in response to a determination that voicing activity is absent from the acoustic signals for a period of time, wherein the plurality of transfer functions includes a second transfer function representative of the acoustic signals, wherein the second transfer function is generated in response to a determination that voicing activity is present in the acoustic signals for the period of time, wherein acoustic noise is removed from the acoustic signals using the first transfer function and at least one combination of the first transfer function and the second transfer function to produce the denoised acoustic data stream.

12. The system of claim 11 , wherein the sensor includes a mechanical sensor in contact with the skin.

13. The system of claim 11 , wherein the sensor includes at least one of an accelerometer, a skin surface microphone in physical contact with skin of a user, a human tissue vibration detector, a radio frequency (RF) vibration detector, and a laser vibration detector.

14. The system of claim 11 , wherein the human tissue is at least one of on a surface of a head, near the surface of the head, on a surface of a neck, near the surface of the neck, on a surface of a chest, and near the surface of the chest.

15. The system of claim 11 , further comprising:

dividing acoustic data of the acoustic signals into a plurality of subbands;

generating a transfer function representative of the ratio of acoustic energies received in each microphone in each subband;

removing acoustic noise from each of the plurality of subbands using a transfer function, wherein a plurality of denoised acoustic data streams are generated; and

combining the plurality of denoised acoustic data streams to generate the denoised acoustic data stream.

16. The system of claim 11 , wherein the receiver includes a plurality of independently located microphones.

17. The system of claim 11 , wherein the at least two acoustic microphones comprise a first directional acoustic microphone and a second directional acoustic microphone, wherein the first directional acoustic microphone and the second directional acoustic microphone selectively attenuate the acoustic signals based on the direction of arrival.

18. A signal processing system coupled among a user and an electronic device, wherein the signal processing system includes a denoising subsystem for removing acoustic noise from acoustic signals, the denoising subsystem comprising a processor coupled among a receiver and at least one sensor, wherein the receiver is coupled to receive the acoustic signals via at least two microphones, wherein the at least one sensor detects human tissue vibration associated with human voicing activity of a user, wherein the processor generates a plurality of transfer functions, wherein a first transfer function representative of a ratio of acoustic energy received by the two microphones is generated in response to a determination that voicing activity is absent from the acoustic signals for a specified period of time, wherein a second transfer function representative of the acoustic signals is generated in response to a determination that voicing activity is present in the acoustic signals for a specified period of time, wherein acoustic noise is removed from the acoustic signals using the first transfer function and at least one combination of the first transfer function and the second transfer function to produce a denoised acoustic data stream.

19. The system of claim 18 , wherein the at least one electronic device includes at least one of cellular telephones, personal digital assistants, portable communication devices, computers, video cameras, digital cameras, and telematics systems.

20. The system of claim 18 , wherein the human tissue is at least one of on a surface of a head, near the surface of the head, on a surface of a neck, near the surface of the neck, on a surface of a chest, and near the surface of the chest.

Assignments (17)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2021
From: JI AUDIO HOLDINGS LLC
To: JAWBONE INNOVATIONS, LLC
Reel/Frame 056323/0728 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2021
From: JAWB ACQUISITION LLC
To: JI AUDIO HOLDINGS LLC
Reel/Frame 056320/0195 →
RELEASE OF SECURITY INTEREST Recorded Feb 2, 2021
From: BLACKROCK ADVISORS, LLC
To: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 055207/0593 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPL. NO. 13/982,956 PREVIOUSLY RECORDED AT REEL: 035531 FRAME: 0554. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Nov 2, 2017
From: SILVER LAKE WATERMAN FUND, L.P., AS ADMINISTRATIVE AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
Reel/Frame 045167/0597 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2017
From: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
To: JAWB ACQUISITION LLC
Reel/Frame 043746/0693 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2017
From: ALIPHCOM
To: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 043711/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: ALIPHCOM DBA JAWBONE
To: ALIPHCOM, LLC
Reel/Frame 043637/0796 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: ALIPHCOM, LLC
To: JAWB ACQUISITION, LLC
Reel/Frame 043638/0025 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. 13870843 PREVIOUSLY RECORDED ON REEL 036500 FRAME 0173. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jan 26, 2017
From: ALIPHCOM; MACGYVER ACQUISITION, LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 041793/0347 →
SECURITY INTEREST Recorded Aug 27, 2015
From: ALIPHCOM; MACGYVER ACQUISITION LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 036500/0173 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 015117 FRAME: 0046. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Jun 24, 2015
From: BURNETT, GREGORY C.; BREITFELLER, ERIC F.
To: ALIPHCOM
Reel/Frame 036020/0011 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2015
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
Reel/Frame 035531/0419 →
SECURITY INTEREST Recorded Apr 28, 2015
From: ALIPHCOM; MACGYVER ACQUISITION LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 035531/0312 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2015
From: SILVER LAKE WATERMAN FUND, L.P., AS ADMINISTRATIVE AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION, LLC
Reel/Frame 035531/0554 →
NOTICE OF SUBSTITUTION OF ADMINISTRATIVE AGENT IN PATENTS Recorded Dec 3, 2014
From: DBD CREDIT FUNDING LLC, AS RESIGNING AGENT
To: SILVER LAKE WATERMAN FUND, L.P., AS SUCCESSOR AGENT
Reel/Frame 034523/0705 →
PATENT SECURITY AGREEMENT Recorded Dec 4, 2013
From: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 031764/0100 →
SECURITY AGREEMENT Recorded Aug 8, 2013
From: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.
To: DBD CREDIT FUNDING LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 030968/0051 →