IP Library Granted Patent US 10,218,327
Granted Patent B2
US 10,218,327 · App. 13/374,746 · Granted Feb 26, 2019

Dynamic enhancement of audio (DAE) in headset systems

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,218,327
App. No.
13/374,746
Granted
Feb 26, 2019
Kind
B2
Abstract

Various embodiments relate to signal processing and, more particularly, to processing of received speech signals to preserve and enhance speech intelligibility. In one embodiment, a communications apparatus includes a receiving path over which received speech signals traverse in an audio stream, and an dynamic audio enhancement device disposed in the receiving path. The dynamic audio enhancement (“DAE”) device is configured to modify an amount of volume and an amount of equalization of the audio stream. The DAE device can include a noise level estimator (“NLE”) configured to generate a signal representing a noise level estimate. The noise level estimator can include a non-stationary noise detector and a stationary noise detector. The noise level estimator can be configured to generate the signal representing a first noise level estimate based on detection of the non-stationary noise or a second noise level estimate based on detection of the stationary noise.

Claims (65)

1. A communications apparatus comprising:

a receiving path over which received speech signals traverse in an audio stream, the audio stream including the received speech signals;

a processor including a dynamic audio enhancement device disposed in the receiving path to dynamically enhance the audio stream, the dynamic audio enhancement device configured to modify an amount of volume of the audio stream and an amount of equalization of the audio stream and comprising:

a noise level estimator (“NLE”) configured to generate a signal representing a noise level estimate, the noise level estimator including:

a non-stationary noise detector configured to detect non-stationary noise, and

a stationary noise detector configured to detect stationary noise,

wherein the noise level estimator is configured to generate as the signal a first signal representing a first noise level estimate, the generation of which is based on detection of the non-stationary noise,

wherein the noise level estimator is configured to generate as the signal a second noise level estimate, the generation of which is based on detection of the stationary noise,

wherein the dynamic audio enhancement device is configured to modify the amount of the volume to generate a modified amount of volume based on the signal representing the noise level estimate to form a modified audio stream, and is further configured to modify the amount of the equalization to generate a modified amount of equalization based on the signal representing the noise level estimate to form the modified audio stream,

wherein the modified audio stream is used to generate audio at a loudspeaker.

2. The apparatus of claim 1 wherein the noise level estimator further comprises:

a bi-modal noise level estimator configured to generate noise level estimates differently based on the detection of different types of noise.

3. The apparatus of claim 1 further comprising:

an automatic volume control (“AVC”) configured to implement either the first noise level estimate or the second noise level estimate.

4. The apparatus of claim 1 wherein the received speech signals comprise:

a signal (“O 2 ”) generated by an omnidirectional microphone.

5. The apparatus of claim 1 wherein the non-stationary noise detector comprises:

a nonlinear peak tracking filter configured to receive a signal representing speech-like non-stationary noise, and further configured to generate a filtered signal including a largest absolute value of the speech-like non-stationary noise in a frame; and

a low pass filter configured to smooth the filtered signal.

6. The apparatus of claim 1 wherein the stationary noise detector comprises:

an energy computation module configured to compute the energy of a one of the received speech signals; and

a moving average filter.

7. The apparatus of claim 1 wherein the dynamic audio enhancement device further comprises:

a limiter configured to introduce a frame of delay to detect a gain to be applied to the received speech signals, and to attenuate a magnitude of the received speech signals.

8. The apparatus of claim 7 wherein the limiter is further configured to prevent clipping at a speaker by attenuating the magnitude of the received speech signals.

9. The apparatus of claim 7 wherein the limiter is further configured to reduce strongly-voiced portions of the received speech signals to amplify unvoiced and weakly-voiced portions of the received speech signals.

10. The apparatus of claim 1 further comprises:

either a headset or a handset.

11. A method comprising:

receiving an audio stream via a receiving processing path, the audio stream including received speech signals;

detecting a type of noise at a processor;

generating a signal representing either a first noise level estimate, the generation of which is based on detection of non-stationary noise as the type of noise, or a second noise level estimate, the generation of which is based on detection of stationary noise as the type of noise;

modifying an amount of volume of the audio stream to form a modified amount of volume,

wherein the modified amount of volume is based on either the first noise level estimate or the second noise level estimate to reduce or eliminate environmental acoustic noise associated with the received speech signals;

modifying an amount of equalization of the audio stream to form a modified amount of equalization,

wherein the modified amount of equalization is based on either the first noise level estimate or the second noise level estimate; and

implementing either the modified amount of volume or the modified amount of equalization, or both, to form a modified audio stream to generate audio at a loudspeaker.

12. The method of claim 11 further comprising:

introducing a delay to form a delayed portion of the received speech signals;

detecting a gain to be applied to the delayed portion of the received speech signals at a first point in time; and

attenuating a magnitude of one of the received speech signals at a second point in time.

13. The method of claim 12 wherein attenuating the magnitude of the one of the received speech signals further comprises:

preventing clipping at a speaker.

14. The method of claim 12 wherein attenuating the magnitude of the one of the received speech signals further comprises:

reducing magnitudes of strongly-voiced portions of the received speech signals; and

amplifying unvoiced and weakly-voiced portions of the received speech signals.

15. The method of claim 11 further comprising:

applying the first noise level estimate or the second noise level estimate to an automatic volume control (“AVC”); and

applying the first noise level estimate or the second noise level estimate to an equalizer.

16. The method of claim 11 wherein receiving received speech signals comprises:

receiving a signal (“O 2 ”) generated by an omnidirectional microphone.

17. The method of claim 11 further comprising:

identifying a first mode of operation;

identifying in a frame a largest absolute value of a received speech signal, the received speech signal being one of the received speech signals;

filtering nonlinearly the largest absolute value of the received speech signal to form a resultant signal; and

applying the resultant signal to a low pass filter.

18. The method of claim 11 further comprising:

identifying a second mode of operation;

computing the energy of a one of the received speech signals; and

applying the one of the received speech signals to a moving average filter.

19. The method of claim 11 further comprising:

receiving a compressor gain; and

compressing high speech levels and boosting low speech levels.

20. The method of claim 11 further comprising:

adding wind comfort noise.

Assignments (17)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 21, 2021
From: JI AUDIO HOLDINGS LLC
To: JAWBONE INNOVATIONS, LLC
Reel/Frame 056323/0728 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 20, 2021
From: JAWB ACQUISITION LLC
To: JI AUDIO HOLDINGS LLC
Reel/Frame 056320/0195 →
RELEASE OF SECURITY INTEREST Recorded Feb 2, 2021
From: BLACKROCK ADVISORS, LLC
To: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 055207/0593 →
CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT APPL. NO. 13/982,956 PREVIOUSLY RECORDED AT REEL: 035531 FRAME: 0554. ASSIGNOR(S) HEREBY CONFIRMS THE RELEASE OF SECURITY INTEREST. Recorded Nov 2, 2017
From: SILVER LAKE WATERMAN FUND, L.P., AS ADMINISTRATIVE AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
Reel/Frame 045167/0597 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 1, 2017
From: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
To: JAWB ACQUISITION LLC
Reel/Frame 043746/0693 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 29, 2017
From: ALIPHCOM
To: ALIPHCOM (ASSIGNMENT FOR THE BENEFIT OF CREDITORS), LLC
Reel/Frame 043711/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: ALIPHCOM, LLC
To: JAWB ACQUISITION, LLC
Reel/Frame 043638/0025 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 22, 2017
From: ALIPHCOM DBA JAWBONE
To: ALIPHCOM, LLC
Reel/Frame 043637/0796 →
CORRECTIVE ASSIGNMENT TO CORRECT THE APPLICATION NO. 13870843 PREVIOUSLY RECORDED ON REEL 036500 FRAME 0173. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Jan 26, 2017
From: ALIPHCOM; MACGYVER ACQUISITION, LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 041793/0347 →
SECURITY INTEREST Recorded Aug 27, 2015
From: ALIPHCOM; MACGYVER ACQUISITION LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 036500/0173 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2015
From: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
Reel/Frame 035531/0419 →
SECURITY INTEREST Recorded Apr 28, 2015
From: ALIPHCOM; MACGYVER ACQUISITION LLC; ALIPH, INC.; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION LLC
To: BLACKROCK ADVISORS, LLC
Reel/Frame 035531/0312 →
RELEASE OF SECURITY INTEREST Recorded Apr 28, 2015
From: SILVER LAKE WATERMAN FUND, L.P., AS ADMINISTRATIVE AGENT
To: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.; PROJECT PARIS ACQUISITION, LLC
Reel/Frame 035531/0554 →
NOTICE OF SUBSTITUTION OF ADMINISTRATIVE AGENT IN PATENTS Recorded Dec 3, 2014
From: DBD CREDIT FUNDING LLC, AS RESIGNING AGENT
To: SILVER LAKE WATERMAN FUND, L.P., AS SUCCESSOR AGENT
Reel/Frame 034523/0705 →
PATENT SECURITY AGREEMENT Recorded Dec 4, 2013
From: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 031764/0100 →
SECURITY AGREEMENT Recorded Aug 8, 2013
From: ALIPHCOM; ALIPH, INC.; MACGYVER ACQUISITION LLC; BODYMEDIA, INC.
To: DBD CREDIT FUNDING LLC, AS ADMINISTRATIVE AGENT
Reel/Frame 030968/0051 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 31, 2012
From: JING, ZHINIAN
To: ALIPHCOM
Reel/Frame 028300/0156 →