IP Library Granted Patent US 10,477,031
Granted Patent B2
US 10,477,031 · App. 15/781,887 · Granted Nov 12, 2019

System and method for suppression of non-linear acoustic echoes

Inventors: Ingo Schalk-Schupp (Ulm, DE); Markus Buck (Biberach, DE); Friedrich Faubel (Ulm, DE)
Assignee: Nuance Communications, Inc.
H04M9/082G10L21/0232G10L21/0264H04M9/08G10L2021/02082H04M1/6041H04M2201/40
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,477,031
App. No.
15/781,887
Granted
Nov 12, 2019
Kind
B2
Abstract

A method for residual echo suppression is provided. Embodiments may include receiving an original reference signal and applying a distortion function to the original reference signal to generate a second signal. Embodiments may include generating a non-linear signal from the distortion function that does not include linear components of the original reference signal. Embodiments may also include calculating a residual echo power of a linear component and a non-linear component, wherein the linear component is based upon the original reference signal and the non-linear component is based upon the non-linear signal. Embodiments may further include applying a room model to each of the original reference signal and the non-linear signal and estimating a power associated with the original reference signal and the non-linear signal. Embodiments may include calculating a combined echo power estimate as a weighted sum of a weighted original reference signal power and a weighted non-linear signal power.

Claims (35)

1. A method for residual echo suppression comprising:

receiving, at a processor, an original reference signal and applying a distortion function to the original reference signal to generate a second signal;

generating a non-linear signal from the distortion function that does not include linear components of the original reference signal;

calculating a residual echo power of a linear component and a non-linear component, wherein the linear component is based upon, at least in part, the original reference signal and the non-linear component is based upon, at least in part, the non-linear signal;

applying a room model to each of the original reference signal and the non-linear signal;

estimating a power associated with the original reference signal and the non-linear signal; and

calculating a combined echo power estimate as a weighted sum of a weighted original reference signal power and a weighted non-linear signal power.

2. The method for residual echo suppression of claim 1 , wherein the application of the room model includes convolving each of the original reference signal and the non-linear signal with a room impulse response.

3. The method for residual echo suppression of claim 2 , wherein the room impulse response is estimated using a linear echo canceller.

4. The method for residual echo suppression of claim 1 , wherein at least one of the weighted original reference signal power and the weighted non-linear signal power used in the weighted sum include one or more coupling factors.

5. The method for residual echo suppression of claim 4 , wherein, the coupling factors differ between the linear component and the non-linear component.

6. The method for residual echo suppression of claim 1 , wherein a magnitude is used instead of the power.

7. The method for residual echo suppression of claim 4 , wherein the distortion function is estimated based upon, at least in part, a coupling factor associated with the non-linear signal.

8. The method for residual echo suppression of claim 7 , wherein the coupling factor includes at least one of broadband or an individual frequency band calculation.

9. The method for residual echo suppression of claim 1 , wherein generating a non-linear signal includes subtracting the original reference signal from the second signal to generate a non-linear signal.

10. The method for residual echo suppression of claim 1 , wherein the distortion function is approximated by a polynomial and wherein one or more coefficients of the polynomial are estimated based upon, at least in part, a correlation between a plurality of monomials and a cross-correlation of each of the plurality of monomials with the original reference signal.

11. The system for residual echo suppression of claim 1 , wherein generating a non-linear signal includes subtracting the original reference signal from the second signal to generate a non-linear signal.

12. The system for residual echo suppression of claim 1 , wherein the distortion function is approximated by a polynomial and wherein one or more coefficients of the polynomial are estimated based upon, at least in part, a correlation between a plurality of monomials and a cross-correlation of each of the plurality of monomials with the original reference signal.

13. A system for residual echo suppression comprising:

a speaker;

a microphone; and

a processor configured to perform one or more operations including:

receiving, at a processor, an original reference signal and applying a distortion function to the original reference signal to generate a second signal;

generating a non-linear signal from the distortion function that does not include linear components of the original reference signal;

calculating a residual echo power of a linear component and a non-linear component, wherein the linear component is based upon, at least in part, the original reference signal and the non-linear component is based upon, at least in part, the non-linear signal;

applying a room model to each of the original reference signal and the non-linear signal;

estimating a power associated with the original reference signal and the non-linear signal; and

calculating a combined echo power estimate as a weighted sum of a weighted original reference signal power and a weighted non-linear signal power.

14. The system for residual echo suppression of claim 13 , wherein the application of the room model includes convolving each of the original reference signal and the non-linear signal with a room impulse response.

15. The system for residual echo suppression of claim 14 , wherein the room impulse response is estimated using a linear echo canceller.

16. The system for residual echo suppression of claim 13 , wherein at least one of the weighted original reference signal power and the weighted non-linear signal power used in the weighted sum include one or more coupling factors.

17. The system for residual echo suppression of claim 16 , wherein, the coupling factors differ between the linear component and the non-linear component.

18. The system for residual echo suppression of claim 13 , wherein a magnitude is used instead of the power.

19. The system for residual echo suppression of claim 16 , wherein the distortion function is estimated based upon, at least in part, a coupling factor associated with the non-linear signal.

20. The system for residual echo suppression of claim 19 , wherein the coupling factor includes at least one of broadband or an individual frequency band calculation.

Assignments (8)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 16, 2018
From: SCHALK-SCHUPP, INGO; BUCK, MARKUS; FAUBEL, FRIEDRICH
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 047526/0303 →
Continuity (1)
Related Publication 20180367674A1 · Dec 20, 2018
Cited By (2)
US 12,231,603 US 12,671,767