IP Library Granted Patent US 10,540,984
Granted Patent B1
US 10,540,984 · App. 15/273,568 · Granted Jan 21, 2020

System and method for echo control using adaptive polynomial filters in a sub-band domain

Inventors: Sarmad Aziz Malik (Cupertino, CA); Arvindh Krishnaswamy (Palo Alto, CA)
Assignee: APPLE INC.
G10L21/0232G10L21/0388G10L2021/02082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,540,984
App. No.
15/273,568
Granted
Jan 21, 2020
Kind
B1
Abstract

Method for echo control using adaptive polynomial filters in sub-band domain starts with loudspeaker that is configured to be driven by a reference signal outputting a loudspeaker signal. Microphone receives at least one of: a near-end speaker signal, ambient noise signal, or the loudspeaker signal and generates a microphone signal. Adaptive polynomial filters in sub-band domain included in adaptive echo canceller (AEC) are configured to adaptively filter representation of the reference signal in a plurality of channels in a sub-band domain based on a clean signal to generate the echo estimate. Echo suppressor is configured to remove an echo estimate from the microphone signal to generate the clean signal. Other embodiments are described.

Claims (31)

1. A system for echo control using adaptive polynomial filters in sub-band domain comprising:

a loudspeaker to output a loudspeaker signal, wherein the loudspeaker is configured to be driven by a reference signal;

a microphone to receive at least one of: a near-end speaker signal, ambient noise signal, or the loudspeaker signal, and to generate a microphone signal;

a linear echo canceller (EC) to cancel linear echo from the microphone signal to generate a linear EC corrected microphone signal; and

an adaptive echo-canceller (AEC) including

a splitter to create a plurality of channels from the reference signal wherein each of the plurality of channels contains a nonlinear representation of the reference signal;

a time to frequency transformer to create a sub-band domain representation of the plurality of channels wherein the time-frequency transformer comprises a windowed time-frequency transformer to transform the plurality of channels from a time domain to windowed frequency domain;

a plurality of adaptive polynomial filters that are configured based on i) the microphone signal, ii) the linear EC corrected signal, or iii) a clean signal produced by an echo suppressor, wherein the adaptive polynomial filters are to adaptively filter the plurality of channels in the sub-band domain to generate an echo estimate wherein the adaptive polynomial filters in the sub-band domain are configured to receive and process the plurality of channels in the windowed frequency domain, and the adaptive polynomial filters are configured to generate the echo estimate in the windowed frequency domain,

a windowed frequency-time transformer to transform the echo estimate in the windowed frequency domain to time domain;

a non-linear echo canceller (EC) to remove the echo estimate from the linear EC corrected microphone signal, to generate an AEC output signal; and

an echo suppressor configured to remove a residual echo from the AEC output signal to generate the clean signal.

2. The system of claim 1 , wherein the linear echo canceller (EC) is an adaptive linear EC or a fixed linear EC.

3. The system of claim 1 , wherein the adaptive polynomial filters in the sub-band domain generate the echo estimate that estimates non-linear echo.

4. The system of claim 1 , wherein the AEC comprises:

a combiner to generate the echo estimate by combining the time domain output of the windowed frequency-time transformer into a single echo estimate, and

to transmit the single echo estimate to the non-linear EC.

5. A method for echo control using adaptive polynomial filters in sub-band domain comprising:

outputting by a loudspeaker a loudspeaker signal, wherein the loudspeaker is configured to be driven by a reference signal;

receiving by a microphone at least one of: a near-end speaker signal, ambient noise signal, or the loudspeaker signal;

generating by the microphone a microphone signal;

cancelling by a linear echo canceller (EC) linear echo from the microphone signal to generate a linear EC corrected microphone signal;

creating a plurality of channels from the reference signal wherein each of the plurality of channels contains a nonlinear representation of the reference signal;

creating a sub-band domain representation of the plurality of channels by a windowed time-frequency transformer that transforms the plurality of channels from a time domain to windowed frequency domain;

adaptively filtering by a plurality of adaptive polynomial filters the plurality of channels in the sub-band domain to generate an echo estimate wherein the adaptive polynomial filters generate the echo estimate in the windowed frequency domain, wherein the adaptive filtering is configured in accordance with i) the microphone signal, ii) the linear EC corrected microphone signal, or iii) a clean signal produced by an echo suppressor;

a windowed frequency-time transformation to transform the echo estimate from the windowed frequency domain to time domain; and

removing by a non-linear echo canceller (EC) the echo estimate from the linear EC corrected microphone signal to generate an adaptive echo canceller, AEC, output signal.

6. The method of claim 5 wherein the linear echo canceller (EC) is an adaptive linear EC or a fixed linear EC.

7. The method of claim 5 further comprising

removing by an echo suppressor a residual echo from the AEC output signal to generate the clean signal, and wherein the adaptive polynomial filters in the sub-band domain generate the echo estimate that estimates non-linear echo.

8. The method of claim 5 wherein the echo estimate is generated by combining the time domain output of the windowed frequency-time transformation into a single echo estimate, and wherein

the single echo estimate is removed from the linear EC corrected microphone signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 22, 2016
From: MALIK, SARMAD AZIZ; KRISHNASWAMY, ARVINDH
To: APPLE INC.
Reel/Frame 039837/0682 →
Cited By (1)
US 12,401,945