IP Library Granted Patent US 9,640,187
Granted Patent B2
US 9,640,187 · App. 13/394,783 · Granted May 2, 2017

Method and an apparatus for processing an audio signal using noise suppression or echo suppression

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,640,187
App. No.
13/394,783
Granted
May 2, 2017
Kind
B2
Abstract

The invention relates to a method and an apparatus for processing an audio signal, wherein the method comprises the steps of: filtering an audio signal into at least two frequency band signals, generating for each frequency band signal a plurality of sub-band signals, wherein for at least one frequency band signal the plurality of sub-band signals are generated using a time to frequency domain transform and for the at least one other frequency band the plurality of sub-band signals for the other frequency band are generated using a sub-band filterbank, and the apparatus comprises at least one processor and at least one memory including computer program code, the at least one memory and the computer program code being configured to, with the at least one processor, cause the apparatus to perform the method.

Claims (75)

1. A method comprising:

filtering an audio signal into at least a first frequency band signal and a second frequency band signal, wherein frequencies of the first frequency band signal are lower than frequencies of the second frequency band signal;

decimating the first, lower frequency band signal to produce a down-sampled first, lower frequency band signal;

generating for the down-sampled first, lower frequency band signal, a plurality of sub-band signals using a time to frequency domain transform;

generating for the second, higher frequency band signal, a plurality of non-decimated sub-band signals using a non-decimating sub-band filterbank;

applying in the frequency domain noise suppression or echo suppression to at least one sub-band signal generated for the down-sampled first, lower frequency band signal using the time to frequency domain transform;

applying in the time domain noise suppression or echo suppression to at least one non-decimated sub-band signal generated for the second, higher frequency band signal using the non-decimating sub-band filterbank;

combining the sub-band signals generated using the time to frequency domain transform, including the at least one noise or echo suppressed sub-band signal, to form a processed lower frequency band audio signal;

combining the non-decimated sub-band signals generated using the non-decimating sub-band filterbank, including the at least one noise or echo suppressed sub-band signal, to form a processed higher frequency band audio signal; and

combining the processed lower frequency band audio signal and the processed higher frequency band signal to generate a processed audio signal.

2. The method as claimed in claim 1 , wherein the time to frequency domain transform comprises one of:

a fast Fourier transform;

a discrete Fourier transform; and

a discrete cosine transform.

3. The method as claimed in claim 1 , wherein the non-decimating sub-band filterbank is a cosine based modulated filterbank.

4. The method as claimed in claim 1 , wherein filtering an audio signal into at least the first and second frequency band signals comprises:

high-pass filtering the audio signal into the second frequency band signal; and

low-pass filtering the audio signal into the first frequency band signal.

5. The method as claimed in claim 1 , wherein the decimating the first, lower frequency band signal to generate the down-sampled first, lower frequency band signal is by a factor of 2.

6. The method as claimed in claim 1 , wherein combining the sub-band signals generated using the time to frequency domain transform to form the processed lower frequency band audio signal comprises:

generating using a frequency to time domain transform the processed lower frequency band audio signal; and wherein

combining the non-decimated sub-band signals generated using the non-decimating sub-band filterbank to form the processed higher frequency band signal comprises:

summing the non-decimated sub-band signals generated using the non-decimating sub-band filterbank.

7. The method as claimed in claim 1 , wherein combining the processed higher and lower frequency band audio signals to generate a processed audio signal further comprises:

upsampling the processed lower frequency band signals;

low pass filtering the upsampled processed lower frequency band signal; and

combining the low pass filtered, upsampled, processed lower frequency band signal with the processed higher frequency band signal to generate the processed audio signal.

8. The method as claimed in claim 7 , wherein upsampling the processed lower frequency band signals is by a factor of 2.

9. The method as claimed in claim 7 , wherein combining the low pass filtered, upsampled, processed lower frequency band signal with the processed higher frequency band signal to generate the processed audio signal further comprises delaying the processed higher frequency band signal.

10. The method as claimed in claim 1 , further comprising, prior to combining the processed higher and lower frequency band audio signals to generate a processed audio signal, processing the sub-band signals forming the processed higher and lower frequency band audio signals, wherein the processing of the sub-band signals comprises signal level control on the sub-band signals.

11. The method as claimed in claim 7 , further comprising configuring filters comprising:

high-pass filtering by a first filter of the audio signal into the second, higher frequency band signal;

low-pass filtering by a second filter of the audio signal into the first, lower frequency band signal; and

low pass filtering by a third filter of the upsampled processed lower frequency band signal.

12. The method as claimed in claim 1 , further comprising:

processing the first and second frequency band signals prior to generating for each frequency band signal the plurality of sub-band signals, wherein the processing of the first and second frequency band signals comprises at least one of:

audio beamforming processing; and adaptive filtering.

13. An apparatus comprising at least one processor and at least one memory including computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:

filter an audio signal into at least a first frequency band signal and a second frequency band signal, wherein frequencies of the first frequency band signal are lower than the frequencies of the second frequency band signal;

decimate the first, lower frequency band signal to produce a down-sampled first, lower frequency band signal;

generate for the down-sampled first, lower frequency band signal, a plurality of sub-band signals using a time to frequency domain transform;

generate for the second, higher frequency band signal, a plurality of non-decimated sub-band signals using a non-decimating sub-band filterbank;

apply in the frequency domain noise suppression or echo suppression to at least one sub-band signal generated for the down-sampled first, lower frequency band signal using the time to frequency domain transform;

apply in the time domain noise suppression or echo suppression to at least one non-decimated sub-band signal generated for the second, higher frequency band signal using the non-decimating sub-band filterbank;

combine the sub-band signals generated using the time to frequency domain transform, including the at least one noise or echo suppressed sub-band signal, to form a processed lower frequency band audio signal;

combine the non-decimated sub-band signals generated using the non-decimating sub-band filterbank, including the at least one noise or echo suppressed sub-band signal, to form a processed higher frequency band audio signal; and

combine the processed lower frequency band audio signal and the processed higher frequency band signal to generate a processed audio signal.

14. The apparatus as claimed in claim 13 , wherein the time to frequency domain transform comprises one of:

a fast Fourier transform;

a discrete Fourier transform; and

a discrete cosine transform.

15. The apparatus as claimed in claim 13 , wherein the non-decimating sub-band filterbank is a cosine based modulated filterbank.

16. The apparatus as claimed in claim 13 , wherein when causing the apparatus to filter an audio signal into at least the first and second frequency band signals further comprises causing the apparatus to:

high-pass filter the audio signal into the second frequency band signal; and

low-pass filter the audio signal into the first frequency band signal.

17. The apparatus as claimed in claim 16 , wherein when causing the apparatus to decimate the first, lower frequency band signal to generate the down-sampled first, lower frequency band signal further comprises causing the apparatus to decimate by a factor of 2.

18. The apparatus as claimed in claim 13 , wherein when causing the apparatus to perform combining the sub-band signals to form the processed lower frequency band audio signal further comprises causing the apparatus to:

generate using a frequency to time domain transform the processed lower frequency band audio signal;

and wherein causing the apparatus to combine the non-decimated sub-band signals generated using the non-decimating sub-band filterbank to form the processed higher frequency band signal comprises:

summing the non-decimated sub-band signals generated using the non-decimating sub-band filterbank.

19. The apparatus as claimed in claim 13 , wherein when causing the apparatus to perform combining the processed higher and lower frequency band audio signals to generate a processed audio signal further comprises causing the apparatus to:

upsample the processed lower frequency band signal;

low pass filter the upsampled processed lower frequency band signal; and

combine the low pass filtered, upsampled, processed lower frequency band signal with the processed higher frequency band signal to generate the processed audio signal.

20. The apparatus as claimed in claim 19 , wherein when causing the apparatus to upsample the processed lower frequency band signal further comprises causing the apparatus to upsample by a factor of 2.

21. The apparatus as claimed in claim 19 , wherein when causing the apparatus to combine the low pass filtered, upsampled, processed lower frequency band signal with the processed higher frequency band signal to generate the processed audio signal further comprises causing the apparatus to delay the processed higher frequency band signal.

22. The apparatus as claimed in claim 13 , wherein the at least one processor, causes the apparatus at least to further process the sub-band signals forming the processed higher and lower frequency band signals prior to combining the processed higher and lower frequency band audio signals to generate a processed audio signal, wherein the process of the sub-band signals comprises signal level control on the sub-band signals.

23. The apparatus as claimed in claim 20 , wherein the at least one processor, causes the apparatus at least to further configure filters comprises:

a first filter for high-pass filtering of the audio signal into the second higher frequency band signal;

a second filter for low-pass filtering of the audio signal into the first lower frequency band signal; and

a third filter for low pass filtering of the upsampled processed lower frequency band signal.

24. The apparatus as claimed in claim 13 , wherein the at least one processor, causes the apparatus at least to further:

process the first and second frequency band signals prior to generating for each frequency band signal the plurality of sub-band signals, wherein the processing of the first and second frequency band signals comprises at least one of:

audio beamforming processing; and

adaptive filtering.

Assignments (12)
PATENT SECURITY AGREEMENT Recorded Aug 6, 2024
From: RPX CORPORATION; RPX CLEARINGHOUSE LLC
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 068328/0674 →
RELEASE OF LIEN ON PATENTS Recorded Aug 5, 2024
From: BARINGS FINANCE LLC
To: RPX CORPORATION
Reel/Frame 068328/0278 →
PATENT SECURITY AGREEMENT Recorded Apr 22, 2023
From: RPX CORPORATION
To: BARINGS FINANCE LLC, AS COLLATERAL AGENT
Reel/Frame 063429/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 28, 2021
From: PROVENANCE ASSET GROUP LLC
To: RPX CORPORATION
Reel/Frame 059352/0001 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: NOKIA US HOLDINGS INC.
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058363/0723 →
RELEASE OF SECURITY INTEREST Recorded Nov 30, 2021
From: CORTLAND CAPITAL MARKETS SERVICES LLC
To: PROVENANCE ASSET GROUP HOLDINGS LLC; PROVENANCE ASSET GROUP LLC
Reel/Frame 058983/0104 →
ASSIGNMENT AND ASSUMPTION AGREEMENT Recorded Feb 14, 2019
From: NOKIA USA INC.
To: NOKIA US HOLDINGS INC.
Reel/Frame 048370/0682 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 13, 2017
From: NOKIA TECHNOLOGIES OY; NOKIA SOLUTIONS AND NETWORKS BV; ALCATEL LUCENT SAS
To: PROVENANCE ASSET GROUP LLC
Reel/Frame 043877/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP LLC
To: NOKIA USA INC.
Reel/Frame 043879/0001 →
SECURITY INTEREST Recorded Sep 13, 2017
From: PROVENANCE ASSET GROUP HOLDINGS, LLC; PROVENANCE ASSET GROUP, LLC
To: CORTLAND CAPITAL MARKET SERVICES, LLC
Reel/Frame 043967/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 24, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 035280/0093 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 18, 2012
From: NIEMISTO, RIITTA ELINA; BREGOVIC, ROBERT; DUMITRESCU, BOGDAN; MYLLYLA, VILLE MIKAEL
To: NOKIA CORPORATION
Reel/Frame 028237/0158 →