IP Library Granted Patent US 10,410,653
Granted Patent B2
US 10,410,653 · App. 15/558,181 · Granted Sep 10, 2019

Adaptive audio filtering

Inventors: Dong Shi (Shanghai, CN); Glenn N. Dickins (Como, AU); David Gunawan (Sydney, AU); Xuejing Sun (Beijing, CN)
Assignee: Dolby Laboratories Licensing Corporation
G10L21/0232G10L21/0208G10L21/028G10L25/21H04M9/082G10L2021/02082
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,410,653
App. No.
15/558,181
Granted
Sep 10, 2019
Kind
B2
Abstract

In an audio processing system ( 300 ), a filtering section ( 350, 400 ): receives subband signals ( 410, 420, 430 ) corresponding to audio content of a reference signal ( 301 ) in respective frequency subbands; receives subband signals ( 411, 421, 431 ) corresponding to audio content of a response signal ( 304 ) in the respective subbands; and forms filtered inband references ( 412, 422, 432 ) by applying respective filters ( 413, 423, 433 ) to the subband signals of the reference signal. For a frequency subband: filtered crossband references ( 424, 425 ) are formed by multiplying, by scalar factors ( 426, 427 ), filtered inband references of other subbands; a composite filtered reference ( 428 ) is formed by summing the filtered inband reference of the subband ( 422 ) and the filtered crossband references; a residual signal ( 429 ) is computed as a difference between the composite filtered reference and the subband signal of the response signal corresponding to the subband; and the scalar factors and the filter applied to the subband signal of the reference signal corresponding to the subband are adjusted based on the residual signal.

Claims (76)

1. An audio processing method comprising:

receiving subband signals corresponding to audio content of a reference signal in respective frequency subbands;

receiving subband signals corresponding to audio content of a response signal in the respective frequency subbands;

forming filtered inband references by applying respective filters to the subband signals of the reference signal; and

for at least one frequency subband:

forming one or more filtered crossband references by multiplying, by one or more scalar factors, one or more filtered inband references of one or more other frequency subbands;

forming a composite filtered reference by summing the filtered inband reference corresponding to the frequency subband and the one or more filtered crossband references;

computing a residual signal as a difference between the composite filtered reference and the subband signal of the response signal corresponding to the frequency subband; and

adjusting, based on the residual signal, the one or more scalar factors and the filter applied to the subband signal of the reference signal corresponding to the frequency subband.

2. The method of claim 1 , further comprising:

receiving the reference signal and the response signal;

decomposing the reference signal and the response signal into respective subband signals;

downsampling the subband signals of the reference signal prior to applying the filters; and

downsampling the subband signals of the response signal prior to computing the residual signal.

3. The method of claim 1 , wherein the adjustment is performed to reduce power and/or energy of the residual signal.

4. The method of claim 1 , wherein the residual signal is computed for a time frame, or for a portion of a time frame, and wherein a new residual signal is computed for a succeeding time frame, or for a succeeding portion of a time frame, based on the adjusted filter and the adjusted one or more scalar factors.

5. The method of claim 1 , wherein said other frequency subbands include a neighboring frequency subband on either side of said frequency subband.

6. The method of claim 1 , wherein adjusting the one or more scalar factors and the filter applied to the subband signal of the reference signal corresponding to said frequency subband includes:

modifying an update step size of the one or more scalar factors and/or of the filter applied to the subband signal of the reference signal corresponding to said frequency subband, in response to a power ratio between the subband signal of the reference signal corresponding to said frequency subband and said one or more filtered inband references of one or more other frequency subbands exceeding an upper threshold or being below a lower threshold.

7. The method of claim 1 , wherein the response signal is an audio signal provided by at least one acoustic transducer in response to playback, by at least one loudspeaker, of the reference signal.

8. The method of claim 7 , comprising:

for each of the frequency subbands:

computing a frequency subband residual signal based on the filtered inband reference corresponding to the frequency subband and a subband signal of the response signal corresponding to the frequency subband; and

adjusting, based on the frequency subband residual signal for the frequency subband, at least the filter applied to the subband signal of the reference signal corresponding to the frequency subband,

wherein the method further comprises:

synthesizing an output signal based on the frequency subband residual signals for the respective frequency subbands.

9. The method of claim 7 , comprising:

in response to a power level or energy level of the residual signal exceeding a threshold, dispensing with adjustment of at least one filter or at least one scalar factor for at least one time frame.

10. The method of claim 1 , wherein the reference signal is a multichannel signal, and wherein the method comprises:

receiving subband signals corresponding to audio content of channels of the reference signal in the respective frequency subbands;

applying respective filters to the subband signals of the channels of the reference signal; and

for at least one frequency subband:

for each channel of the reference signal, forming one or more filtered crossband references by multiplying, by one or more scalar factors, one or more filtered inband references of one or more other frequency subbands of the channel;

forming a composite filtered reference by summing, over the channels of the reference signal, the filtered inband references corresponding to the frequency subband and the respective associated one or more filtered crossband references;

computing a residual signal as a difference between the composite filtered reference and the subband signal of the response signal corresponding to the frequency subband; and

for at least one of the channels of the reference signal, adjusting, based on the residual signal, the one or more scalar factors for the channel and the filter applied to the subband signal of the channel of the reference signal corresponding to the frequency subband.

11. An audio processing system comprising:

a filtering section configured to:

receive subband signals corresponding to audio content of a reference signal in respective frequency subbands;

receive subband signals corresponding to audio content of a response signal in the respective frequency subbands;

form filtered inband references by applying respective filters to the subband signals of the reference signal; and

for at least one frequency subband:

form one or more filtered crossband references by multiplying, by one or more scalar factors, one or more filtered inband references of one or more other frequency subbands;

form a composite filtered reference by summing the filtered inband reference corresponding to the frequency subband and the one or more filtered crossband references;

compute a residual signal as a difference between the composite filtered reference and the subband signal of the response signal corresponding to the frequency subband; and

adjust, based on the residual signal, the one or more scalar factors and the filter applied to the subband signal of the reference signal corresponding to the frequency subband.

12. The audio processing system of claim 11 , further comprising:

a first analysis section configured to receive the reference signal and to decompose the reference signal into subband signals corresponding to respective frequency subbands;

a second analysis section configured to receive the response signal and to decompose the response signal into subband signals corresponding to respective frequency subbands;

a first resampling section arranged upstream of the filtering section and configured to downsample the subband signals of the reference signal; and

a second resampling section arranged upstream of the filtering section and configured to downsample the subband signals of the response signal.

13. The audio processing system of claim 11 , wherein the response signal is an audio signal provided by at least one acoustic transducer in response to playback, by at least one loudspeaker, of the reference signal.

14. The audio processing system of claim 13 , wherein the filtering section is configured to, for each of the frequency subbands:

compute a frequency subband residual signal based on the filtered inband reference corresponding to the frequency subband and a subband signal of the response signal corresponding to the frequency subband; and

adjust, based on the frequency subband residual signal for the frequency subband, at least the filter applied to the subband signal of the reference signal corresponding to the frequency subband,

wherein the audio processing system further comprises:

a synthesis section configured to synthesize an output signal based on the frequency subband residual signals for the respective frequency subbands.

15. A non-transitory medium having software stored thereon, the software including instructions for controlling at least one apparatus to perform a method comprising the following steps:

receiving subband signals corresponding to audio content of a reference signal in respective frequency subbands;

receiving subband signals corresponding to audio content of a response signal in the respective frequency subbands;

forming filtered inband references by applying respective filters to the subband signals of the reference signal; and

for at least one frequency subband:

forming one or more filtered crossband references by multiplying, by one or more scalar factors, one or more filtered inband references of one or more other frequency subbands;

forming a composite filtered reference by summing the filtered inband reference corresponding to the frequency subband and the one or more filtered crossband references;

computing a residual signal as a difference between the composite filtered reference and the subband signal of the response signal corresponding to the frequency subband; and

adjusting, based on the residual signal, the one or more scalar factors and the filter applied to the subband signal of the reference signal corresponding to the frequency subband.

16. The non-transitory medium of claim 15 , the further comprising the steps:

receiving the reference signal and the response signal;

decomposing the reference signal and the response signal into respective subband signals;

downsampling the subband signals of the reference signal prior to applying the filters; and

downsampling the subband signals of the response signal prior to computing the residual signal.

17. The non-transitory medium of claim 15 , wherein the adjustment is performed to reduce power and/or energy of the residual signal.

18. The non-transitory medium of claim 15 , wherein the residual signal is computed for a time frame, or for a portion of a time frame, and wherein a new residual signal is computed for a succeeding time frame, or for a succeeding portion of a time frame, based on the adjusted filter and the adjusted one or more scalar factors.

19. The non-transitory medium of claim 15 , wherein said other frequency subbands include a neighboring frequency subband on either side of said frequency subband.

20. The non-transitory medium of claim 15 , wherein adjusting the one or more scalar factors and the filter applied to the subband signal of the reference signal corresponding to said frequency subband includes:

modifying an update step size of the one or more scalar factors and/or of the filter applied to the subband signal of the reference signal corresponding to said frequency subband, in response to a power ratio between the subband signal of the reference signal corresponding to said frequency subband and said one or more filtered inband references of one or more other frequency subbands exceeding an upper threshold or being below a lower threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 14, 2017
From: SHI, DONG; DICKINS, GLENN N.; GUNAWAN, DAVID; SUN, XUEJING
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 043590/0411 →
Priority Claims (2)
WO PCT/CN2015/075208 · Mar 27, 2015 · international
EP 15169483.3 · May 27, 2015 · regional
Continuity (2)
Provisional Application 62162937 · May 18, 2015
Related Publication 20180075862A1 · Mar 15, 2018