IP Library Granted Patent US 9,986,365
Granted Patent B2
US 9,986,365 · App. 15/825,078 · Granted May 29, 2018

Audio signal processing method and device

Inventors: Taegyu Lee (Gyeonggi-do, KR); Hyun Oh Oh (Gyeonggi-do, KR)
Assignee: Wilus Institute Of Standards And Technology Inc.
H04S7/307H04S3/008H04S7/303H04S2400/01H04S2400/11H04S2420/01H04S2420/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,986,365
App. No.
15/825,078
Granted
May 29, 2018
Kind
B2
Abstract

The present invention relates to a method and an apparatus for processing an audio signal, and more particularly, to a method and an apparatus for processing an audio signal, which synthesizes an object signal and a channel signal and effectively binaural-render the synthesized signal. To this end, the present invention provides a method for processing an audio signal, including: receiving an input audio signal including at least one of a multi-channel signal and a multi-object signal; receiving type information of a filter set for binaural filtering of the input audio signal, the type of the filter set being one of a finite impulse response (FIR) filter, a parameterized filter in a frequency domain, and a parameterized filter in a time domain; receiving filter information for binaural filtering based on the type information; and performing the binaural filtering for the input audio signal by using the received filter information, wherein when the type information indicates the parameterized filter in the frequency domain, in the receiving of the filter information, a subband filter coefficient having a length determined for each subband of a frequency domain is received, and in the performing of the binaural filtering, each subband signal of the input audio signal is filtered by using the subband filter coefficient corresponding thereto and an apparatus for processing an audio signal by using the same.

Claims (26)

1. A method for generating a filter for an audio signal, comprising:

receiving time domain binaural room impulse response (BRIR) filter coefficients for binaural filtering an input audio signal;

obtaining propagation time information of the time domain BRIR filter coefficients, the propagation time information representing a time from an initial sample to direct sound of the BRIR filter coefficients;

QMF-converting time domain BRIR filter coefficients subsequent to the obtained propagation time to generate a plurality of sets of subband filter coefficients;

obtaining filter order information for determining a truncation length of each set of subband filter coefficients by at least partially using characteristic information extracted from the set of subband filter coefficients, the filter order being variably determined in a frequency domain; and

truncating each set of subband filter coefficients based on the obtained filter order information for each subband.

2. The method of claim 1 , wherein the obtaining the propagation time information further comprises:

measuring frame energies by shifting a predetermined hop wise;

identifying a first frame in which a frame energy is larger than a predetermined threshold; and

obtaining the propagation time information based on position information of the identified first frame.

3. The method of claim 2 , wherein the measuring frame energies measures an average value of frame energies for each channel with respect to a same time interval.

4. The method of claim 2 , wherein the threshold is determined to be a value which is lower than a maximum value of the measured frame energy by a predetermined proportion.

5. The method of claim 1 , wherein the characteristic information comprises reverberation time information of the corresponding set of subband filter coefficients, and the filter order has a single value for each subband.

6. A parameterization device for generating a filter for an audio signal, the parameterization device configured to:

receive time domain binaural room impulse response (BRIR) filter coefficients for binaural filtering an input audio signal;

obtain propagation time information of the time domain BRIR filter coefficients, the propagation time information representing a time from an initial sample to direct sound of the BRIR filter coefficients;

QMF-convert time domain BRIR filter coefficients subsequent to the obtained propagation time to generate a plurality of sets of subband filter coefficients;

obtain filter order information for determining a truncation length of each set of subband filter coefficients by at least partially using characteristic information extracted from the set of subband filter coefficients, the filter order being variably determined in a frequency domain; and

truncate each set of subband filter coefficients based on the obtained filter order information for each subband.

7. The device of claim 6 , wherein the parameterization device is further configured to:

measure frame energies by shifting a predetermined hop wise;

identify a first frame in which a frame energy is larger than a predetermined threshold; and

obtain the propagation time information based on position information of the identified first frame.

8. The device of claim 7 , wherein the parameterization device measures an average value of frame energies for each channel with respect to a same time interval.

9. The device of claim 7 , wherein the threshold is determined to be a value which is lower than a maximum value of the measured frame energies by a predetermined proportion.

10. The device of claim 6 , wherein the characteristic information comprises reverberation time information of the corresponding set of subband filter coefficients, and the filter order has a single value for each subband.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2021
From: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
To: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.; GCOA CO., LTD.
Reel/Frame 056610/0624 →
TERMINATION AGREEMENT OF EXCLUSIVE LICENSE Recorded Jul 16, 2020
From: BINAURAL AUDIO TECHNOLOGY INC.
To: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
Reel/Frame 053235/0462 →
LICENSE Recorded Feb 12, 2018
From: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
To: BINAURAL AUDIO TECHNOLOGY INC.
Reel/Frame 044905/0601 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 9, 2018
From: LEE, TAEGYU; OH, HYUN OH
To: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
Reel/Frame 044578/0178 →
Priority Claims (1)
KR 10-2014-0081226 · Jun 30, 2014 · national
Continuity (4)
Continuation 15300273
Provisional Application 61973868 · Apr 2, 2014
Provisional Application 62019958 · Jul 2, 2014
Related Publication 20180091927A1 · Mar 29, 2018