IP Library Granted Patent US 10,455,346
Granted Patent B2
US 10,455,346 · App. 15/942,588 · Granted Oct 22, 2019

Method and device for audio signal processing

Inventors: Taegyu Lee (Seongnam-si, KR); Hyunoh Oh (Gwacheon-si, KR)
Assignee: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
H04S5/005G10L19/008G10L19/0204G10L25/48H03H17/0229H03H17/0248H03H17/0266H03H17/0272H03H21/0012H04R5/04H04S3/00H04S3/002H04S3/008H04S3/02H04S7/30H04S2400/01H04S2400/03H04S2420/03H04S2420/07H04S2420/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,455,346
App. No.
15/942,588
Granted
Oct 22, 2019
Kind
B2
Abstract

The present invention relates to a method and an apparatus for processing a signal, which are used for effectively reproducing an audio signal, and more particularly, to a method and an apparatus for processing a signal, which are used for implementing binaural rendering for reproducing multi-channel or multi-object audio signals in stereo with a low calculation amount. To this end, provided are a method for processing an audio signal including: receiving multi-audio signals including multi-channel or multi-object signals, each of the multi-audio signals including a plurality of subband signals, and the plurality of subband signals including a signal of a first subband group having low frequencies and a signal of a second subband group having high frequencies based on a predetermined frequency band; receiving at least one parameter corresponding to each subband signal of the second subband group, the at least one parameter being extracted from binaural room impulse response (BRIR) subband filter coefficients corresponding to each subband signal of the second subband group; and performing tap-delay line filtering of the subband signal of the second subband group by using the received parameter and an apparatus for processing an audio signal using the same.

Claims (38)

1. A method for processing an audio signal, the method comprising:

receiving an input audio signal including a plurality of subband signals, wherein the plurality of subband signals include a first subband group containing only low-frequency subband signals determined based on a predetermined frequency band and a second subband group containing only high-frequency subband signals determined based on the predetermined frequency band;

performing a first filtering on each subband signal of the first subband group; and

performing a second filtering on each subband signal of the second subband group, wherein the second filtering is distinct from the first filtering,

wherein the first filtering is performed by using a first parameter set including one or more parameters for a corresponding subband and the second filtering is performed by using a second parameter set including one or more parameters for a corresponding subband,

wherein characteristics of the first parameter set is different from characteristics of the second parameter set,

wherein the second parameter set includes a set of gain and delay for the corresponding subband, and

wherein the second filtering comprises performing one-tap-delay line filtering on each subband signal of the second subband group by using the set of gain and delay for the corresponding subband.

2. The method of claim 1 , wherein the number of one or more parameters of a second parameter set for a subband of the first subband group is equal to or less than the number of one or more parameters of a first parameter set for a subband of the first subband group.

3. The method of claim 1 , wherein the first parameter set includes a set of subband filter coefficients obtained as at least a portion of proto-type subband filter coefficients for the corresponding subband, and

wherein the first filtering comprises performing fast convolution on each subband signal of the first subband group by using the set of subband filter coefficients for the corresponding subband.

4. The method of claim 3 , wherein the proto-type subband filter coefficients are binaural room impulse response (BRIR) subband filter coefficients.

5. The method of claim 1 , wherein the set of gain and delay is extracted from BRIR subband filter coefficients for the corresponding subband.

6. The method of claim 5 , wherein the delay indicates positional information for a maximum peak in the BRIR subband filter coefficients.

7. The method of claim 1 , wherein the gain has a complex value.

8. The method of claim 1 , further comprising:

combining filtered subband signals of the first subband group and filtered subband signals of the second subband group into 2-channel left and right signals; and

performing a QMF-synthesis on the combined 2-channel left and right signals.

9. An apparatus for processing an audio signal, the apparatus comprising:

a binaural renderer configured to perform binaural rendering on an input audio signal,

wherein the binaural renderer is configured to:

receive an input audio signal including a plurality of subband signals, wherein the plurality of subband signals include a first subband group containing only low-frequency subband signals determined based on a predetermined frequency band and a second subband group containing only high-frequency subband signals determined based on the predetermined frequency band,

perform a first filtering on each subband signal of the first subband group, and

perform a second filtering on each subband signal of the second subband group, wherein the second filtering is distinct from the first filtering,

wherein the first filtering is performed by using a first parameter set including one or more parameters for a corresponding subband and the second filtering is performed by using a second parameter set including one or more parameters for a corresponding subband,

wherein characteristics of the first parameter set is different from characteristics of the second parameter set,

wherein the second parameter set includes a set of gain and delay for the corresponding subband, and

wherein the second filtering comprises performing one-tap-delay line filtering on each subband signal of the second subband group by using the set of gain and delay for the corresponding subband.

10. The apparatus of claim 9 , wherein the number of one or more parameters of a second parameter set for a subband of the first subband group is equal to or less than the number of one or more parameters of a first parameter set for a subband of the first subband group.

11. The apparatus of claim 9 , wherein the first parameter set includes a set of subband filter coefficients obtained as at least a portion of proto-type subband filter coefficients for the corresponding subband, and

wherein the first filtering comprises performing fast convolution on each subband signal of the first subband group by using the set of subband filter coefficients for the corresponding subband.

12. The apparatus of claim 11 , wherein the proto-type subband filter coefficients are binaural room impulse response (BRIR) subband filter coefficients.

13. The apparatus of claim 9 , wherein the set of gain and delay is extracted from BRIR subband filter coefficients for the corresponding subband.

14. The apparatus of claim 13 , wherein the delay indicates positional information for a maximum peak in the BRIR subband filter coefficients.

15. The apparatus of claim 9 , wherein the gain has a complex value.

16. The apparatus of claim 9 , wherein the binaural renderer is further configured to:

combine filtered subband signals of the first subband group and filtered subband signals of the second subband group into 2-channel left and right signals, and

perform a QMF-synthesis on the combined 2-channel left and right signals.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2021
From: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
To: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.; GCOA CO., LTD.
Reel/Frame 056610/0624 →
TERMINATION AGREEMENT OF EXCLUSIVE LICENSE Recorded Jul 16, 2020
From: BINAURAL AUDIO TECHNOLOGY INC.
To: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
Reel/Frame 053235/0462 →
LICENSE Recorded Jan 17, 2019
From: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
To: BINAURAL AUDIO TECHNOLOGY INC.
Reel/Frame 048038/0977 →
Priority Claims (1)
KR 10-2013-0125936 · Oct 22, 2013 · national
Continuity (4)
Continuation 15022922
Provisional Application 61878638 · Sep 17, 2013
Provisional Application 61894442 · Oct 23, 2013
Related Publication 20180227692A1 · Aug 9, 2018