IP Library Granted Patent US 10,321,254
Granted Patent B2
US 10,321,254 · App. 16/105,945 · Granted Jun 11, 2019

Audio signal processing method and apparatus

Inventors: Hyunoh Oh (Gyeonggi-do, KR); Taegyu Lee (Gyeonggi-do, KR); Jinsam Kwak (Gyeonggi-do, KR); Juhyung Son (Gyeonggi-do, KR)
Assignee: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
H04S3/008G10L19/20H04S2400/01H04S2400/03H04S2400/11H04S2420/01H04S2420/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,321,254
App. No.
16/105,945
Granted
Jun 11, 2019
Kind
B2
Abstract

The present invention relates to a method and an apparatus for processing an audio signal, and more particularly, to a method and an apparatus for processing an audio signal, which synthesize an object signal and a channel signal and effectively perform binaural rendering of the synthesized signal. To this end, provided are a method for processing an audio signal, which includes: receiving an input audio signal including a multi-channel signal; receiving truncated subband filter coefficients for filtering the input audio signal, the truncated subband filter coefficients being at least some of subband filter coefficients obtained from binaural room impulse response (BRIR) filter coefficients for binaural filtering of the input audio signal and the length of the truncated subband filter coefficients being determined based on filter order information obtained by at least partially using reverberation time information extracted from the corresponding subband filter coefficients; obtaining vector information indicating the BRIR filter coefficients corresponding to each channel of the input audio signal; and filtering each subband signal of the multi-channel signal by using the truncated subband filter coefficients corresponding to the relevant channel and subband based on the vector information and an apparatus for processing an audio signal by using the same.

Claims (28)

1. A method for processing an audio signal, comprising:

receiving an audio signal of a first channel, wherein the first channel is classified into a first channel group, and the audio signal of the first channel includes a plurality of subband signals;

receiving an audio signal of a second channel, wherein the second channel is classified into a second channel group, and the audio signal of the second channel includes a plurality of subband signals;

filtering each subband signal of the first channel by using each set of subband filter coefficients generated from a first set of filter coefficients, wherein the first set of filter coefficients corresponds to a position related to the first channel in a virtual reproduction space;

filtering each subband signal of the second channel by using each set of subband filter coefficients generated from a second set of filter coefficients, wherein the second set of filter coefficients corresponds to a position related to the second channel in the virtual reproduction space; and

generating an output audio signal by mixing the filtered subband signals of the first channel and the filtered subband signals of the second channel;

wherein a length of the set of subband filter coefficients is determined based on a filter order for each subband and for each channel group, and the filter order is variable for each subband and for each channel group.

2. The method of claim 1 , wherein a filter order for a specific subband for the first channel group is higher than a filter order for the specific subband for the second channel group.

3. The method of claim 2 , wherein the first channel group is a front channel group including one or more front channels, and the second channel group is a rear channel group including one or more rear channels.

4. The method of claim 1 , wherein the set of subband filter coefficients is generated by truncating a corresponding set of binaural room impulse response (BRIR) subband filter coefficients, and

the set of BRIR subband filter coefficients is obtained from a set of BRIR filter coefficients in a time domain.

5. The method of claim 4 , wherein a length of the truncation is determined based on a filter order obtained by using characteristic information extracted from the corresponding set of BRIR subband filter coefficients.

6. The method of claim 5 , wherein the characteristic information includes reverberation time information of the corresponding set of BRIR subband filter coefficients.

7. The method of claim 4 , wherein the first set of filter coefficients is a set of BRIR filter coefficients corresponding to the position related to the first channel and the second set of filter coefficients is a set of BRIR filter coefficients corresponding to the position related to the second channel.

8. An apparatus for processing an audio signal, the apparatus is configured to:

receive an audio signal of a first channel, wherein the first channel is classified into a first channel group, and the audio signal of the first channel includes a plurality of subband signals;

receive an audio signal of a second channel, wherein the second channel is classified into a second channel group, and the audio signal of the second channel includes a plurality of subband signals;

filter each subband signal of the first channel by using each set of subband filter coefficients generated from a first set of filter coefficients, wherein the first set of filter coefficients corresponds to a position related to the first channel in a virtual reproduction space;

filter each subband signal of the second channel by using each set of subband filter coefficients generated from a second set of filter coefficients, wherein the second set of filter coefficients corresponds to a position related to the second channel in the virtual reproduction space; and

generate an output audio signal by mixing the filtered subband signals of the first channel and the filtered subband signals of the second channel;

wherein a length of the set of subband filter coefficients is determined based on a filter order for each subband and for each channel group, and the filter order is variable for each subband and for each channel group.

9. The apparatus of claim 8 , wherein a filter order for a specific subband for the first channel group is higher than a filter order for the specific subband for the second channel group.

10. The apparatus of claim 9 , wherein the first channel group is a front channel group including one or more front channels, and the second channel group is a rear channel group including one or more rear channels.

11. The apparatus of claim 8 , wherein the set of subband filter coefficients is generated by truncating a corresponding set of binaural room impulse response (BRIR) subband filter coefficients, and

the set of BRIR subband filter coefficients is obtained from a set of BRIR filter coefficients in a time domain.

12. The apparatus of claim 11 , wherein a length of the truncation is determined based on a filter order obtained by using characteristic information extracted from the corresponding set of BRIR subband filter coefficients.

13. The apparatus of claim 12 , wherein the characteristic information includes reverberation time information of the corresponding set of BRIR subband filter coefficients.

14. The apparatus of claim 11 , wherein the first set of filter coefficients is a set of BRIR filter coefficients corresponding to the position related to the first channel and the second set of filter coefficients is a set of BRIR filter coefficients corresponding to the position related to the second channel.

Assignments (4)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 22, 2021
From: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
To: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.; GCOA CO., LTD.
Reel/Frame 056610/0624 →
TERMINATION AGREEMENT OF EXCLUSIVE LICENSE Recorded Jul 16, 2020
From: BINAURAL AUDIO TECHNOLOGY INC.
To: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
Reel/Frame 053235/0462 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 21, 2019
From: OH, HYUNOH; LEE, TAEGYU; KWAK, JINSAM; SON, JUHYUNG
To: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
Reel/Frame 048075/0936 →
LICENSE Recorded Jan 17, 2019
From: WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.
To: BINAURAL AUDIO TECHNOLOGY INC.
Reel/Frame 048038/0977 →
Priority Claims (1)
KR 10-2014-0033966 · Mar 24, 2014 · national
Continuity (4)
Continuation 15795180 · Oct 26, 2017
Continuation 15124029
Provisional Application 61955243 · Mar 19, 2014
Related Publication 20180359587A1 · Dec 13, 2018