IP Library Granted Patent US 10,580,417
Granted Patent B2
US 10,580,417 · App. 15/031,275 · Granted Mar 3, 2020

Method and apparatus for binaural rendering audio signal using variable order filtering in frequency domain

Inventors: Taegyu Lee (Seongnam-si, KR); Hyunoh Oh (Gwacheon-si, KR); Youngcheol Park (Wonju-si, KR); Daehee Youn (Seoul, KR); Jeongil Seo (Daejeon, KR); Yongju Lee (Daejeon, KR); Seungkwon Beack (Seoul, KR); Kyeongok Kang (Daejeon, KR); Daeyoung Jang (Daejeon, KR)
Assignees: INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY; WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY INC.; ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
G10L19/008H04R5/033H04S3/00H04S3/002H04S3/004H04S3/008G10H2250/111G10H2250/145H04R3/00H04S2400/01H04S2420/01H04S2420/03
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,580,417
App. No.
15/031,275
Granted
Mar 3, 2020
Kind
B2
Abstract

The present invention relates to a method and an apparatus for binaural rendering an audio signal using variable order filtering in frequency domain. To this end, provided are a method for processing an audio signal including: receiving an input audio signal; receiving a set of truncated subband filter coefficients for filtering each subband signal of the input audio signal, the set of truncated subband filter coefficients being constituted by one or more FFT filter coefficients generated by performing FFT by a predetermined block size; generating at least one subframe for each subband; generating at least one filtered subframe for each subband; performing inverse FFT on the filtered subframe for each subband; and generating a filtered subband signal by overlap-adding the transformed subframe for each subband and an apparatus for processing an audio signal using the same.

Claims (31)

1. A method for binaural rendering an audio signal, comprising:

receiving an input audio signal;

receiving a set of truncated subband filter coefficients for filtering each subband signal of the input audio signal, the set of truncated subband filter coefficients being at least a portion of a corresponding set of subband filter coefficients obtained from binaural room impulse response (BRIR) filter coefficients for binaural filtering of the input audio signal, a length of the set of truncated subband filter coefficients being individually determined for each subband based on characteristic information extracted from the corresponding set of subband filter coefficients, the length of the set of truncated subband filter coefficients being determined to be variable in a frequency domain, and the set of truncated subband filter coefficients being constituted by one or more FFT filter coefficients generated by performing fast Fourier transform (FFT) by a predetermined block size in a corresponding subband;

generating at least one subframe for each subband by performing fast Fourier transform of each subband signal based on a predetermined subframe size;

generating at least one filtered subframe for each subband, each filtered subframe being generated by multiplying a corresponding subframe and the FFT filter coefficients;

inverse fast Fourier transforming the at least one filtered subframe for each subband; and

generating a filtered subband signal by overlap-adding the at least one inverse fast Fourier transformed subframe for each subband.

2. The method of claim 1 , wherein the characteristic information includes reverberation time information of the corresponding set of subband filter coefficients.

3. The method of claim 1 , wherein a length of a set of truncated subband filter coefficients of at least one subband is different from a length of a set of truncated subband filter coefficients of another subband.

4. The method of claim 1 , wherein the predetermined block size and the predetermined subframe size have values of power of 2.

5. The method of claim 1 , wherein the predetermined subframe size is determined based on the predetermined block size in the corresponding subband.

6. The method of claim 5 , the performing of the fast Fourier transform of each subband signal comprises:

partitioning each subband signal by the predetermined subframe size;

generating a temporary subframe including a first half part constituted by the partitioned subband signal and a second half part constituted by zero-padded values; and

fast Fourier transforming the generated temporary subframe.

7. An apparatus for processing an audio signal, which is used for performing binaural rendering of input audio signals, each input audio signal including a plurality of subband signals, the apparatus comprising:

a processor configured to perform rendering of a direct sound and early reflections sound parts for each subband signal, wherein the processor is further configured to:

receive an input audio signal;

receive a set of truncated subband filter coefficients for filtering each subband signal of the input audio signal, the set of truncated subband filter coefficients being at least a portion of a corresponding set of subband filter coefficients obtained from binaural room impulse response (BRIR) filter coefficients for binaural filtering of the input audio signal, a length of the set of truncated subband filter coefficients being individually determined for each subband based on characteristic information extracted from the corresponding set of subband filter coefficients, the length of the set of truncated subband filter coefficients being determined to be variable in a frequency domain, and the set of truncated subband filter coefficients being constituted by one or more FFT filter coefficients generated by performing fast Fourier transform (FFT) by a predetermined block size in a corresponding subband;

generate at least one subframe for each subband by performing fast Fourier transform of each subband signal based on a predetermined subframe size;

generate at least one filtered subframe for each subband, each filtered subframe being generated by multiplying a corresponding subframe and the FFT filter coefficients;

inverse fast Fourier transform the at least one filtered subframe for each subband; and

generate a filtered subband signal by overlap-adding the at least one inverse fast Fourier transformed subframe for each subband.

8. The apparatus of claim 7 , wherein the characteristic information includes reverberation time information of the corresponding set of subband filter coefficients.

9. The apparatus of claim 7 , wherein a length of a set of truncated subband filter coefficients of at least one subband is different from a length of a set of truncated subband filter coefficients of another subband.

10. The apparatus of claim 7 , wherein the predetermined block size and the predetermined subframe size have values of power of 2.

11. The apparatus of claim 7 , wherein the predetermined subframe size is determined based on the predetermined block size in the corresponding subband.

12. The apparatus of claim 11 , the performing of the fast Fourier transform of each subband signal comprises:

partitioning each subband signal by the predetermined subframe size;

generating a temporary subframe including a first half part constituted by the partitioned subband signal and a second half part constituted by zero-padded values; and

fast Fourier transforming the generated temporary subframe.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 15, 2016
From: LEE, TAEGYU; OH, HYUNOH; PARK, YOUNGCHEOL; YOUN, DAEHEE; SEO, JEONGIL; LEE, YONGJU; BEACK, SEUNGKWON; KANG, KYEONGOK; JANG, DAEYOUNG
To: INDUSTRY-ACADEMIC COOPERATION FOUNDATION, YONSEI UNIVERSITY; WILUS INSTITUTE OF STANDARDS AND TECHNOLOGY; ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 038913/0950 →
Priority Claims (2)
KR 10-2013-0125930 · Oct 22, 2013 · national
KR 10-2013-0125933 · Oct 22, 2013 · national
Continuity (2)
Provisional Application 61973868 · Apr 2, 2014
Related Publication 20160277865A1 · Sep 22, 2016
Cited By (1)
US 12,738,913