IP Library Granted Patent US 11,570,571
Granted Patent B2
US 11,570,571 · App. 17/199,757 · Granted Jan 31, 2023

Method and apparatus for performing binaural rendering of audio signal

Inventors: Yong Ju Lee (Daejeon, KR); Jae-hyoun Yoo (Daejeon, KR); Mi Suk Lee (Daejeon, KR); Kyeongok Kang (Daejeon, KR); Dae Young Jang (Daejeon, KR)
Assignee: Electronics and Telecommunications Research Institute
H04S7/307G10L19/008H04S3/004H04S3/008H04S7/302
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,570,571
App. No.
17/199,757
Granted
Jan 31, 2023
Kind
B2
Abstract

A method and apparatus for performing binaural rendering of an audio signal are provided. The method includes identifying an input signal that is based on an object, and metadata that includes distance information indicating a distance to the object, generating a binaural filter that is based on the metadata, using a binaural room impulse response, obtaining a binaural filter to which a low-pass filter (LPF) is applied, using a frequency response control that is based on the distance information, and generating a binaural-rendered output signal by performing a convolution of the input signal and the binaural filter to which the LPF is applied.

Claims (39)

1. A rendering method comprising:

identifying an object-based audio signal;

identifying metadata including distance information representing the distance between an object corresponding to the object-based audio signal and a listener; and

rendering the object-based audio signal, based on the distance information representing the distance between an object corresponding to the object-based audio signal and a listener,

wherein, the object-based audio signal is rendered as an effect of applying a low-pass filter (LPF) according to the distance information included in the metadata,

wherein rendering the object-based audio signal comprises:

determining a binaural filter that is based on the metadata, using a binaural room impulse response;

obtaining the binaural filter to which the low-pass filter (LPF) is applied, using a frequency response control that is based on the distance information; and

generating a binaural-rendered output signal by performing a convolution of the object-based audio signal and the binaural filter which the low-pass filter (LPF) has been applied.

2. The rendering method of claim 1 ,

wherein the LPF has a cutoff frequency, and the cutoff frequency decreases as the distance represented by the distance information increases.

3. The rendering method of claim 1 , wherein:

the LPF has a cutoff frequency,

the cutoff frequency has a predetermined value when the distance represented by the distance information is less than or equal to a threshold, and

the cutoff frequency decreases as the distance represented by the distance information increases, when the distance represented by the distance information is greater than the threshold.

4. A rendering method comprising:

identifying an object-based audio signal;

identifying metadata including distance information representing the distance between an object corresponding to the object-based audio signal and a listener; and

rendering the object-based audio signal, based on the distance information representing the distance between an object corresponding to the object-based audio signal and a listener,

wherein, the object-based audio signal is rendered as an effect of applying a low-pass filter (LPF) according to the distance information included in the metadata,

wherein rendering the object-based audio signal comprises:

determining a binaural filter that is based on the metadata, using a binaural room impulse response;

obtaining an input signal to which a low-pass filter (LPF) is applied, using a frequency response control that is based on the distance information; and

generating a binaural-rendered output signal by performing a convolution of the binaural filter and the input signal to which the LPF has been applied,

wherein the LPF has a cutoff frequency,

wherein the cutoff frequency has a predetermined value when the distance represented by the distance information is less than or equal to a threshold, and

wherein the cutoff frequency decreases as the distance represented by the distance information increases, when the distance represented by the distance information is greater than the threshold.

5. A rendering method comprising:

identifying an object-based audio signal;

identifying metadata including distance information representing the distance between an object corresponding to the object-based audio signal and a listener; and

rendering the object-based audio signal, based on the distance information representing the distance between an object corresponding to the object-based audio signal and a listener,

wherein, the object-based audio signal is rendered as an effect of applying a low-pass filter (LPF) according to the distance information included in the metadata,

wherein the rendering the object-based audio signal comprises:

determining a binaural filter that is based on the metadata, using a binaural room impulse response;

generating a binaural-rendered input signal by performing a convolution of the input signal and the binaural filter; and

extracting an output signal in which a low-pass filter (LPF) is applied to the binaural-rendered input signal, using a frequency response control that is based on the distance information,

wherein the LPF has a cutoff frequency,

wherein the cutoff frequency has a predetermined value when the distance represented by the distance information is less than or equal to a threshold, and

wherein the cutoff frequency decreases as the distance represented by the distance information increases, when the distance represented by the distance information is greater than the threshold.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 12, 2021
From: LEE, YONG JU; YOO, JAE-HYOUN; LEE, MI SUK; KANG, KYEONGOK; JANG, DAE YOUNG
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 055658/0238 →
Priority Claims (1)
KR 10-2020-0084518 · Jul 9, 2020 · national
Continuity (1)
Related Publication 20220014869A1 · Jan 13, 2022