IP Library › Granted Patent US 11,871,204
Granted Patent B2
US 11,871,204 · App. 17/877,696 · Granted Jan 9, 2024

Apparatus and method for processing multi-channel audio signal

Inventors: Yong Ju Lee (Daejeon, KR); Jeong Il Seo (Daejeon, KR); Seung Kwon Beack (Daejeon, KR); Kyeong Ok Kang (Daejeon, KR); Jin Woong Kim (Daejeon, KR); Jae Hyoun Yoo (Daejeon, KR)
Assignee: Electronics and Telecommunications Research Institute
H04S3/008G10L19/008H04S2400/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,871,204
App. No.
17/877,696
Granted
Jan 9, 2024
Kind
B2
Abstract

Disclosed is an apparatus and method for processing a multichannel audio signal. A multichannel audio signal processing method may include: generating an N-channel audio signal of N channels by down-mixing an M-channel audio signal of M channels; and generating a stereo audio signal by performing binaural rendering of the N-channel audio signal.

Claims (34)

1. A multichannel audio signal processing method processed by a decoder, comprising:

generating an N-channel audio signal of N channels by down-mixing an M-channel audio signal of M channels in a format converter using playback environment or virtual layout, the number of M channels being greater than the number of N channels;

generating a stereo audio signal by performing binaural rendering of the N-channel audio signal in a binaural renderer; and

outputting the stereo audio signal,

wherein a plurality of objects are inputted to an object renderer through a first dynamic range control (DRC 1 ).

2. The method of claim 1 , wherein the decoder extracts a plurality of channel/prerendered objects and a plurality of objects from a bitstream.

3. The method of claim 1 , wherein a plurality of channels corresponding to the M channel audio signal of M channels are inputted to the format converter through a first dynamic range control (DRC 1 ).

4. The method of claim 1 , wherein the N-channel audio signal of N channels are outputted from a mixer.

5. The method of claim 1 , wherein the N-channel audio signal of N channels is inputted into a binaural renderer connected with a second dynamic range control (DRC 2 ) or is inputted into a third dynamic range control (DRC 3 ) connected with the second dynamic range control (DRC 2 ) for a loudspeaker feed.

6. The method of claim 1 , wherein the generating of the stereo audio signal comprises:

applying a N binaural filter for binaural rendering into each channel audio signal of N-channel audio signal, for each left channel audio signal and each right channel audio signal of the stereo audio signal.

7. The method of claim 6 , wherein the generating of the stereo audio signal comprises:

summing a filtering result of the N binaural filter related to a head related transfer function (HRTF) or a binaural room impulse response (BRIR) for binaural rendering.

8. A multichannel audio signal processing method processed by a decoder, comprising:

downmixing a M-channel audio signal of M channels for generating N-channel audio signal of N channels in a format converter using playback environment or virtual layout;

generating a stereo audio signal by performing binaural rendering the downmixed N-channel audio signal in a binaural renderer; and

outputting the stereo audio signal,

wherein a plurality of objects are inputted to an object renderer through a first dynamic range control (DRC 1 ).

9. The method of claim 8 , wherein a plurality of channel/prerendered objects and a plurality of objects are extracted from a bitstream.

10. The method of claim 9 , wherein a plurality of channels corresponding to the M channel audio signal of M channels are inputted to the format converter through a first dynamic range control (DRC 1 ).

11. The method of claim 8 , wherein the N-channel audio signal of N channels are outputted from a mixer.

12. The method of claim 8 , wherein the N-channel audio signal of N channels is inputted into the binaural renderer connected with a second dynamic range control (DRC 2 ) or is inputted into a third dynamic range control (DRC 3 ) connected with the second dynamic range control (DRC 2 ) for a loudspeaker feed.

13. The method of claim 8 , wherein the generating of the stereo audio signal comprises performing binaural rendering of the downmixed multichannel audio signal in a frequency domain.

14. The method of claim 8 , wherein the generating of the stereo audio signal comprises generating the stereo audio signal using a plurality of binaural filters respectively corresponding to the N channels of the N-channel audio signal.

15. A multichannel audio signal processing apparatus processed by a Unified Speech Audio Coding (USAC) 3D decoder, comprising:

one or more processor configured to:

downmix a M-channel audio signal of M channels in a format converter for generating N-channel audio signal of N channels based on a three-dimensional (3D) loudspeaker layout;

generate a stereo audio signal by performing binaural rendering of the downmixed N-channel audio signal in a binaural renderer; and

output the stereo audio signal,

wherein a plurality of objects are inputted to an object renderer through a first dynamic range control (DRC 1 ).

16. The apparatus of claim 15 , wherein the USAC 3D decoder extracts a plurality of channel/prerendered objects and a plurality of objects from a bitstream.

17. The apparatus of claim 15 , wherein a plurality of channels corresponding to the M channel audio signal of M channels are inputted to the format converter through a first dynamic range control (DRC 1 ).

18. The apparatus of claim 15 , wherein the N-channel audio signal of N channels are outputted from a mixer,

wherein the N-channel audio signal of N channels is inputted into the binaural renderer connected with a second dynamic range control (DRC 2 ) or is inputted into a third dynamic range control (DRC 3 ) connected with the second dynamic range control (DRC 2 ) for a loudspeaker feed.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 29, 2022
From: LEE, YONG JU; SEO, JEONG IL; BEACK, SEUNG KWON; KANG, KYEONG OK; KIM, JIN WOONG; YOO, JAE HYOUN
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 060677/0107 →
Priority Claims (2)
KR 10-2013-0043383 · Apr 19, 2013 · national
KR 10-2014-0046741 · Apr 18, 2014 · national
Continuity (4)
Continuation 16703226 · Dec 4, 2019
Continuation 16126466 · Sep 10, 2018
Continuation 14767538
Related Publication 20220369058A1 · Nov 17, 2022