IP Library Granted Patent US 9,685,167
Granted Patent B2
US 9,685,167 · App. 13/054,662 · Granted Jun 20, 2017

Multi-object audio encoding and decoding apparatus supporting post down-mix signal

Inventors: Jeongil Seo (Daejeon, KR); Seungkwon Beack (Daejeon, KR); Kyeongok Kang (Daejeon, KR); Jin Woo Hong (Daejeon, KR); Jinwoong Kim (Daejeon, KR); Chieteuk Ahn (Daejeon, KR); Kwangki Kim (Daejeon, KR); Minsoo Hahn (Daejeon, KR)
Assignee: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
G10L19/20G10L19/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,685,167
App. No.
13/054,662
Granted
Jun 20, 2017
Kind
B2
Abstract

A multi-object audio encoding and decoding apparatus supporting a post downmix signal may be provided. The multi-object audio encoding apparatus may include: an object information extraction and downmix generation unit to generate object information and a downmix signal from input object signals; a parameter determination unit to determine a downmix information parameter using the extracted downmix signal and the post downmix signal; and a bitstream generation unit to combine the object information and the downmix information parameter, and to generate an object bitstream.

Claims (31)

1. A multi-object audio encoding apparatus, comprising:

at least one hardware processor to:

generate object information using input object signals and extract a downmix signal from the input object signals;

determine a Post Downmix Gain (PDG) to compensate for a difference between the extracted downmix signal and a post downmix signal supplied from a source that is external to the multi-object audio encoding apparatus, the PDG being useable to adjust for the post downmix signal according to a relationship between the extracted downmix signal and the post downmix signal; and

generate an object bitstream including the PDG and the object information,

wherein the difference between the downmix signal and the post downmix signal is compensated by applying a mixing matrix including the PDG included with the object bitstream generated at the multi-object audio encoding apparatus,

wherein the mixing matrix is determined based on either mono downmix or stereo downmix.

2. The multi-object audio encoding apparatus of claim 1 ,

wherein the object information comprises spatial cue parameters predicted from the input object signals.

3. The multi-object audio encoding apparatus of claim 1 , wherein the at least one processor is configured operate as:

a power offset calculator that scales the post downmix signal as a predetermined value to enable an average power of the post downmix signal in a particular frame to be identical to an average power of the downmix signal; and

a parameter extractor that extracts the PDG from the scaled post downmix signal in a predetermined frame.

4. The multi-object audio encoding apparatus of claim 1 , wherein the at least one processor calculates a Downmix Channel Level Difference (DCLD) and a Downmix Gain (DMG) indicating a mixing amount of the input object signals.

5. The multi-object audio encoding apparatus of claim 1 , wherein the at least one processor generates a residual signal corresponding to the difference between the downmix signal and the post downmix signal, and transmits the object bitstream including the residual signal, the difference between the downmix signal and the post downmix signal being compensated for by applying the PDG.

6. The multi-object audio encoding apparatus of claim 5 , wherein the residual signal is generated with respect to a frequency band that affects a sound quality of the input object signals, and transmitted through the object bitstream.

7. A multi-object audio decoding apparatus which decodes a multi-object audio, comprising:

at least one hardware processor to:

extracting a Post Downmix Gain (PDG) and object information from an object bitstream;

decoding a downmix signal using the object information and generates an object signal; and

compensating a difference between the downmix signal and a post downmix signal supplied from a source that is external to the multi-object audio decoding apparatus, based on the PDG, the PDG being useable to adjust for the post downmix signal according to a relationship between the decoded downmix signal and the post downmix signal,

wherein the difference between the downmix signal and the post downmix signal is compensated by applying a mixing matrix including PDG transmitted to include the object bitstream to the multi-object audio decoding apparatus,

wherein the mixing matrix is determined based on either mono downmix or stereo downmix.

8. The multi-object audio decoding apparatus of claim 7 ,

wherein the object information comprises spatial cue parameters predicted from input object signals.

9. The multi-object audio decoding apparatus of claim 8 ,

user control information is applied to the object signal generated from the decoding to generate a reproducible output signal.

10. The multi-object audio decoding apparatus of claim 8 , wherein the at least one processor is configured operate as:

a power offset compensator that scales the post downmix signal using a power offset value extracted from the PDG as a downmix information parameter; and

a downmix signal adjustor that converts the scaled post downmix signal into the downmix signal using the PDG.

11. The multi-object audio decoding apparatus of claim 10 , wherein a residual signal is referenced to the post downmix signal, which is compensated for by using the PDG, and the post downmix signal is adjusted to be similar to the downmix signal, and

the residual signal is the difference between the downmix signal and the post downmix signal, the difference between the downmix signal and the post downmix signal being compensated for by applying the PDG.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 19, 2011
From: SEO, JEONGIL; BEACK, SEUNGKWON; KANG, KYEONGOK; HONG, JIN WOO; KIM, JINWOONG; AHN, CHIETEUK; KIM, KWANGKI; HAHN, MINSOO
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 025658/0028 →
Priority Claims (8)
KR 10-2008-0068861 · Jul 16, 2008 · national
KR 10-2008-0093557 · Sep 24, 2008 · national
KR 10-2008-0099629 · Oct 10, 2008 · national
KR 10-2008-0100807 · Oct 14, 2008 · national
KR 10-2008-0101451 · Oct 16, 2008 · national
KR 10-2008-0109318 · Nov 5, 2008 · national
KR 10-2009-0006716 · Jan 28, 2009 · national
KR 10-2009-0061736 · Jul 7, 2009 · national
Continuity (1)
Related Publication 20110166867A1 · Jul 7, 2011