IP Library Granted Patent US 8,712,784
Granted Patent B2
US 8,712,784 · App. 13/377,334 · Granted Apr 29, 2014

Encoding method and encoding device, decoding method and decoding device and transcoding method and transcoder for multi-object audio signals

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,712,784
App. No.
13/377,334
Granted
Apr 29, 2014
Kind
B2
Abstract

A method of encoding a multi-object audio signal and an encoding apparatus, a decoding method and a decoding apparatus, and a transcoding method and a transcoder are provided. A multi-object audio signal encoding apparatus may encode object signals obtained by excluding ForeGround Objects (FGOs) from a plurality of input object signals, and may encode the FGOs, thereby providing a listener with a satisfactory sound quality.

Claims (54)

1. An encoding apparatus, comprising:

a first encoder to downmix object signals, and to generate BackGround Objects (BGOs) and a Spatial Audio Object Codec (SAOC) parameter, the object signals being obtained by excluding ForeGround Objects (FGOs) from a plurality of input object signals; and

a second encoder to downmix the FGOs and the BGOs, and to generate a final downmix signal and an Enhanced Karaoke-Solo (EKS) parameter.

2. The encoding apparatus of claim 1 , further comprising:

a multiplexer to multiplex the SAOC parameter and the EKS parameter and to generate an SAOC bitstream.

3. The encoding apparatus of claim 1 , wherein the first encoder and the second encoder are operated selectively based on an EKS encoding mode for controlling the FGOs, and a classic encoding mode for controlling the BGOs.

4. An encoding method, comprising:

downmixing object signals, and generating BackGround Objects (BGOs) and a Spatial Audio Object Codec (SAOC) parameter by a first encoder, the object signals being obtained by excluding ForeGround Objects (FGOs) from a plurality of input object signals; and

downmixing the FGOs and the BGOs, and generating a final downmix signal and an Enhanced Karaoke-Solo (EKS) parameter by a second encoder.

5. The encoding method of claim 4 , further comprising:

multiplexing the SAOC parameter and the EKS parameter, and generating an SAOC bitstream.

6. A decoding apparatus, comprising:

a bitstream analyzer to extract a Spatial Audio Object Codec (SAOC) parameter and an Enhanced Karaoke-Solo (EKS) parameter from a multiplexed SAOC bitstream;

a first decoder to restore ForeGround Objects (FGOs) and BackGround Objects (BGOs) from a final downmix signal using the EKS parameter;

a second decoder to generate a first rendered signal from the BGOs using the SAOC parameter and a rendering matrix; and

a renderer to generate a final rendered signal using the FGOs and the first rendered signal.

7. The decoding apparatus of claim 6 , wherein the renderer generates, based on the rendering matrix, the final rendered signal by using the first rendered signal and a second rendered signal that is generated from the FGOs.

8. The decoding apparatus of claim 7 , wherein the second decoder generates the first rendered signal by adjusting a gain of BGOs based on a gain value included in the rendering matrix, and

wherein the renderer generates a second rendered signal by adjusting a gain of the FGOs based on the gain value included in the rendering matrix.

9. The decoding apparatus of claim 6 , wherein the second decoder comprises:

a downmix preprocessor to preprocess the BGOs based on the rendering matrix, and to generate a modified downmix signal;

an SAOC transcoder to convert the SAOC parameter into a Moving Pictures Experts Group Surround (MPS) bitstream based on the rendering matrix; and

an MPS decoder to render the modified downmix signal based on the MPS bitstream and to generate the first rendered signal.

10. The decoding apparatus of claim 9 , wherein the renderer generates the final rendered signal using the rendered modified downmix signal and the FGOs.

11. The decoding apparatus of claim 6 , wherein the first decoder and the second decoder are operated selectively based on an EKS decoding mode for controlling the FGOs, and a classic decoding mode for controlling the BGOs.

12. The decoding apparatus of claim 6 , wherein the first decoder renders the restored FGOs based on the rendering matrix, and

wherein the renderer combines the rendered FGOs and the rendered BGOs, and generates the final rendered signal.

13. A decoding method, comprising:

extracting a Spatial Audio Object Codec (SAOC) parameter and an Enhanced Karaoke-Solo (EKS) parameter from a multiplexed SAOC bitstream;

restoring ForeGround Objects (FGOs) and BackGround Objects (BGOs) from a final downmix signal using the EKS parameter;

generating a first rendered signal from the BGOs using the SAOC parameter and a rendering matrix; and

generating a final rendered signal using the FGOs and the first rendered signal.

14. The decoding method of claim 13 , wherein the generating of the final rendered signal comprises generating, based on the rendering matrix, the final rendered signal by using the first rendered signal and a second rendered signal that is generated from the FGOs.

15. The decoding method of claim 14 , wherein the generating of the first rendered signal comprises generating the first rendered signal by adjusting a gain of the BGOs based on a gain value included in the rendering matrix, and

wherein the generating of the final rendered signal comprises generating the second rendered signal by adjusting a gain of the FGOs based on the gain value included in the rendering matrix.

16. The decoding method of claim 13 , wherein the generating of the first rendered signal comprises:

preprocessing the BGOs based on the rendering matrix, and generating a modified downmix signal;

converting the SAOC parameter into a Moving Pictures Experts Group Surround (MPS) bitstream based on the rendering matrix; and

rendering the modified downmix signal based on the MPS bitstream and generating the first rendered signal.

17. The decoding method of claim 16 , wherein the generating of the final rendered signal comprises generating the final rendered signal using the rendered modified downmix signal and the FGOs.

18. The decoding method of claim 13 , further comprising:

rendering the restored FGOs based on the rendering matrix,

wherein the generating of the final rendered signal comprises combining the rendered FGOs and the rendered BGOs, and generating the final rendered signal.

19. A decoding apparatus, comprising:

a bitstream analyzer to extract a Spatial Audio Object Codec (SAOC) parameter and an Enhanced Karaoke-Solo (EKS) parameter from a multiplexed SAOC bitstream;

a first decoder to restore ForeGround Objects (FGOs) and BackGround Objects (BGOs) from a final downmix signal using the EKS parameter, and to render the restored FGOs based on a rendering matrix;

a second decoder to render the BGOs using the SAOC parameter and the rendering matrix; and

a renderer to combine the rendered FGOs and the rendered BGOs, and to generate a final rendered signal.

20. A decoding method, comprising:

extracting a Spatial Audio Object Codec (SAOC) parameter and an Enhanced Karaoke-Solo (EKS) parameter from a multiplexed SAOC bitstream;

restoring ForeGround Objects (FGOs) and BackGround Objects (BGOs) from a final downmix signal using the EKS parameter;

rendering the restored FGOs based on a rendering matrix;

rendering the BGOs using the SAOC parameter and the rendering matrix; and

combining the rendered FGOs and the rendered BGOs and generating a final rendered signal.

Assignments (2)
ACKNOWLEDGMENT OF PATENT EXCLUSIVE LICENSE AGREEMENT Recorded Jun 26, 2013
From: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
To: INTELLECTUAL DISCOVERY CO., LTD.
Reel/Frame 030695/0272 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 9, 2011
From: SEO, JEONG IL; KANG, KYEONG OK
To: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE
Reel/Frame 027360/0407 →