IP Library Granted Patent US 8,180,061
Granted Patent B2
US 8,180,061 · App. 11/458,646 · Granted May 15, 2012

Concept for bridging the gap between parametric multi-channel audio coding and matrixed-surround multi-channel coding

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,180,061
App. No.
11/458,646
Granted
May 15, 2012
Kind
B2
Abstract

The purpose of the invention is to bridge the gap between parametric multi-channel audio coding and matrixed-surround multi-channel coding by gradually improving the sound of an up-mix signal while raising the bit-rate consumed by the side-information starting from 0 up to the bit-rates of the parametric methods. More specifically, it provides a method of flexibly choosing an “operating point” somewhere between matrixed-surround (no side-information, limited audio quality) and fully parametric reconstruction (full side-information rate required, good quality). This operating point can be chosen dynamically (i.e. varying over time) and in response to the permissible side-information rate, as it is dictated by the individual application.

Claims (55)

1. Multi-channel audio decoder for processing an audio signal and for processing first parametric data describing a first portion of a multi-channel signal, wherein for a second portion of the multi-channel signal no parametric data or second parametric data is processed, the second parametric data requiring less information units than the first parametric data when describing an identical portion of the multi-channel signal, comprising:

a processor for deriving an intermediate signal from the audio signal,

using a first deriving rule for deriving a first portion of the intermediate signal, the first portion of the intermediate signal corresponding to the first portion of the multi-channel audio signal, wherein the first deriving rule is depending on the first parametric data; and

using a second deriving rule for deriving a second portion of the intermediate signal, the second deriving rule using no parametric data or the second parametric data.

2. Multi-channel audio decoder in accordance with claim 1 , which is operative to process first parametric data that is describing a time portion or a frequency portion of the multi-channel signal.

3. Multi-channel audio decoder in accordance with claim 1 , which is operative to process first parametric data that is comprising a description of a time portion of the multi-channel audio signal, wherein only information on a predetermined frequency band of the multi-channel audio signal is contained within the description.

4. Multi-channel audio decoder in accordance with claim 1 , in which the processor is operative to use the first deriving rule for deriving a frequency portion of the intermediate signal ranging from a low-frequency limit to a high-frequency limit.

5. Multi-channel audio decoder in accordance with claim 4 , which is operative to additionally process a window information signalling at least the high-frequency limit.

6. Multi-channel audio decoder in accordance with claim 4 , which is operative to derive at least the high-frequency limit from the first parametric data using a window estimation rule.

7. Multi-channel audio decoder in accordance with claim 6 , in which the window estimation rule includes counting the amount of parametric data submitted for a signal portion of the audio signal and comparing the counted amount of parametric data with a nominal amount of parametric data, wherein the audio signal is a down-mix signal.

8. Multi-channel audio decoder in accordance with claim 1 , in which the processor is operative to calculate the second deriving rule from information on the audio signal or from the second parametric data, wherein the audio signal is a down-mix signal.

9. Multi-channel audio decoder in accordance with claim 1 , in which the processor is operative to use a predefined rule as the second deriving rule.

10. Multi-channel audio decoder in accordance with claim 1 , which is operative to process parametric data that is comprising one or more spatial audio parameters chosen from the following list of spatial audio parameters:

ICC (inter-channel correlation)

CLD (channel level difference)

CPC (channel prediction coefficient).

11. Multi-channel audio decoder in accordance with claim 1 , further comprising a de-correlator to derive a de-correlated signal from the intermediate signal using a de-correlation filter.

12. Multi-channel audio decoder in accordance with claim 1 further comprising an up-mixer for calculating a reconstruction of the multi-channel signal,

using a first up-mixing rule for calculating a first portion of the reconstruction of the multi-channel signal corresponding to the first portion of the multi-channel signal, wherein the first upmixing rule is depending on the first parametric data; and

using a second up-mixing rule for calculating a second portion of the reconstruction of the multi-channel signal, the second up-mixing rule using no parametric data or the second parametric data.

13. Non-transitory storage medium having stored thereon a parametric representation describing spatial properties of a multi-channel audio signal, the parametric representation including first parametric data for a first portion of the multi-channel signal and wherein for a second portion of the multi-channel signal no parametric data or second parametric data is included, the second parametric data requiring less information units than the first parametric data for an identical portion of the multi-channel signal, wherein the parametric representation results in a processed audio signal when input into a multi-channel audio decoder for processing an audio signal according to claim 1 .

14. Multi-channel encoder for generating a parametric representation describing spatial properties of a multi-channel audio signal, the multi-channel encoder comprising:

a parameter generator for generating spatial parameters;

an output interface for generating the parametric representation,

wherein the parameter generator or the output interface is adapted to generate the parametric representation such that the parametric representation includes first parametric data for a first portion of the multi-channel signal and wherein for a second portion of the multi-channel signal no parametric data or second parametric data is included in the parametric representation, the second parametric data requiring less information units than the first parametric data when describing an identical portion of the multi-channel signal.

15. Multi-channel encoder in accordance with claim 14 ,

in which the output interface is further adapted to include a window information in the parametric representation, the window information indicating the first portion of the multi-channel audio signal.

16. Multi-channel encoder in accordance with claim 14 ,

further including a portion decider for deciding which portion of the multi-channel signal is used as the first portion, using a quality criterion.

17. Multi-channel encoder in accordance with claim 16 ,

in which the portion decider is operative to decide such that a quality of a reconstruction of the multi-channel signal using the parametric representation stays within a quality-tolerance range.

18. Multi-channel encoder in accordance with claim 16 ,

in which the portion decider is operative to decide such that a maximum amount of storage space consumed by the parametric representation is not exceeded.

19. Multi-channel encoder in accordance with claim 14 , additionally comprising a down-mixer for deriving a down-mix signal from the multi-channel signal; and

in which the output interface is further adapted to output the down-mix signal.

20. Multi-channel encoder in accordance with claim 19 ,

in which the parameter generator is operative to generate a full set of spatial parameters for the first portion and for the second portion of the multi-channel signal;

in which the down-mixer is operative to derive the down-mix signal using a full down-mixing rule depending on the full set of spatial parameters; and

in which the output interface is operative to generate the parametric representation using at least the spatial parameters corresponding to the first portion of the multi-channel signal.

21. Method for processing an audio signal and for processing first parametric data describing a first portion of a multi-channel signal, wherein for a second portion of the multi-channel signal no parametric data or second parametric data is processed, the second parametric data requiring less information units than the first parametric data when describing an identical portion of the multi-channel signal, the method comprising:

deriving, by a processor, an intermediate signal from a down-mix signal using a first deriving rule depending on the first parametric data for deriving a first portion of the intermediate signal, the first portion of the intermediate signal corresponding to the first portion of the multi-channel audio signal; and

deriving a second portion of the intermediate signal using a second deriving rule, the second deriving rule using the second parametric data or no parametric data,

wherein the processor comprises a hardware implementation.

22. Method for generating a parametric representation describing spatial properties of a multi-channel audio signal, the method comprising:

generating, by a parameter generator, spatial parameters; and

generating, by an output interface, the parametric representation such that the parametric representation includes first parametric data for a first portion of the multi-channel signal and wherein for a second portion of the multi-channel signal no parametric data or second parametric data is included in the parametric representation, the second parametric data requiring less information units than the first parametric data when describing an identical portion of the multi-channel signal,

wherein the parameter generator or the output interface comprises a hardware implementation.

23. A non-transitory storage medium having stored thereon a computer executable program code, for performing a method for processing an audio signal and for processing first parametric data describing a first portion of a multi-channel signal, wherein for a second portion of the multi-channel signal no parametric data or second parametric data is processed, the second parametric data requiring less information units than the first parametric data when describing an identical portion of the multi-channel signal, the method comprising:

deriving an intermediate signal from a down-mix signal using a first deriving rule depending on the first parametric data for deriving a first portion of the intermediate signal, the first portion of the intermediate signal corresponding to the first portion of the multi-channel audio signal; and

deriving a second portion of the intermediate signal using a second deriving rule, the second deriving rule using the second parametric data or no parametric data.

24. A non-transitory storage medium having stored thereon a computer executable program code, for performing a method for generating a parametric representation describing spatial properties of a multi-channel audio signal, the method comprising:

generating spatial parameters; and

generating the parametric representation such that the parametric representation includes first parametric data for a first portion of the multi-channel signal and wherein for a second portion of the multi-channel signal no parametric data or second parametric data is included in the parametric representation, the second parametric data requiring less information units than the first parametric data when describing an identical portion of the multi-channel signal.

25. Transcoder for generating a parametric representation of a multi-channel audio signal using spatial parameters describing the spatial properties of the multi-channel audio signal, comprising:

a parameter generator to generate the parametric representation such that the parametric representation includes first parametric data being derived from the spatial parameters for a first portion of the multi-channel signal and wherein for a second portion of the multi-channel signal no parametric data or second parametric data is included in the parametric representation, the second parametric data requiring less information units than the first parametric data when describing an identical portion of the multi-channel signal.

Assignments (10)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 4, 2019
From: UNIFIED SOUND RESEARCH, INC.
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 048247/0944 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 31, 2019
From: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
To: UNIFIED SOUND RESEARCH, INC.
Reel/Frame 048207/0701 →
CORRECTIVE ASSIGNMENT TO CORRECT THE EFFECTIVE DATE OF MERGER TO 09/05/2018 PREVIOUSLY RECORDED AT REEL: 047230 FRAME: 0133. ASSIGNOR(S) HEREBY CONFIRMS THE MERGER. Recorded Oct 29, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047630/0456 →
MERGER Recorded Oct 4, 2018
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: AVAGO TECHNOLOGIES INTERNATIONAL SALES PTE. LIMITED
Reel/Frame 047230/0133 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENTS Recorded Feb 3, 2017
From: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 041710/0001 →
PATENT SECURITY AGREEMENT Recorded Feb 11, 2016
From: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
To: BANK OF AMERICA, N.A., AS COLLATERAL AGENT
Reel/Frame 037808/0001 →
TERMINATION AND RELEASE OF SECURITY INTEREST IN PATENT RIGHTS (RELEASES RF 032856-0031) Recorded Feb 2, 2016
From: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
To: LSI CORPORATION; AGERE SYSTEMS LLC
Reel/Frame 037684/0039 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 3, 2015
From: AGERE SYSTEMS LLC
To: AVAGO TECHNOLOGIES GENERAL IP (SINGAPORE) PTE. LTD.
Reel/Frame 035365/0634 →
PATENT SECURITY AGREEMENT Recorded May 8, 2014
From: LSI CORPORATION; AGERE SYSTEMS LLC
To: DEUTSCHE BANK AG NEW YORK BRANCH, AS COLLATERAL AGENT
Reel/Frame 032856/0031 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 15, 2008
From: HILPERT, JOHANNES; FALLER, CHRISTOF; LINZMEIER, KARSTEN; SPERSCHNEIDER, RALPH
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.; AGERE SYSTEM, INC.
Reel/Frame 020805/0869 →