IP Library Granted Patent US 10,453,464
Granted Patent B2
US 10,453,464 · App. 15/326,378 · Granted Oct 22, 2019

Decomposing audio signals

Inventors: Jun Wang (Beijing, CN); Lie Lu (Beijing, CN)
Assignee: Dolby Laboratories Licensing Corporation
G10L19/0204G10L19/008G10L21/0308G10L25/21H04S3/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,453,464
App. No.
15/326,378
Granted
Oct 22, 2019
Kind
B2
Abstract

Example embodiments disclosed herein relate to signal processing. A method for decomposing a plurality of audio signals from at least two different channels is disclosed. The method obtains a set of components that are weakly correlated wherein the set of components generated based on the plurality of audio signals. The method extract a feature from the set of components and determining determines a set of gains associated with the set of components at least in part based on the extracted feature. Each of the gains indicate a proportion of a diffuse part in the associated component and decompose the plurality of audio signals by applying the set of gains to the set of components. Corresponding system and computer program product are also disclosed.

Claims (68)

1. A method for providing a sound field comprising:

obtaining a set of components that are weakly correlated, the set of components generated based on applying a transformation, to a received plurality of audio signals from at least two different channels, that causes the set of components to have correlations below a predefined threshold;

extracting a feature from the set of components;

determining a set of gains associated with the set of components at least in part based on the extracted feature, each of the set of gains indicating a proportion of a diffuse part in the associated set of components;

decomposing the plurality of audio signals by applying the set of gains to the set of components; and

providing the decomposed plurality of audio signals to an upmixer for subsequent output as the sound field.

2. The method according to claim 1 , wherein extracting the feature comprises at least one of the following:

extracting a local feature specific to one of the set of components; and

extracting a global feature related to the set of components,

wherein extracting the global feature comprises:

extracting the global feature based on power distributions of the set of components.

3. The method according to claim 2 , wherein extracting the local feature comprises at least one of the following:

determining position statistics of the one of the set of components in the at least two different channels; and

extracting an audio texture feature of the one of the set of components.

4. The method according to claim 2 , wherein extracting the global feature based on power distributions of the set of components comprises at least one of the following:

determining differences between powers of the set of components; and

calculating entropy based on normalized powers of the set of components.

5. The method according to claim 2 , wherein obtaining the set of components further comprises:

obtaining a first set of components that are weakly correlated and a second set of components that are weakly correlated, the first set of components generated in a sub-band and the second set of components generated in a full band or in a time domain, and

wherein extracting the global feature based on power distributions of the set of components comprises at least one of the following:

determining a difference between a first power and a second power, the first power being a larger power of the first set of components and the second power being a larger power of the second set of components; and

determining a difference between a first position of a first component having the first power in the at least two different channels and a second position of a second component having the second power in the at least two different channels.

6. The method according to claim 1 , further comprising:

determining complexity of the plurality of audio signals, the complexity indicating a number of direct signals in the plurality of audio signals; and

adjusting the set of gains based on the determined complexity,

wherein determining the set of gains comprises:

determining the set of gains based on the extracted feature and a preference of whether to preserve directionality or diffusion of the plurality of audio signals.

7. The method according to claim 1 , wherein determining the set of gains comprises:

predicting the set of gains based on the extracted feature and a set of reference gains determined for a reference feature.

8. The method according to claim 7 , further comprising:

obtaining a set of reference components that are weakly correlated, the set of reference components generated based on a plurality of known audio signals from the at least two different channels, the plurality of known audio signals having the reference feature; and

determining the set of reference gains associated with the set of reference components such that a difference between first characteristic of directionality and diffusion of the plurality of the known audio signals and second characteristic of directionality and diffusion is minimized, the second characteristic obtained by decomposing the plurality of the known audio signals by applying the set of reference gains to the set of reference components.

9. The method according to claim 8 , wherein determining the set of reference gains further comprises:

determining the set of reference gains based on a preference of whether to preserve directionality or diffusion of the plurality of known audio signals.

10. A system for providing a sound field, the system comprising:

a component obtaining unit configured to obtain a set of components that are weakly correlated, the set of components generated based on applying a transformation, to a received plurality of audio signals from at least two different channels, that causes the set of components to have correlations below a predefined threshold;

a feature extracting unit configured to extract a feature from the set of components;

a gain determining unit configured to determine a set of gains associated with the set of components at least in part based on the extracted feature, each of the gains indicating a proportion of a diffuse part in the associated set of components;

a decomposing unit configured to decompose the plurality of audio signals by applying the set of gains to the set of components, the decomposing unit providing the decomposed plurality of audio signals to an upmixer for subsequent output as the sound field.

11. The system according to claim 10 , wherein the feature extracting unit is further configured to do at least one of the following:

extract a local feature specific to one of the set of components; and

extract a global feature related to the set of components,

wherein the feature extracting unit is further configured to extract the global feature based on power distributions of the set of components.

12. The system according to claim 11 , wherein the feature extracting unit is further configured to do at least one of the following:

determine position statistics of the one of the set of components in the at least two different channels; and

extract an audio texture feature of the one of the set of components.

13. The system according to claim 11 , wherein the feature extracting unit is further configured to do at least one of the following:

determine differences between powers of the set of components; and

calculate entropy based on normalized powers of the set of components.

14. The system according to claim 11 , wherein the component obtaining unit is further configured to:

obtain a first set of components that are weakly correlated and a second set of components that are weakly correlated, the first set of components generated in a sub-band and the second set of components generated in a full band or in a time domain, and

wherein the feature extracting unit is further configured to do at least one of the following:

determine a difference between a first power and a second power, the first power being a larger power of the first set of components and the second power being a larger power of the second set of components; and

determine a difference between a first position of a first component having the first power in the at least two different channels and a second position of a second component having the second power in the at least two different channels.

15. The system according to claim 10 , further comprising:

a complexity determining unit configured to determine complexity of the plurality of audio signals, the complexity indicating a number of direct signals in the plurality of audio signals; and

a gain adjusting unit configured to adjust the set of gains based on the determined complexity.

16. The system according to claim 15 , wherein the gain determining unit is further configured to:

determine the set of gains based on the extracted feature and a preference of whether to preserve directionality or diffusion of the plurality of audio signals.

17. The system according to claim 10 , wherein the gain determining unit is further configured to:

predict the set of gains based on the extracted feature and a set of reference gains determined for a reference feature.

18. The system according to claim 17 , wherein the component obtaining unit is further configured to:

obtain a set of reference components that are weakly correlated, the set of reference components generated based on a plurality of known audio signals from the at least two different channels, the plurality of known audio signals having the reference feature; and

the system further comprises:

a reference gain determining unit configured to determine the set of reference gains associated with the set of reference components such that a difference between first characteristic of directionality and diffusion of the plurality of the known audio signals and second characteristic of directionality and diffusion is minimized, the second characteristic obtained by decomposing the plurality of the known audio signals by applying the set of reference gains to the set of reference components.

19. The system according to claim 18 , wherein the reference gain determining unit is further configured to:

determine the set of reference gains based on a preference of whether to preserve directionality or diffusion of the plurality of known audio signals.

20. A computer program product for providing a sound field, the computer program product being tangibly stored on a non-transient computer-readable medium and comprising machine executable instructions which, when executed, cause a machine to perform steps of the method according to claim 1 .

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 26, 2017
From: WANG, JUN; LU, LIE
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 041093/0899 →
Priority Claims (1)
CN 2014 1 0357288 · Jul 17, 2014 · national
Continuity (2)
Provisional Application 62033727 · Aug 6, 2014
Related Publication 20170206907A1 · Jul 20, 2017
Cited By (1)
US 12,581,266