IP Library Granted Patent US 9,622,008
Granted Patent B2
US 9,622,008 · App. 14/766,739 · Granted Apr 11, 2017

Method and apparatus for determining directions of uncorrelated sound sources in a higher order ambisonics representation of a sound field

Inventors: Alexander Krueger (Hannover, DE); Sven Kordon (Wunstorf, DE)
Assignee: Dolby Laboratories Licensing Corporation
H04S3/00G10L19/008G10L21/0272H04S2420/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,622,008
App. No.
14/766,739
Granted
Apr 11, 2017
Kind
B2
Abstract

Higher Order Ambisonics (HOA) represents three-dimensional sound. HOA provides high spatial resolution and facilitates analyzing of the sound field with respect to dominant sound sources. The invention aims to identify independent dominant sound sources constituting the sound field, and to track their temporal trajectories. Known applications are searching for all potential candidates for dominant sound source directions by looking at the directional power distribution of the original HOA representation, whereas in the invention all components which are correlated with the signals of previously found sound sources are removed. By such operation the problem of erroneously detecting many instead of only one correct sound source can be avoided in case its contributions to the sound field are highly directionally dispersed.

Claims (38)

1. A method for determining directions of uncorrelated sound sources in a Higher Order Ambisonics (HOA) representation of a sound field, comprising:

in a current time frame of HOA coefficients, searching preliminary direction estimates of dominant sound sources; and

determining HOA sound field components based on corresponding dominant sound sources,

wherein a current direction estimate is determined based on a residual HOA representation which represents an original HOA representation from which all components correlated with signals of previously found sound sources have been removed,

wherein the current direction estimate is selected out of a set of predefined test directions, based on a power of a related general plane wave of the residual HOA representation, impinging from a direction on a listener position, relative to respective power of all other test directions, and

wherein the current direction estimate for the current time frame of HOA coefficients is assigned to at least a dominant sound source of a previous time frame of HOA coefficients and is smoothed with respect to a time trajectory.

2. The method of claim 1 , wherein the smoothing is based on a Bayesian inference process that exploits a statistical a priori sound source movement model and directional power distributions of the dominant sound source components of the original HOA representation.

3. The method of claim 2 , wherein the statistical a priori model statistically predicts a movement of individual sound sources based on their direction in the previous time frame and movement between the previous time frame and a penultimate time frame.

4. The method of claim 2 , wherein direction estimates are assigned to dominant sound sources of the previous time frame of HOA coefficients based on a joint minimization of angles between pairs of a direction estimate and a direction of a previously found sound source, and maximization of an absolute value of a correlation coefficient between the pairs of the directional signals related to a direction estimate and to a dominant sound source found in the previous time frame of HOA coefficients.

5. A method for determining directions of uncorrelated sound sources in a Higher Order Ambisonics (HOA) representation of a sound field, comprising:

in a current time frame of HOA coefficients, searching preliminary direction estimates of dominant sound sources, and

determining HOA sound field components based on corresponding dominant sound sources, and determining corresponding directional signals;

assigning the dominant sound sources to corresponding sound sources active in a previous time frame of the HOA coefficients based on a comparison of the preliminary direction estimates of the current time frame and smoothed directions of sound sources active in the previous time frame, wherein the assignment is further based on a correlation of directional signals of the current time frame and directional signals of sound sources active in the previous time frame, resulting in an assignment function;

determining smoothed dominant source directions based on the assignment function, the smoothed dominant source directions in the previous time frame, indices of active dominant sound sources in the previous time frame, respective source movement angles between the penultimate time frame and the previous time frame, and the HOA sound field components based on the corresponding dominant sound sources; and

determining indices and directions of the active dominant sound sources of the current time frame based on the smoothed dominant source directions, a frame delayed version of directions of the active dominant sound sources of the previous time frame and a frame delayed version of indices of the active dominant sound sources of the previous time frame,

wherein the directional signals of sound sources active in the previous time frame are determined based on mode matching based on the frame delayed version of directions of the active dominant sound sources of the previous time frame and the HOA coefficients of the previous time frame, and

wherein the source movement angles between the penultimate time frame and the previous time frame is determined based on the frame delayed version of directions of the active dominant sound sources of the previous time frame and a further frame delayed version thereof.

6. An apparatus for determining directions of uncorrelated sound sources in a Higher Order Ambisonics (HOA) representation of a sound field, comprising:

a processor configured to search in a current time frame of HOA coefficients preliminary direction estimates of dominant sound sources, and to determine HOA sound field components based on corresponding dominant sound sources, the processor further configured to determine corresponding directional signals;

wherein the processor is further configured to assign the dominant sound sources to corresponding sound sources active in a previous time frame of the HOA coefficients based on a comparison of the preliminary direction estimates of the current time frame and smoothed directions of sound sources active in the previous time frame, wherein the assignment is further based on a correlation of the directional signals of the current time frame and directional signals of sound sources active in the previous time frame, resulting in an assignment function;

wherein the processor is further configured to determine smoothed dominant source directions based on the assignment function, the smoothed dominant source directions in the previous time frame, indices of active dominant sound sources in the previous time frame, respective source movement angles between the penultimate time frame and the previous time frame, and the HOA sound field components based on the corresponding dominant sound sources,

wherein the processor is further configured to determine indices and directions of active dominant sound sources of the current time frame based on the smoothed dominant source directions, a frame delayed version of directions of the active dominant sound sources of the previous time frame and a frame delayed version of indices of the active dominant sound sources of the previous time frame,

wherein the directional signals of sound sources active in the previous time frame are determined based on mode matching based on frame delayed version of directions of the active dominant sound sources of said previous time frame and the HOA coefficients of the previous time frame, and

wherein the source movement angles between the penultimate time frame and the previous time frame is determined based on the frame delayed version of directions of the active dominant sound sources of the previous time frame and a further frame delayed version thereof.

7. The method of claim 5 , wherein the determination of the detected dominant directional signals and the corresponding preliminary direction estimates, further includes:

determining an HOA sound field component based on a subtraction of the corresponding dominant sound sources from the current time frame of HOA coefficients in order to obtain a corresponding residual HOA representation, wherein the subtraction processing is repeatedly performed for each case of a remaining residual HOA representation for further sound field components, wherein the sound field components are excluded for further direction searches.

8. The method of claim 7 , further comprising determining a representation for a predefined number of discrete test directions which are nearly uniformly distributed on a unit sphere,

wherein directional power distribution is analyzed for presence of a dominant sound source, and based on a determination of an absence of a dominant sound source, the direction search is stopped and, based on a determination of a detection of a dominant source, a preliminary estimate of its direction with respect to a coordinate origin is determined.

9. The method of claim 8 , wherein the respective directional signal and the HOA representation of the sound field components based on the same sound source are determined based on:

rotating a fixed predefined spherical grid consisting of sampling positions, wherein the sampling positions are targeted to be uniformly distributed on the unit sphere, to determine a grid of rotated sampling positions, wherein said rotation is performed such that a first rotated sampling position corresponds to the preliminary direction estimate;

transforming the remaining residual HOA representation to a spatial domain and determining dominant sound source signals and grid direction signals;

performing a prediction of the grid direction signals from the dominant sound source signals; and

determining the HOA representation of the predicted grid directional signals, representing the contribution of the dominant sound source to the sound field represented by the remaining residual HOA representation, based on an inverse Spherical Harmonics Transform.

10. The method of claim 5 , wherein the smoothed dominant source directions is are determined based on:

determining directional a priori probability functions for dominant sound source directions based on the assignment function, the smoothed dominant source directions in the previous time frame, the indices of active dominant sound sources in the previous time frame, and the source movement angles;

determining directional likelihood functions for dominant sound source directions based on the assignment function and the HOA sound field components created by dominant sound sources;

determining directional a posteriori probability functions for dominant sound source directions based on directional likelihood functions and the directional a priori probability functions;

determining smoothed dominant sound source directions based on the directional a posteriori probability functions for dominant sound source directions.

Assignments (3)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 10, 2016
From: KRUEGER, ALEXANDER; KORDON, SVEN
To: THOMSON LICENSING
Reel/Frame 039980/0071 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO ADD ASSIGNOR NAMES PREVIOUSLY RECORDED ON REEL 038863 FRAME 0394. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 18, 2016
From: THOMSON LICENSING; THOMSON LICENSING S.A.; THOMSON LICENSING, SAS; THOMSON LICENSING SA; THOMSON LICENSING, S.A.S.
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 039726/0357 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2016
From: THOMSON LICENSING, SAS
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 038863/0394 →
Priority Claims (1)
EP 13305156 · Feb 8, 2013 · regional
Continuity (1)
Related Publication 20150373471A1 · Dec 24, 2015