IP Library Granted Patent US 9,460,728
Granted Patent B2
US 9,460,728 · App. 14/415,571 · Granted Oct 4, 2016

Method and apparatus for encoding multi-channel HOA audio signals for noise reduction, and method and apparatus for decoding multi-channel HOA audio signals for noise reduction

Inventors: Johannes Boehm (Goettingen, DE); Sven Kordon (Wunstorf, DE); Alexander Krueger (Hannover, DE); Peter Jax (Hannover, DE)
Assignee: Dolby Laboratories Licensing Corporation
G10L19/012G10L19/008H04S3/02
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,460,728
App. No.
14/415,571
Granted
Oct 4, 2016
Kind
B2
Abstract

A method for encoding multi-channel HOA audio signals for noise reduction comprises steps of decorrelating the channels using an inverse adaptive DSHT, the inverse adaptive DSHT comprising a rotation operation and an inverse DSHT, with the rotation operation rotating the spatial sampling grid of the iDSHT, perceptually encoding each of the decorrelated channels, encoding rotation information, the rotation information comprising parameters defining said rotation operation, and transmitting or storing the perceptually encoded audio channels and the encoded rotation information.

Claims (174)

1. A method for encoding multi-channel Higher Order Ambisonics (HOA) audio signals for noise reduction, comprising steps of

decorrelating the channels using an inverse adaptive Discrete Spherical Harmonics Transform (DSHT), the inverse adaptive DSHT comprising a rotation operation and an inverse DSHT, with the rotation operation rotating the spatial sampling grid of the iDSHT, wherein the spherical sample grid is rotated such that the logarithm of the term

l

=

1

L

Sd

j

=

1

L

Sd

W

Sd

l

,

j

-

(

σ

S

d

1

2

,

,

σ

S

d

L

Sd

2

)

is minimized, wherein

W

Sd

l

,

j

are the absolute values of the elements of Σ W Sd with a row index l and a column index j, and

σ

S

d

l

2

are the diagonal elements of Σ W Sd , where Σ W Sd =W Sd W Sd H and W Sd is a matrix having a size of number of audio channels by number of block processing samples, and W Sd the result of the inverse adaptive DSHT;

perceptually encoding each of the decorrelated channels;

encoding rotation information, wherein the rotation information is a spatial vector {circumflex over (ψ)} rot with three components defining said rotation operation; and

transmitting or storing the perceptually encoded audio channels and the encoded rotation information.

2. The method according to claim 1 , wherein the inverse adaptive DSHT performs steps of

selecting an initial default spherical sample grid;

determining a strongest source direction; and

rotating, for a block of M time samples, the spherical sample grid such that a single spatial sample position matches the strongest source direction.

3. The method according to claim 1 , further comprising steps of

constructing overlapping data blocks in a Time to Frequency Transform (TFT) framing unit,

performing a Time-to-Frequency Transform on the coefficients of each channel,

combining in a Spectral Banding unit the time-to-frequency transformed frequency bands to form J new spectral bands,

processing a plurality of the spectral bands simultaneously in a plurality of processing blocks, wherein each processing block performs an inverse adaptive DSHT, the inverse adaptive DSHT comprising a rotation operation and an inverse DSHT, wherein the rotation operation rotates the spatial sampling grid of the iDSHT, and

performing a channel independent lossy audio compression without Time to Frequency Transform.

4. A method for decoding coded multi-channel Higher Order Ambisonics (HOA) audio signals with reduced noise, comprising steps of

receiving encoded multi-channel HOA audio signals and channel rotation information, the channel rotation information comprising a spatial vector {circumflex over (ψ)} rot with three components defining a rotation operation;

decompressing the received data, wherein perceptual decoding is used and perceptually decoded channels are obtained;

spatially decoding each perceptually decoded channel using an adaptive Discrete Spherical Harmonics Transform (DSHT), wherein a Discrete Spherical Harmonics Transform (DSHT) and a rotation of a spatial sampling grid of the DSHT according to said rotation information are performed; and

matrixing the perceptually and spatially decoded channels, wherein reproducible audio signals mapped to loudspeaker positions are obtained.

5. The method according to claim 4 , wherein the adaptive DSHT comprises steps of

selecting an initial default spherical sample grid for the adaptive DSHT;

rotating, for a block of m time samples, the default spherical sample grid according to said rotation information; and

performing the DSHT on the rotated spherical sample grid.

6. The method according to claim 4 , wherein the step of spatially decoding each channel using an adaptive DSHT is done for all channels simultaneously in a plurality of spatial decoding units, further comprising steps of spectral debanding and performing an inverse Time to Frequency Transform with Overlay Add processing.

7. The method according to claim 4 , wherein the channel rotation information is composed of three angles: θ axis ,φ axis ,φ rot , where θ axis ,φ axis define the information for the rotation axis with an implicit radius of one in spherical coordinates and φ rot defines the rotation angle around the rotation axis.

8. The method according to claim 4 , wherein the three components of the spatial vectors {circumflex over (ψ)} rot are quantized and entropy coded with an escape pattern that signals the reuse of previously used values for creating side information.

9. An apparatus for encoding multi-channel Higher Order Ambisonics (HOA) audio signals for noise reduction, comprising

a decorrelator for decorrelating the channels using an inverse adaptive Discrete Spherical Harmonics Transform (DSHT), the inverse adaptive DSHT comprising a rotation operation unit and an inverse DSHT (iDSHT), the rotation operation rotating the spatial sampling grid of the iDSHT, wherein the spherical sample grid is rotated such that the logarithm of the term

l

=

1

L

S

d

j

=

1

L

S

d

E

W

S

d

l

,

j

-

(

σ

S

d

1

2

,

,

σ

S

d

L

S

d

2

)

is minimized, wherein

W

S

d

l

,

j

are the absolute values of the elements of τ W Sd with a row index l and a column index j, and

σ

S

d

l

2

are the diagonal elements of Σ W Sd , where Σ W Sd =W Sd W Sd H and W Sd is matrix having a size of number of audio channels by number of block processing samples, and W Sd is the result of the inverse adaptive DSHT;

perceptual encoder for perceptually encoding each of the decorrelated channels;

side information encoder for encoding rotation information, the rotation information comprising a spatial vector {circumflex over (ψ)} rot with three components defining said rotation operation, and

interface for transmitting or storing the perceptually encoded audio channels and the encoded rotation information.

10. An apparatus for decoding multi-channel Higher Order Ambisonics (HOA) audio signals with reduced noise, comprising

interface means for receiving encoded multi-channel HOA audio signals and channel rotation information, the channel rotation information comprising a spatial vector {circumflex over (ψ)} rot with three components defining a rotation operation;

decompression module for decompressing the received data with a perceptual decoder for perceptually decoding each channel;

correlator for correlating the perceptually decoded channels using an adaptive Discrete Spherical Harmonics Transform (aDSHT), wherein a Discrete Spherical Harmonics Transform (DSHT) and a rotation of a spatial sampling grid of the DSHT according to said rotation information is performed; and

mixer for matrixing the correlated perceptually decoded channels, wherein reproducible audio signals mapped to loudspeaker positions are obtained.

11. The apparatus according to claim 10 , wherein the adaptive DSHT comprises

means for selecting an initial default spherical sample grid for the adaptive DSHT;

rotation processing means for rotating, for a block of M time samples, the default spherical sample grid according to said rotation information; and

transform processing means for performing the DSHT on the rotated spherical sample grid.

12. The apparatus according to claim 10 , wherein the correlator comprises a plurality of spatial decoding units for simultaneously spatially decoding each channel using an adaptive DSHT, further comprising a spectral debanding unit for performing spectral debanding, and an iTFT&OLA unit for performing an inverse Time to Frequency Transform with Overlay Add processing, wherein the spectral debanding unit provides its output to the iTFT&OLA unit.

13. The apparatus according to claim 10 , wherein the three components of the spatial vector {circumflex over (ψ)} rot are quantized and entropy coded with an escape pattern that signals the reuse of previously used values for creating side information.

14. The method according to claim 1 , wherein the three components of the spatial vector {circumflex over (ψ)} rot are angles θ axis ,φ axis ,φ rot , where θ axis ,φ axis define the information for the rotation axis with an implicit radius of one in spherical coordinates and φ rot defines the rotation angle around the rotation axis, and wherein the angles are quantized and entropy coded with an escape pattern that signals the reuse of previously used values for creating side information.

15. The apparatus according to claim 8 , wherein the three components of the spatial vector {circumflex over (ψ)} rot are angles θ axis ,φ axis ,φ rot , where θ axis ,φ axis define the information for the rotation axis with an implicit radius of one in spherical coordinates and φ rot defines the rotation angle around the rotation axis, and wherein the angles are quantized and entropy coded with an escape pattern that signals the reuse of previously used values for creating side information.

Assignments (4)
CORRECTIVE ASSIGNMENT TO CORRECT THE RECEIVING PARTY NAME PREVIOUSLY RECORDED AT REEL: 034920 FRAME: 0501. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 30, 2016
From: BOEHM, JOHANNES; KORDON, SVEN; KRUEGER, ALEXANDER; JAX, PETER
To: THOMSON LICENSING
Reel/Frame 039874/0425 →
CORRECTIVE ASSIGNMENT TO CORRECT THE TO ADD ASSIGNOR NAMES PREVIOUSLY RECORDED ON REEL 038863 FRAME 0394. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Aug 18, 2016
From: THOMSON LICENSING; THOMSON LICENSING S.A.; THOMSON LICENSING, SAS; THOMSON LICENSING SA; THOMSON LICENSING, S.A.S.
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 039726/0357 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 9, 2016
From: THOMSON LICENSING, SAS
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 038863/0394 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 9, 2015
From: BOEHM, JOHANNES; KORDON, SVEN; KRUEGER, ALEXANDER; JAX, PETER
To: THOMSON LICENSING SAS
Reel/Frame 034920/0501 →
Priority Claims (1)
EP 12305861 · Jul 16, 2012 · regional
Continuity (1)
Related Publication 20150154971A1 · Jun 4, 2015