IP Library Granted Patent US 9,384,741
Granted Patent B2
US 9,384,741 · App. 14/289,602 · Granted Jul 5, 2016

Binauralization of rotated higher order ambisonics

Inventors: Martin James Morrell (San Diego, CA); Dipanjan Sen (San Diego, CA); Nils Günther Peters (San Diego, CA)
Assignee: QUALCOMM Incorporated
G10L19/008H04S7/30H04S7/304H04S2400/01H04S2420/01H04S2420/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,384,741
App. No.
14/289,602
Granted
Jul 5, 2016
Kind
B2
Abstract

A device comprising one or more processors is configured to obtain transformation information, the transformation information describing how a sound field was transformed to reduce a number of a plurality of hierarchical elements to a reduced plurality of hierarchical elements; and perform binaural audio rendering with respect to the reduced plurality of hierarchical elements based on the transformation information.

Claims (77)

1. A method of binaural audio rendering comprising:

obtaining a bitstream that includes encoded audio data and transformation information;

decoding the encoded audio data to obtain a reduced plurality of hierarchical elements, the transformation information describing how a sound field represented by a plurality of hierarchical elements was transformed in order to generate the reduced plurality of hierarchical elements, the reduced plurality of hierarchical elements having a number of hierarchical elements that is less than a number of the plurality of hierarchical elements; and

performing the binaural audio rendering with respect to the reduced plurality of hierarchical elements based on the transformation information.

2. The method of claim 1 , wherein performing the binaural audio rendering comprises transforming a frame of reference by which to render the reduced plurality of hierarchical elements to a plurality of channels based on the transformation information.

3. The method of claim 1 , the transformation information comprising rotation information that specifies at least an elevation angle and an azimuth angle by which the sound field was transformed.

4. The method of claim 1 , wherein performing the binaural audio rendering comprises:

transforming a frame of reference by which a rendering function is to render the reduced plurality of hierarchical elements based on the transformation information; and

applying an energy preservation function with respect to the transformed rendering function.

5. The method of claim 1 , wherein performing the binaural audio rendering comprises:

transforming a rendering function by transforming a frame of reference by which the rendering function is to render the reduced plurality of hierarchical elements based on the transformation information; and

combining the transformed rendering function with a complex binaural room impulse response function using multiplication operations.

6. The method of claim 1 , wherein performing the binaural audio rendering comprises:

transforming a rendering function by transforming a frame of reference by which the rendering function is to render the reduced plurality of hierarchical elements based on the transformation information; and

combining the transformed rendering function with a complex binaural room impulse response function using multiplication operations and without requiring convolution operations.

7. The method of claim 1 , wherein performing the binaural audio rendering comprises:

transforming a rendering function by transforming a frame of reference by which a rendering function is to render the reduced plurality of hierarchical elements based on the transformation information;

combining the transformed rendering function with a complex binaural room impulse response function to generate a rotated binaural audio rendering function; and

applying the rotated binaural audio rendering function to the reduced plurality of hierarchical elements to generate left and right channels.

8. The method of claim 1 , the plurality of hierarchical elements comprising a plurality of spherical harmonic coefficients of which at least one of the plurality of spherical harmonic coefficients are associated with an order greater than one.

9. The method of claim 1 , further comprising:

parsing the encoded audio data from the bitstream to obtain parsed encoded audio data;

decoding the parsed encoded audio data to obtain the reduced plurality of hierarchical elements; and

parsing the transformation information from the bitstream.

10. The method of claim 1 , further comprising:

obtaining a position of a head of a listener relative to the sound field represented by the plurality of hierarchical elements; and

determining updated transformation information based on the transformation information and the position of the head of the listener,

wherein performing the binaural audio rendering comprises performing the binaural audio rendering with respect to the reduced plurality of hierarchical elements based on the updated transformation information.

11. A device comprising one or more processors, the one or more processors configured to:

obtain a bitstream that includes encoded audio data and transformation information,

decode the encoded audio data to obtain a reduced plurality of hierarchical elements, the transformation information describing how a sound field represented by a plurality of hierarchical elements was transformed in order to generate the reduced plurality of hierarchical elements, the reduced plurality of hierarchical elements having a number of hierarchical elements that is less than a number of the plurality of hierarchical elements; and

perform binaural audio rendering with respect to the reduced plurality of hierarchical elements based on the transformation information.

12. The device of claim 11 , wherein to perform the binaural audio rendering, the one or more processors are further configured to transform a frame of reference by which to render the reduced plurality of hierarchical elements to a plurality of channels based on the transformation information.

13. The device of claim 11 , the transformation information comprising rotation information that specifies at least an elevation angle and an azimuth angle by which the sound field was transformed.

14. The device of claim 11 ,

wherein to perform the binaural audio rendering, the one or more processors are further configured to transform a frame of reference by which a rendering function is to render the reduced plurality of hierarchical elements based on the transformation information, and apply an energy preservation function with respect to the transformed rendering function.

15. The device of claim 11 , wherein to perform the binaural audio rendering, the one or more processors are further configured to transform a rendering function by transforming a frame of reference by which the rendering function is to render the reduced plurality of hierarchical elements based on the transformation information, and combine the transformed rendering function with a complex binaural room impulse response function using multiplication operations.

16. The device of claim 11 , wherein to perform the binaural audio rendering, the one or more processors are further configured to transform a rendering function by transforming a frame of reference by which the rendering function is to render the reduced plurality of hierarchical elements based on the transformation information, and combine the transformed rendering function with a complex binaural room impulse response function using multiplication operations and without requiring convolution operations.

17. The device of claim 11 , wherein to perform the binaural audio rendering, the one or more processors are further configured to transform a rendering function by transforming a frame of reference by which the rendering function is to render the reduced plurality of hierarchical elements based on the transformation information, combine the transformed rendering function with a complex binaural room impulse response function to generate a rotated binaural audio rendering function, and apply the rotated binaural audio rendering function to the reduced plurality of hierarchical elements to generate left and right channels.

18. The device of claim 11 , the plurality of hierarchical elements comprising a plurality of spherical harmonic coefficients of which at least one of the plurality of spherical harmonic coefficients is associated with an order greater than one.

19. The device of claim 11 , the one or more processors further configured to:

parse the encoded audio data from the bitstream;

decode the parsed encoded audio data to generate the reduced plurality of hierarchical elements; and

parse the transformation information from the bitstream.

20. The device of claim 11 , the one or more processors further configured to:

obtain a position of a head of a listener relative to the sound field represented by the plurality of hierarchical; and

determine updated transformation information based on the transformation information and the position of the head of the listener,

wherein to perform the binaural audio rendering the one or more processors are further configured to perform the binaural audio rendering with respect to the reduced plurality of hierarchical elements based on the updated transformation information.

21. An apparatus comprising:

means for obtaining a bitstream that includes encoded audio data and transformation information;

means for decoding the encoded audio data to obtain a reduced plurality of hierarchical elements, the transformation information describing how a sound field represented by a plurality of hierarchical elements was transformed in order to generate the reduced plurality of hierarchical elements, the reduced plurality of hierarchical elements having a number of hierarchical elements that is less than a number of the plurality of hierarchical elements; and

means for performing the binaural audio rendering with respect to the reduced plurality of hierarchical elements based on the transformation information.

22. The apparatus of claim 21 , wherein the means for performing the binaural audio rendering comprises means for transforming a frame of reference by which to render the reduced plurality of hierarchical elements to a plurality of channels based on the transformation information.

23. The apparatus of claim 21 , the transformation information comprising rotation information that specifies at least an elevation angle and an azimuth angle by which the sound field was transformed.

24. The apparatus of claim 21 , wherein the means for performing the binaural audio rendering comprises:

means for transforming a frame of reference by which a rendering function is to render the reduced plurality of hierarchical elements based on the transformation information; and

means for applying an energy preservation function with respect to the transformed rendering function.

25. The apparatus of claim 21 , wherein the means for performing the binaural audio rendering comprises:

means for transforming a rendering function by transforming a frame of reference by which the rendering function is to render the reduced plurality of hierarchical elements based on the transformation information; and

means for combining the transformed rendering function with a complex binaural room impulse response function using multiplication operations and without requiring convolution operations.

26. The apparatus of claim 21 , wherein the means for performing the binaural audio rendering comprises:

means for transforming a rendering function by transforming a frame of reference by which the rendering function is to render the reduced plurality of hierarchical elements based on the transformation information;

means for combining the transformed rendering function with a complex binaural room impulse response function to generate a rotated binaural audio rendering function; and

means for applying the rotated binaural audio rendering function to the reduced plurality of hierarchical elements to generate left and right channels.

27. The apparatus of claim 21 , the plurality of hierarchical elements comprising a plurality of spherical harmonic coefficients of which at least one of the plurality of spherical harmonic coefficients is associated with an order greater than one.

28. The apparatus of claim 21 , further comprising:

means for parsing the encoded audio data from the bitstream to obtain parsed encoded audio data;

means for decoding the parsed encoded audio data to obtain the reduced plurality of hierarchical elements

means for parsing the transformation information from the bitstream.

29. The apparatus of claim 21 , further comprising:

means for obtaining a position of a head of a listener relative to the sound field represented by the plurality of hierarchical elements; and

means for determining updated transformation information based on the transformation information and the position of the head of the listener,

wherein the means for performing the binaural audio rendering comprises means for performing the binaural audio rendering with respect to the reduced plurality of hierarchical elements based on the updated transformation information.

30. A non-transitory computer-readable storage medium comprising instructions stored thereon that, when executed, configure one or more processors to:

obtain a bitstream that includes encoded audio data and transformation information;

decode the encoded audio data to obtain a reduced plurality of hierarchical elements, the transformation information describing how a sound field represented by a plurality of hierarchical elements was transformed in order to generate the reduced plurality of hierarchical elements, the reduced plurality of hierarchical elements having a number of hierarchical elements that is less than a number of the plurality of hierarchical elements; and

perform the binaural audio rendering with respect to the reduced plurality of hierarchical elements based on the transformation information.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 2, 2014
From: MORRELL, MARTIN JAMES; SEN, DIPANJAN; PETERS, NILS GÜNTHER
To: QUALCOMM INCORPORATED
Reel/Frame 033653/0013 →
Continuity (2)
Provisional Application 61828313 · May 29, 2013
Related Publication 20140355766A1 · Dec 4, 2014