Granted Patent B2

US 12,308,034 · App. 16/907,771 · Granted May 20, 2025

Inventors: Ferdinando Olivieri (San Diego, CA); Taher Shahbazi Mirzahasanloo (San Diego, CA); Nils Günther Peters (San Diego, CA)

Assignee: QUALCOMM Incorporated

G10L19/008G10L19/032G10L25/48H04L65/75H04L65/752

Abstract

Claims (63)

1. A device configured to decode encoded scene-based audio data, the device comprising:

a memory configured to store the encoded scene-based audio data; and

one or more processors configured to:

monitor one or more internal components of the device to obtain an operating condition of the device for decoding the encoded scene-based audio data;

perform, based on the operating condition, psychoacoustic audio decoding with respect to the encoded scene-based audio data to obtain ambisonic transport format audio data; and

perform spatial audio decoding with respect to the ambisonic transport format audio data to obtain scene-based audio data.

2. The device of claim 1 , wherein the one or more processors perform a single instance of the psychoacoustic audio decoding with respect to the encoded scene-based audio data to obtain the ambisonic transport format audio data.

3. The device of claim 1 , wherein the one or more processors are configured to perform, based on the operating conditions, psychoacoustic audio decoding according to a compression algorithm with respect to the encoded scene-based audio data to obtain the ambisonic transport format audio data.

4. The device of claim 1 ,

wherein the one or more processors are further configured to obtain a latency requirement for decoding the encoded scene-based audio data; and

wherein the one or more processors are configured to perform, based on the operating condition and the latency requirement, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to obtain the ambisonic transport format audio data.

5. The device of claim 1 ,

wherein the one or more processors are further configured to establish a communication link over which the encoded scene-based audio data is received, and

wherein the one or more processors are configured to monitor an internal communication component that established the communication link to obtain a status of the communication link as the operating condition.

6. The device of claim 1 , wherein the one or more processors are configured to perform, when the operating condition is below a threshold, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode a subset of bits representative of the ambisonic transport format audio data, the subset of bits less than a total number of bits used to represent the ambisonic transport format audio data.

7. The device of claim 6 , wherein the one or more processors are configured to:

determine a number of course bits used during quantization of an energy of the ambisonic transport format audio data; and

perform the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode the number of course bits representative of the ambisonic transport format audio data.

8. The device of claim 1 , wherein the one or more processors are configured to perform, when the operating condition is greater than or equal to a threshold, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode a subset of bits representative of the ambisonic transport format audio data and additional bits representative of the ambisonic transport format audio data, the subset of bits less than a total number of bits used to represent the ambisonic transport format audio data.

9. The device of claim 8 , wherein the one or more processors are configured to perform the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode the ambisonic transport format audio data corresponding to all of the orders up to a defined order either when reconstructing the subset of bits or both the subset of bits and the additional bits.

10. The device of claim 1 , wherein the one or more processors are configured to:

determine a number of course bits used during quantization of an energy of the ambisonic transport format audio data;

determine a number of fine bits used during quantization of the energy of the ambisonic transport format audio data; and

perform, when the operating condition is greater than or equal to a threshold, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode the number of course bits and the number of fine bits representative of the ambisonic transport format audio data.

11. The device of claim 1 , wherein the one or more processors are configured to perform, when the operating condition is below a threshold, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode the ambisonic transport format audio data corresponding to spherical basis functions having a subset of orders, the subset of orders being less than all of the orders of the spherical basis functions to which the scene-based audio data corresponds.

12. The device of claim 1 , wherein the one or more processors are configured to perform, when the operating condition is above a threshold, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to reconstruct the ambisonic transport format audio data corresponding to spherical basis functions having a subset of orders and at least one additional order, the subset of orders being less than all of the orders of the spherical basis functions to which the scene-based audio data corresponds.

13. The device of claim 12 , wherein the one or more processors are configured to perform the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode all of the bits representative of the ambisonic transport format audio data corresponding to the spherical basis functions having either the subset of orders or both the subset of orders and the at least one additional order.

14. The device of claim 1 , wherein the one or more processors are further configured to:

render the scene-based audio data to one or more speaker feeds; and

output the speaker feeds to one or more speakers to reproduce, based on the speaker feeds, a soundfield represented by the scene-based audio data.

15. The device of claim 1 ,

wherein the one or more processors are further configured to render the scene-based audio data to one or more speaker feeds, and

wherein the device comprises one or more speakers configured to reproduce, based on the speaker feeds, a soundfield represented by the scene-based audio data.

16. The device of claim 1 , wherein the one or more processors are configured to monitor an internal battery of the device to obtain a battery power as the operating condition.

17. A method of decoding encoded scene-based audio data, the method comprising:

monitoring one or more internal components of a device configured to decode the scene-based audio data to obtain an operating condition of the device;

performing, based on the operating condition, psychoacoustic audio decoding with respect to the encoded scene-based audio data to obtain ambisonic transport format audio data; and

performing spatial audio decoding with respect to the ambisonic transport format audio data to obtain scene-based audio data.

18. The method of claim 17 , wherein performing the psychoacoustic audio decoding comprises performing a single instance of the psychoacoustic audio decoding with respect to the encoded scene-based audio data to obtain the ambisonic transport format audio data.

19. The method of claim 17 , wherein performing the psychoacoustic audio decoding comprises performing, based on the operating conditions, the psychoacoustic audio decoding according to a compression algorithm with respect to the encoded scene-based audio data to obtain the ambisonic transport format audio data.

20. The method of claim 17 , further comprising obtaining a latency requirement for decoding the encoded scene-based audio data, and

wherein performing the psychoacoustic audio decoding comprises performing, based on the operating condition and the latency requirement, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to obtain the ambisonic transport format audio data.

21. The method of claim 17 , further comprising establishing a communication link over which the encoded scene-based audio data is received, and

wherein monitoring the one or more internal components includes monitoring a communication unit that established the communication link to obtain a status of the communication link as the operating condition.

22. The method of claim 17 , wherein performing the psychoacoustic audio decoding comprises performing, when the operating condition is below a threshold, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode a subset of bits representative of the ambisonic transport format audio data, the subset of bits less than a total number of bits used to represent the ambisonic transport format audio data.

23. The method of claim 22 , wherein obtaining the psychoacoustic audio decoding comprises:

determining a number of course bits used during quantization of an energy of the ambisonic transport format audio data; and

performing the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode the number of course bits representative of the ambisonic transport format audio data.

24. The method of claim 17 , wherein performing the psychoacoustic audio decoding comprises performing, when the operating condition is greater than or equal to a threshold, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode a subset of bits representative of the ambisonic transport format audio data and additional bits representative of the ambisonic transport format audio data, the subset of bits less than a total number of bits used to represent the ambisonic transport format audio data.

25. The method of claim 17 , where performing the psychoacoustic audio decoding comprises:

determining a number of course bits used during quantization of an energy of the ambisonic transport format audio data;

determining a number of fine bits used during quantization of the energy of the ambisonic transport format audio data; and

performing, based on the operating condition is greater than or equal to a threshold, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode the number of course bits and the number of fine bits representative of the ambisonic transport format audio data.

26. The method of claim 22 , wherein performing the psychoacoustic audio decoding comprises performing the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode the ambisonic transport format audio data corresponding to all of the orders up to a defined order either when reconstructing the subset of bits or both the subset of bits and additional bits.

27. The method of claim 17 , wherein performing the psychoacoustic audio decoding comprises performing, when the operating condition is below a threshold, the psychoacoustic audio decoding with respect to the encoded scene-based audio data to decode the ambisonic transport format audio data corresponding to spherical basis functions having a subset of orders, the subset of orders being less than all of the orders of the spherical basis functions to which the scene-based audio data corresponds.

28. A device configured to decode encoded scene-based audio data, the device comprising:

means for monitoring one or more internal components of the device to obtain an operating condition of the device;

means for performing, based on the operating condition, psychoacoustic audio decoding with respect to the encoded scene-based audio data to obtain ambisonic transport format audio data; and

means for performing spatial audio decoding with respect to the ambisonic transport format audio data to obtain scene-based audio data.

29. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors of a device configured to decode encoded scene-based audio data to:

monitor one or more internal components of the device to obtain an operating condition of the device;

perform, based on the operating condition, psychoacoustic audio decoding with respect to the encoded scene-based audio data to obtain ambisonic transport format audio data; and

perform spatial audio decoding with respect to the ambisonic transport format audio data to obtain scene-based audio data.

Assignments (1)

Continuity (2)

References Cited (90)