IP Library Granted Patent US 9,959,876
Granted Patent B2
US 9,959,876 · App. 14/712,638 · Granted May 1, 2018

Closed loop quantization of higher order ambisonic coefficients

Inventors: Moo Young Kim (San Diego, CA); Nils Günther Peters (San Diego, CA); Dipanjan Sen (San Diego, CA)
Assignee: QUALCOMM Incorporated
G10L19/008G10L19/032G10L19/038H04S3/02H04S5/005G10L19/20H04S2400/01H04S2420/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,959,876
App. No.
14/712,638
Granted
May 1, 2018
Kind
B2
Abstract

In general, techniques are described for closed loop quantization of HOA coefficients that provide a three-dimensional representation of the sound field. An audio encoding device may perform closed loop quantization of an audio object based at least in part on a result of performing quantization of directional information associated with the audio object. An audio decoding device may obtain an audio object that has been closed loop quantized based at least in part on a result of performing quantization of directional information associated with the audio object, and may dequantize the audio object.

Claims (79)

1. A method for quantizing a foreground audio signal, comprising:

receiving, by at least one processor, audio data indicative of Higher Order Ambisonics (HOA) coefficients captured by a microphone;

decomposing, by the at least one processor, an audio object and directional information associated with the audio object from the HOA coefficients; and

performing, by the at least one processor, closed loop quantization of the audio object based at least in part on a result of performing quantization of the directional information associated with the audio object.

2. The method of claim 1 , wherein performing the closed loop quantization of the audio object further comprises:

performing quantization of the directional information associated with the audio object; and

performing quantization of a the audio object based at least in part on a result of performing quantization of the directional information associated with the audio object.

3. The method of claim 2 , wherein performing quantization of the audio object further comprises:

performing quantization of the audio object based at least in part on a quantization error resulting from performing quantization of the directional information associated with the audio object.

4. The method of claim 3 , wherein performing quantization of the audio object based at least in part on the quantization error resulting from performing quantization of the directional information associated with the audio object further comprises:

compensating for the quantization error resulting from performing quantization of the directional information associated with the audio object.

5. The method of claim 4 , wherein compensating for the quantization error resulting from performing quantization of the directional information associated with the audio object further comprises:

determining a quantization-compensated audio object based at least in part on a pseudoinverse of a result of performing quantization of the directional information associated with the audio object; and

performing quantization of the quantization-compensated audio object.

6. The method of claim 5 , wherein determining the quantization-compensated audio object based at least in part on the pseudoinverse of the result of performing quantization of the directional information associated with the audio object further comprises:

determining the quantization-compensated audio object as a product of the HOA coefficients and the pseudoinverse of the result of performing quantization of the directional information associated with the audio object.

7. The method of claim 1 , wherein:

the audio object comprises a product of a U matrix representative of left-singular vectors of a plurality of spherical harmonic coefficients and a S matrix representative of singular values of the plurality of spherical harmonic coefficients; and

the directional information associated with the audio object comprises a V matrix representative of right-singular vectors of the plurality of spherical harmonic coefficients.

8. The method of claim 1 , further comprising:

capturing, by the microphone, the audio data indicative of the HOA coefficients.

9. A device for quantizing a foreground audio signal, comprising:

at least one processor configured to:

receive audio data indicative of Higher Order Ambisonics (HOA) coefficients captured by a microphone;

decompose an audio object and directional information associated with the audio object from the HOA coefficients; and

perform closed loop quantization of the audio object based at least in part on a result of performing quantization of the directional information associated with the audio object; and

a memory configured to store the audio object and the directional information associated with the audio object.

10. The device of claim 9 , wherein the at least one processor is further configured to:

perform quantization of the directional information associated with the audio object; and

perform quantization of the audio object based at least in part on a result of performing quantization of the directional information associated with the audio object.

11. The device of claim 10 , wherein performing quantization of the audio object further comprises:

perform quantization of the audio object based at least in part on a quantization error resulting from performing quantization of the directional information associated with the audio object.

12. The device of claim 11 , wherein the at least one processor is further configured to:

compensate for the quantization error resulting from performing quantization of the directional information associated with the audio object.

13. The device of claim 12 , wherein the at least one processor is further configured to:

determine a quantization-compensated audio object based at least in part on a pseudoinverse of a result of performing quantization of the directional information associated with the audio object; and

perform quantization of the quantization-compensated audio object.

14. The device of claim 13 , wherein the at least one processor is further configured to:

determine the audio object as a product of the HOA coefficients and the pseudoinverse of the result of performing quantization of the directional information associated with the audio object.

15. The device of claim 9 , further comprising:

a microphone configured to capture the audio data indicative of HOA coefficients.

16. A method for dequantizing an audio object, comprising:

obtaining, by at least one processor, an audio object that has been closed loop quantized based at least in part on a result of performing quantization of directional information associated with the audio object; and

dequantizing, by the at least one processor, the audio object;

rendering, by the at least one processor using the dequantized audio object, loudspeaker feeds; and

outputting, by the at least one processor, the loudspeaker feeds to drive one or more speakers to playback the loudspeaker feeds.

17. The method of claim 16 , wherein the audio object is close looped quantized by quantizing the directional information associated with the audio object and quantizing the audio object based at least in part on a result of quantizing the directional information associated with the audio object.

18. The method of claim 16 , wherein the audio object is close looped quantized by quantizing the directional information associated with the audio object and quantizing

the audio object based at least in part on a quantization error resulting from quantizing the directional information associated with the audio object.

19. The method of claim 16 , wherein the audio object is close looped quantized by quantizing the directional information associated with the audio object and quantizing the audio object based at least in part on a quantization error resulting from quantizing of the directional information associated with the audio object, including compensating for the quantization error resulting from performing quantization of the directional information associated with the audio object.

20. The method of claim 16 wherein the audio object is close looped quantized by quantizing the directional information associated with the audio object, determining a quantization-compensated audio object based at least in part on a pseudoinverse of a result of quantizing the directional information associated with the audio object, and quantizing the quantization-compensated audio object.

21. The method of claim 20 , wherein the audio object is close looped quantized by determining the quantization-compensated audio object as a product of Higher Order Ambisonics (HOA) coefficients and the pseudoinverse of the result of performing quantization of the directional information associated with the audio object.

22. The method of claim 16 , wherein:

the audio object and the directional information are decomposed from higher order ambisonic coefficients;

the audio object comprises a product of a U matrix representative of left-singular vectors of a plurality of spherical harmonic coefficients and a S matrix representative of singular values of the plurality of spherical harmonic coefficients; and

the directional information associated with the audio object comprises a V matrix representative of right-singular vectors of the plurality of spherical harmonic coefficients.

23. The method of claim 16 , further comprising:

receiving a bitstream; and

decoding the bitstream to obtain the closed loop quantized audio object and the quantized directional information.

24. The method of claim 16 , further comprising:

playing back, by the one or more speakers, the loudspeaker feeds rendered from the dequantized audio object.

25. A device for dequantizing a foreground audio signal, comprising:

a memory configured to store an audio object;

at least one processor configured to:

obtain the audio object that has been closed loop quantized based at least in part on a result of performing quantization of directional information associated with the audio object;

dequantize the audio object;

render, using the dequantized audio object, loudspeaker feeds; and

output the loudspeaker feeds to drive one or more speakers to playback the loudspeaker feeds; and

the one or more speakers configured to playback the loudspeaker feeds rendered from the dequantized audio object.

26. The device of claim 25 , wherein the audio object is close looped quantized by quantizing the directional information associated with the audio object and quantizing the audio object based at least in part on a result of quantizing the directional information associated with the audio object.

27. The device of claim 25 , wherein the audio object is close looped quantized by quantizing the directional information associated with the audio object and quantizing the audio object based at least in part on a quantization error resulting from quantizing the directional information associated with the audio object.

28. The device of claim 25 , wherein the audio object is close looped quantized by quantizing the directional information associated with the audio object and quantizing the audio object based at least in part on a quantization error resulting from quantizing of the directional information associated with the audio object, including compensating for the quantization error resulting from performing quantization of the directional information associated with the audio object.

29. The device of claim 25 wherein the audio object is close looped quantized by quantizing the directional information associated with the audio object, determining a quantization-compensated audio object based at least in part on a pseudoinverse of a result of quantizing the directional information associated with the audio object, and quantizing the quantization-compensated audio object.

30. The device of claim 29 , wherein the audio object is close looped quantized by determining the quantization-compensated audio object as a product of Higher Order Ambisonics (HOA) coefficients and the pseudoinverse of the result of performing quantization of the directional information associated with the audio object.

31. The device of claim 25 , wherein the at least one processor is further configured to:

receiving a bitstream; and

decoding the bitstream to obtain the closed loop quantized audio object and the quantized directional information.

32. The device of claim 25 , further comprising:

the one or more speakers configured to playback the loudspeaker feeds rendered from the dequantized audio object.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 17, 2015
From: KIM, MOO YOUNG; PETERS, NILS GÜNTHER; SEN, DIPANJAN
To: QUALCOMM INCORPORATED
Reel/Frame 035852/0776 →
Continuity (4)
Provisional Application 61994493 · May 16, 2014
Provisional Application 61994788 · May 16, 2014
Provisional Application 62004082 · May 28, 2014
Related Publication 20150332681A1 · Nov 19, 2015