IP Library Granted Patent US 10,770,087
Granted Patent B2
US 10,770,087 · App. 14/712,849 · Granted Sep 8, 2020

Selecting codebooks for coding vectors decomposed from higher-order ambisonic audio signals

Inventors: Moo Young Kim (San Diego, CA); Nils Günther Peters (San Diego, CA); Dipanjan Sen (San Diego, CA)
Assignee: Qualcomm Incorporated
G10L19/038G10L19/008G10L2019/0013
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,770,087
App. No.
14/712,849
Granted
Sep 8, 2020
Kind
B2
Abstract

In general, techniques are described for performing codebook selection when coding vectors decomposed from higher-order ambisonic coefficients. A device comprising a memory and a processor may perform the techniques. The memory may be configured to store a plurality of codebooks to use when performing vector dequantization with respect to a vector quantized spatial component of a soundfield. The vector quantized spatial component may be obtained through application of a decomposition to a plurality of higher order ambisonic coefficients. The processor may be configured to select one of the plurality of codebooks.

Claims (40)

1. A device comprising:

a memory configured to store a plurality of codebooks to use when performing vector dequantization with respect to a vector quantized spatial component of a soundfield, the vector quantized spatial component defined in a spherical harmonic domain, and obtained through application of a decomposition to a plurality of higher order ambisonic coefficients representative of the soundfield; and

one or more processors coupled to the memory, and configured to:

select one of the plurality of codebooks;

perform vector dequantization with respect to the vector quantized spatial component using the selected one of the plurality of codebooks to obtain a vector dequantized spatial component of the soundfield; and

render, based on the vector dequantized spatial component, speaker feeds.

2. The device of claim 1 , wherein the one or more processors are further configured to determine a syntax element from a bitstream that includes the vector quantized spatial component, the syntax element identifying the selected one of the plurality of codebooks, and perform the vector dequantization with respect to the vector quantized spatial component based on the selected one of the plurality of codebooks identified by the syntax element.

3. The device of claim 1 , wherein the one or more processors are further configured to determine a syntax element from a bitstream that includes the vector quantized spatial component, the syntax element identifying an index into the selected one of the plurality of codebooks having a weight value used when performing the vector dequantization.

4. The device of claim 1 ,

wherein the one or more processors are further configured to determine a first syntax element and a second syntax element from a bitstream that includes the vector quantized spatial component, wherein the first syntax element identifies the selected one of the plurality of codebooks, and the second syntax element identifies an index into the selected one of the plurality of codebooks having a weight value used when performing the vector dequantization, and

wherein the one or more processors are configured to perform the vector dequantization with respect to the vector quantized spatial component based on the weight value identified by the first syntax element from the selected one of the plurality of codebooks identified by the second syntax element.

5. The device of claim 1 , wherein the one or more processors are further configured to determine a syntax element from a bitstream that includes the vector quantized spatial component, the syntax element identifying an index into a vector dictionary having a code vector used when performing the vector dequantization.

6. The device of claim 1 ,

wherein the one or more processors are further configured to determine a first syntax element, a second syntax element, and a third syntax element from a bitstream that includes the vector quantized spatial component, wherein the first syntax element identifies the selected one of the plurality of codebooks, the second syntax element identifies an index into the selected one of the plurality of codebooks having a weight value used when performing the vector dequantization, and the third syntax element identifies an index into a vector dictionary having a code vector used when performing the vector dequantization, and

wherein the one or more processors are configured to perform the vector dequantization with respect to the vector quantized spatial component based on the weight value identified by the first syntax element from the selected one of the plurality of codebooks identified by the second syntax element and the code vector identified by the third syntax element.

7. The device of claim 1 , wherein the one or more processors are configured to select the one of the plurality of codebooks based on a number of code vectors used when performing the vector dequantization.

8. The device of claim 1 , wherein the one or more processors are configured to select the one of the plurality of codebooks having eight weight values when only one code vector is used when performing the vector dequantization.

9. The device of claim 1 , wherein the one or more processors are configured to select the one of the plurality of codebooks having 254 weight values when two to eight code vectors are used when performing the vector dequantization.

10. The device of claim 1 , wherein the plurality of codebooks comprises a codebook having 254 rows with 7 weight values in each row and a codebook having 898 rows with a single weight value in each row.

11. A device comprising:

means for storing a plurality of codebooks to use when performing vector dequantization with respect to a vector quantized spatial component of a soundfield, the vector quantized spatial component defined in a spherical harmonic domain, and obtained through application of a decomposition to a plurality of higher order ambisonic coefficients;

means for selecting one of the plurality of codebooks

means for performing vector dequantization with respect to the vector quantized spatial component using the selected one of the plurality of codebooks to obtain a vector dequantized spatial component of the soundfield;

means for rendering, based on the vector dequantized spatial component, speaker feeds.

12. The device of claim 11 , further comprising means for determining a syntax element from a bitstream that includes the vector quantized spatial component, the syntax element identifying the selected one of the plurality of codebooks.

13. The device of claim 11 , further comprising means for determining a syntax element from a bitstream that includes the vector quantized spatial component, the syntax element identifying the selected one of the plurality of codebooks, and

wherein the means for performing the vector dequantization comprises means for performing the vector dequantization with respect to the vector quantized spatial component based on the selected one of the plurality of codebooks identified by the syntax element.

14. The device of claim 11 , further comprising means for determining a syntax element from a bitstream that includes the vector quantized spatial component, the identifying an index into the selected one of the plurality of codebooks having a weight value used when performing the vector dequantization.

15. A device comprising:

a memory configured to store a plurality of codebooks to use when performing vector quantization with respect to a spatial component of a soundfield, the spatial component defined in a spherical harmonic domain, and obtained through application of a decomposition to the plurality of higher order ambisonic coefficients; and

one or more processors coupled to the memory, and configured to:

select one of the plurality of codebooks;

perform vector quantization with respect to the spatial component using the selected one of the plurality of codebooks to obtain a vector quantized spatial component of the soundfield; and

generate a bitstream to include the vector quantized spatial component.

16. The device of claim 15 , wherein selecting one of a plurality of codebooks comprises selecting the one of the plurality of codebooks having eight weight values when only one code vector is used when performing the vector quantization.

17. The device of claim 1 ,

further comprising one or more speakers coupled to the one or more processors, and configured to reproduce the soundfield based on the speaker feeds.

18. The device of claim 1 ,

wherein the one or more processors are further configured to reconstruct, based on the vector dequantized spatial component, the higher order ambisonic coefficients, and

wherein the one or more processors are configured to render, based on the reconstructed higher order ambisonic coefficients, the speaker feeds.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 30, 2017
From: KIM, MOO YOUNG; PETERS, NILS GÜNTHER; SEN, DIPANJAN
To: QUALCOMM INCORPORATED
Reel/Frame 041122/0386 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 16, 2015
From: KIM, MOO YOUNG; PETERS, NILS GÜNTHER; SEN, DIPANJAN
To: QUALCOMM INCORPORATED
Reel/Frame 036115/0879 →
Continuity (7)
Provisional Application 61994794 · May 16, 2014
Provisional Application 62004128 · May 28, 2014
Provisional Application 62019663 · Jul 1, 2014
Provisional Application 62027702 · Jul 22, 2014
Provisional Application 62028282 · Jul 23, 2014
Provisional Application 62032440 · Aug 1, 2014
Related Publication 20150332692A1 · Nov 19, 2015
Cited By (1)
US 12,308,034