IP Library Granted Patent US 10,403,294
Granted Patent B2
US 10,403,294 · App. 16/183,063 · Granted Sep 3, 2019

Signaling layers for scalable coding of higher order ambisonic audio data

Inventors: Moo Young Kim (San Diego, CA); Nils Günther Peters (San Diego, CA); Dipanjan Sen (San Diego, CA)
Assignee: Qualcomm Incorporated
G10L19/008G10L19/167H04S3/008H04S2420/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,403,294
App. No.
16/183,063
Granted
Sep 3, 2019
Kind
B2
Abstract

In general, techniques are described for signaling layers for scalable coding of higher order ambisonic audio data. A device comprising a memory and a processor may be configured to perform the techniques. The memory may be configured to store the bitstream. The processor may be configured to obtain, from the bitstream, an indication of a number of layers specified in the bitstream, and obtain the layers of the bitstream based on the indication of the number of layers.

Claims (64)

1. A device configured to decode a bitstream representative of a higher order ambisonic audio signal, the device comprising:

a memory configured to store the bitstream; and

one or more processors configured to:

obtain, from the bitstream, an indication of a number of channels specified in layers of the bitstream;

obtain, from the bitstream, for a first layer of the layers, and based on the indication of the number of channels specified in the first layer, a first set of channels;

determine, based on the number of channels specified in the bitstream and an indication of a number of channels in the first set of channels, an indication of a number of remaining channels specified in the layers of the bitstream; and

obtain, from the bitstream, for a second layer of the layers, and based on the indication of the number of remaining channels, a second set of channels.

2. The device of claim 1 ,

wherein the one or more processors are further configured to obtain, from the bitstream, an indication of whether the bitstream includes a single layer or multiple layers, and

wherein the one or more processors are configured to, when the indication of whether the bitstream includes the single layer or the multiple layers indicates that the bitstream includes multiple layers:

obtain, from the bitstream, the indication of the number of channels specified in the bitstream;

obtain, from the bitstream, for the first layer of the bitstream, and based on the indication of the number of channels specified in bitstream, the first set of channels;

determine, based on the number of channels specified in the bitstream and the number of channels in the first set of channels, the indication of the number of remaining channels specified in the bitstream; and

obtain, from the bitstream, for the second layer of the bitstream, and based on the indication of the number of remaining channels, the second set of channels.

3. The device of claim 1 , wherein the one or more processors are configured to:

obtain an indication of a minimum number of channels used for specifying an ambient component of a soundfield represented by the higher order ambisonic audio signal; and

determine, based on the indication of the number of channels specified in layers of the bitstream and the indication of the minimum number of channels used for specifying the ambient component of the soundfield represented by the higher order ambisonic audio signal, the indication of the number of channels specified in the first layer.

4. The device of claim 3 ,

wherein the one or more processors are further configured to determine, based on the indication of the number of remaining channels, an indication of a number of layers specified in the bitstream, and

wherein the one or more processors are configured to determine, based on the indication of the number of channels specified in layers of the bitstream, the indication of the minimum number of channels used for specifying the ambient component of the soundfield represented by the higher order ambisonic audio signal, and the indication of the number of layers specified in the bitstream, the indication of the number of channels specified in the first layer.

5. The device of claim 1 , wherein the one or more processors are configured to subtract the indication of the number of channels specified in the first set of channels from the number of channels specified in the bitstream to determine the number of remaining channels.

6. The device of claim 1 , wherein the one or more processors are configured to obtain, from the bitstream, for the second layer, and when the indication of the number of remaining channels indicates that there are one or more remaining channels, the second set of channels.

7. The device of claim 1 , wherein the one or more processors are further configured to:

determine, based on the indication of the number of remaining channels specified in the bitstream and an indication of a number of channels specified in the second set of channels, an updated indication of the number of remaining channels; and

obtain, from the bitstream, for a third layer of the layers, and based on the updated indication of the number of remaining channels, a third set of channels.

8. The device of claim 1 , wherein the one or more processors are further configured to obtain, based on the first set of channels and the second set of channels, at least part of the higher order ambisonic signal.

9. The device of claim 8 , wherein the one or more processors are further configured to obtain, based on the first set of channels and the second set of channels, and in accordance with an audio coding standard, the part of the higher order ambisonic signal.

10. The device of claim 9 , wherein the audio coding standard comprises an motion pictures expert group (MPEG) H (MPEG-H) three-dimensional (3D) audio coding standard.

11. The device of claim 8 , wherein the one or more processors are configured to decode the first set of channels and the second set of channels to obtain the part of the higher order ambisonic signal.

12. The device of claim 1 , further comprising loudspeakers configured to reproduce, based on the first set of channels and the second set of channels, a soundfield represented by the higher order ambisonic audio signal.

13. The device of claim 1 , wherein the device comprises a handset.

14. A method of decoding a bitstream representative of a higher order ambisonic audio signal, the method comprising:

obtaining, from the bitstream, an indication of a number of channels specified in layers of the bitstream;

obtaining, from the bitstream, for a first layer of the layers, and based on the indication of the number of channels specified in the first layer, a first set of channels;

determining, based on the number of channels specified in the bitstream and an indication of a number of channels in the first set of channels, an indication of a number of remaining channels specified in the layers of the bitstream; and

obtaining, from the bitstream, for a second layer of the layers, and based on the indication of the number of remaining channels, a second set of channels.

15. The method of claim 14 , further comprising obtaining, from the bitstream, an indication of whether the bitstream includes a single layer or multiple layers, and

wherein obtaining the indication of the number of channels, obtaining the first set of channels, determining, the indication of the number of remaining channels, and obtaining the second set of channels occurs responsive to the indication of whether the bitstream includes the single layer or the multiple layers indicates that the bitstream includes multiple layers.

16. The method of claim 14 , wherein obtaining the indication of the number of channels specified in the layers of the bitstream comprises:

obtaining an indication of a minimum number of channels used for specifying an ambient component of a soundfield represented by the higher order ambisonic audio signal; and

determining, based on the indication of the number of channels specified in layers of the bitstream and the indication of the minimum number of channels used for specifying the ambient component of the soundfield represented by the higher order ambisonic audio signal, the indication of the number of channels specified in the first layer.

17. The method of claim 16 , further comprising determining, based on the indication of the number of remaining channels, an indication of a number of layers specified in the bitstream,

wherein determining the indication of the number of remaining channels in the comprises determining, based on the indication of the number of channels specified in layers of the bitstream, the indication of the minimum number of channels used for specifying the ambient component of the soundfield represented by the higher order ambisonic audio signal, and the indication of the number of layers specified in the bitstream, the indication of the number of channels specified in the first layer.

18. The method of claim 14 , wherein determining the indication of the number of remaining channels in the comprises subtracting the indication of the number of channels specified in the first set of channels from the number of channels specified in the bitstream to determine the number of remaining channels.

19. The method of claim 14 , wherein obtaining the second set of channels comprises obtaining, from the bitstream, for the second layer, and when the indication of the number of remaining channels indicates that there are one or more remaining channels, the second set of channels.

20. The method of claim 14 , further comprising:

determining, based on the indication of the number of remaining channels specified in the bitstream and an indication of a number of channels specified in the second set of channels, an updated indication of the number of remaining channels; and

obtaining, from the bitstream, for a third layer of the layers, and based on the updated indication of the number of remaining channels, a third set of channels.

21. The method of claim 14 , further comprising obtaining, based on the first set of channels and the second set of channels, at least part of the higher order ambisonic signal.

22. The method of claim 21 , further comprising obtaining, based on the first set of channels and the second set of channels, and in accordance with an audio coding standard, the part of the higher order ambisonic signal.

23. The method of claim 22 , wherein the audio coding standard comprises a motion pictures expert group (MPEG) H (MPEG-H) three-dimensional (16D) audio coding standard.

24. The method of claim 21 , wherein obtaining the part of the higher order ambisonic signal comprises decoding the first set of channels and the second set of channels to obtain the part of the higher order ambisonic signal.

25. The method of claim 14 , wherein the method is performed by a device, the device coupled to loudspeakers configured to reproduce, based on the first set of channels and the second set of channels, a soundfield represented by the higher order ambisonic audio signal.

26. The method of claim 25 , wherein the device comprises a handset.

27. An apparatus configured to decode a bitstream representative of a higher order ambisonic audio signal, the apparatus comprising:

means for obtaining, from the bitstream, an indication of a number of channels specified in layers of the bitstream;

means for obtaining, from the bitstream, for a first layer of the layers, and based on the indication of the number of channels specified in the first layer, a first set of channels;

means for determining, based on the number of channels specified in the bitstream and an indication of a number of channels in the first set of channels, an indication of a number of remaining channels specified in the layers of the bitstream; and

means for obtaining, from the bitstream, for a second layer of the layers, and based on the indication of the number of remaining channels, a second set of channels.

28. A non-transitory computer-readable storage medium having stored thereon instructions that, when executed, cause one or more processors to:

obtain, from the bitstream, an indication of a number of channels specified in layers of the bitstream;

obtain, from the bitstream, for a first layer of the layers, and based on the indication of the number of channels specified in the first layer, a first set of channels;

determine, based on the number of channels specified in the bitstream and an indication of a number of channels in the first set of channels, an indication of a number of remaining channels specified in the layers of the bitstream; and

obtain, from the bitstream, for a second layer of the layers, and based on the indication of the number of remaining channels, a second set of channels.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 7, 2018
From: KIM, MOO YOUNG; PETERS, NILS GÜNTHER; SEN, DIPANJAN
To: QUALCOMM INCORPORATED
Reel/Frame 047437/0700 →
Continuity (10)
Continuation 14878691 · Oct 8, 2015
Provisional Application 62209764 · Aug 25, 2015
Provisional Application 62187799 · Jul 1, 2015
Provisional Application 62175185 · Jun 12, 2015
Provisional Application 62145960 · Apr 10, 2015
Provisional Application 62088445 · Dec 5, 2014
Provisional Application 62087209 · Dec 3, 2014
Provisional Application 62084461 · Nov 25, 2014
Provisional Application 62062584 · Oct 10, 2014
Related Publication 20190074020A1 · Mar 7, 2019