IP Library Granted Patent US 9,922,656
Granted Patent B2
US 9,922,656 · App. 14/594,533 · Granted Mar 20, 2018

Transitioning of ambient higher-order ambisonic coefficients

Inventors: Nils Günther Peters (San Diego, CA); Dipanjan Sen (San Diego, CA)
Assignee: QUALCOMM Incorporated
G10L19/002G10L19/008H04S2420/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,922,656
App. No.
14/594,533
Granted
Mar 20, 2018
Kind
B2
Abstract

In general, techniques are described for transitioning an ambient higher order ambisonic coefficient. A device comprising a memory and a processor may be configured to perform the techniques. The processor may obtain, from a frame of a bitstream of encoded audio data, a bit indicative of a reduced vector. The reduced vector may represent, at least in part, a spatial component of a sound field. The processor may also obtain, from the frame, a bit indicative of a transition of an ambient higher-order ambisonic coefficient. The ambient higher-order ambisonic coefficient may represent, at least in part, an ambient component of the sound field. The reduced vector may include a vector element associated with the ambient higher-order ambisonic coefficient in transition. The memory may be configured to store the frame of the bitstream.

Claims (118)

1. A method of decoding, by an audio decoding device, a bitstream of encoded audio data, the method comprising:

obtaining, by the audio decoding device and from a frame of the bitstream, a bit indicative of a reduced vector, the reduced vector representative, at least in part, of a spatial component of a sound field;

obtaining, from the frame, a bit indicative of a transition of an ambient higher-order ambisonic coefficient, the ambient higher-order ambisonic coefficient representative, at least in part, of an ambient component of the sound field, wherein the reduced vector includes a vector element associated with the ambient higher-order ambisonic coefficient in transition;

performing a fade-out operation with respect to the ambient higher-order ambisonic coefficient during the frame; and

performing a fade-in operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-out of the ambient higher-order ambisonic coefficient.

2. The method of claim 1 , wherein obtaining the bit indicative of the reduced vector comprises obtaining a bit indicative of the reduced vector in accordance with a first mode of a plurality of modes, the first mode indicating that the reduced vector includes the vector element associated with the ambient higher-order ambisonic coefficient in transition.

3. The method of claim 2 , wherein the plurality of modes further includes a second mode indicating that the vector element associated with the ambient higher-order ambisonic coefficient is not included in the reduced vector.

4. The method of claim 1 , further comprising:

maintaining transition state information based on the bit indicative of the transition of the ambient higher-order ambisonic coefficient; and

determining that the fade-out operation is to be performed with respect to the ambient higher-order ambisonic coefficient based on the transition state information.

5. The method of claim 4 , wherein the transition state information indicates one of a no transition state, a fade-in state or a fade-out state.

6. The method of claim 4 , further comprising obtaining the transition state information from a bit indicative of state information, the bit indicative of the state information enabling the bitstream of the encoded audio data of the frame to be decoded without reference to previous frames of the bitstream.

7. The method of claim 6 , further comprising dequantizing the reduced vector based on quantization information included in the bit indicative of the state information.

8. The method of claim 6 , further comprising decoding the frame to switch from a first representation of content to a second representation of the content, wherein the second representation is different than the first representation.

9. The method of claim 1 , wherein the bit indicative of the transition indicates whether the ambient higher-order ambisonic coefficient is faded-out during the frame.

10. The method of claim 1 , wherein the indication of the transition indicates whether the ambient higher-order ambisonic coefficient is faded-in during the frame.

11. The method of claim 1 , further comprising:

obtaining, during a subsequent frame, a bit indicative of a second reduced vector, a bit indicative of the ambient higher-order ambisonic coefficient, and a bit indicating that the ambient higher-order ambisonic coefficient is not in transition,

wherein the second reduced vector for the subsequent frame does not include an element associated with the ambient higher-order ambisonic coefficient for the subsequent frame.

12. The method of claim 1 , further comprising:

rendering, based on the reduced vector, one or more speaker feeds; and

outputting the one or more speaker feeds to one or more speakers.

13. The method of claim 1 , wherein performing the fade-in operation comprises performing the fade-in operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-out of the ambient higher-order ambisonic coefficient.

14. An audio decoding device configured to decode a bitstream of encoded audio data, the audio decoding device comprising:

a memory configured to store a frame of the bitstream of encoded audio data; and

one or more processors coupled to the memory, and configured to:

obtain, from the frame, a bit indicative of a reduced vector, the reduced vector representative, at least in part, of a spatial component of a sound field;

obtain, from the frame, an indication of a transition of an ambient higher-order ambisonic coefficient, the ambient high-order ambisonic coefficient representative, at least in part, of an ambient component of the sound field, wherein the reduced vector includes a vector element associated with the ambient higher-order ambisonic coefficient in transition;

perform a fade-out operation with respect to the ambient higher-order ambisonic coefficient during the frame; and

perform a fade-in operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-out of the ambient higher-order ambisonic coefficient.

15. The audio decoding device of claim 14 , wherein the one or more processors are configured to obtain the bit indicative of the reduced vector in accordance with a first mode of a plurality of modes, the first mode indicating that the reduced vector includes the vector element associated with the ambient higher-order ambisonic coefficient in transition.

16. The audio decoding device of claim 15 , wherein the plurality of modes further includes a second mode indicating that the vector element associated with the ambient higher-order ambisonic coefficient is not included in the reduced vector.

17. The audio decoding device of claim 14 , wherein the one or more processors are further configured to:

maintain transition state information based on the bit indicative of the transition of the ambient higher-order ambisonic coefficient;

determine that the fade-out operation is to be performed with respect to the ambient higher-order ambisonic coefficient based on the transition state information.

18. The audio decoding device of claim 17 , wherein the transition state information indicates one of a no transition state, a fade-in state and a fade-out state.

19. The audio decoding device of claim 17 , wherein the one or more processors are further configured to obtain the transition state information from a bit indicative of state information, the bit indicative of state information enabling the bitstream of the encoded audio data of the frame to be decoded without reference to previous frames of the bitstream.

20. The audio decoding device of claim 19 , wherein the one or more processors are further configured to dequantize the reduced vector based on quantization information included in the bit indicative of the state information.

21. The audio decoding device of claim 19 , wherein the one or more processors are further configured to decode the frame to switch from a first representation of content to a second representation of the content, wherein the second representation is different than the first representation.

22. The audio decoding device of claim 14 , wherein the bit indicative of the transition indicates whether the ambient higher-order ambisonic coefficient is faded-out during the frame.

23. The audio decoding device of claim 14 , wherein the bit indicative of the transition indicates whether the ambient higher-order ambisonic coefficient is faded-in during the frame.

24. The audio decoding device of claim 14 , wherein the one or more processors are further configured to obtain, during a subsequent frame, a bit indicative of a second reduced vector, a bit indicative of the ambient higher-order ambisonic coefficient, and a bit indicating that the ambient higher-order ambisonic coefficient is not in transition,

wherein the second reduced vector for the subsequent frame does not include an element associated with the ambient higher-order ambisonic coefficient for the subsequent frame.

25. The audio decoding device of claim 14 , wherein the one or more processors are further configured to:

render, based on the reduced vector, one or more speaker feeds; and

output the one or more speaker feeds to one or more speakers.

26. The audio decoding device of claim 14 , the one or more processors configured to perform the fade-in operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-out of the ambient higher-order ambisonic coefficient.

27. An audio decoding device configured to decode a bitstream of encoded audio data, the audio decoding device comprises:

means for storing a frame of the bitstream;

means for obtaining, from the frame, a bit indicative of a reduced vector, the reduced vector representative, at least in part, of a spatial component of a sound field;

means for obtaining, from the frame, a bit indicative of a transition of an ambient higher-order ambisonic coefficient, the ambient higher-order ambisonic coefficient representative, at least in part, of an ambient component of the sound field, wherein the reduced vector includes a vector element associated with the ambient higher-order ambisonic coefficient in transition;

means for performing a fade-out operation with respect to the ambient higher-order ambisonic coefficient during the frame; and

means for performing a fade-in operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-out of the ambient higher-order ambisonic coefficient.

28. The audio decoding device of claim 27 , wherein the means for obtaining the bit indicative of the reduced vector comprises means for obtaining the bit indicative of the reduced vector in accordance with a first mode of a plurality of modes, the first mode indicating that the reduced vector includes the vector element associated with the ambient higher-order ambisonic coefficient in transition.

29. The audio decoding device of claim 28 , wherein the plurality of modes further includes a second mode indicating that the vector element associated with the ambient higher-order ambisonic coefficient is not included in the reduced vector.

30. The audio decoding device of claim 27 , further comprising:

means for maintaining transition state information based on the bit indicative of the transition of the ambient higher-order ambisonic coefficient; and

means for determining that the fade-out operation is to be performed with respect to the ambient higher-order ambisonic coefficient based on the transition state information.

31. The audio decoding device of claim 30 , wherein the transition state information indicates one of a no transition state, a fade-in state and a fade-out state.

32. The audio decoding device of claim 30 , further comprising means for obtaining the transition state information from a bit indicative of state information, the bit indicative of the state information enabling the bitstream of the encoded audio data of the frame to be decoded without reference to previous frames of the bitstream.

33. The audio decoding device of claim 32 , further comprising means for dequantizing the reduced vector based on quantization information included in the bit indicative of the state information.

34. The audio decoding device of claim 32 , further comprising means for decoding the frame to switch from a first representation of content to a second representation of the content, the second representation is different than the first representation.

35. The audio decoding device of claim 27 , wherein the bit indicative of the transition indicates whether the ambient higher-order ambisonic coefficient is faded-out during the frame.

36. The audio decoding device of claim 27 , wherein the bit indicative of the transition indicates whether the ambient higher-order ambisonic coefficient is faded-in during the frame.

37. The audio decoding device of claim 27 , further comprising means for obtaining, during a subsequent frame, from the bitstream, a bit indicative of a second reduced vector, a bit indicative of the ambient higher-order ambisonic coefficient, and a bit indicating that the ambient higher-order ambisonic coefficient is not in transition,

wherein the second reduced vector for the subsequent frame does not include an element associated with the ambient higher-order ambisonic coefficient for the subsequent frame.

38. The audio decoding device of claim 27 , further comprising:

means for rendering, based on the reduced vector, one or more speaker feeds; and

means for outputting the one or more speaker feeds to one or more speakers.

39. The audio decoding device of claim 27 , wherein the means for performing the fade-in operation comprises means for performing the fade-in operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-out of the ambient higher-order ambisonic coefficient.

40. A non-transitory computer-readable storage medium having stored thereon instructions that when executed cause one or more processors of an audio decoding device to:

obtain, from a frame of a bitstream of encoded audio data, a bit indicative of a reduced vector, the reduced vector representative, at least in part, of a spatial component of a sound field;

obtain, from the frame, a bit indicative of a transition of an ambient higher-order ambisonic coefficient, the ambient higher-order ambisonic coefficients representative, at least in part, of an ambient component of the sound field, wherein the reduced vector includes a vector element associated with the ambient higher-order ambisonic coefficient in transition;

perform a fade-out operation with respect to the ambient higher-order ambisonic coefficient during the frame; and

perform a fade-in operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-out of the ambient higher-order ambisonic coefficient.

41. The non-transitory computer-readable storage medium of claim 40 having further stored thereon instructions that when executed cause the one or more processors of the audio decoding device to:

render, based on the reduced vector, one or more speaker feeds; and

output the one or more speaker feeds to one or more speakers.

42. The non-transitory computer-readable storage medium of claim 40 , wherein the fade-in operation is performed with respect to the vector element during the frame to compensate for energy change resulting from the fade-out of the ambient higher-order ambisonic coefficient.

43. A method of decoding, by an audio decoding device, a bitstream of encoded audio data, the method comprising:

obtaining, by the audio decoding device and from a frame of the bitstream, a bit indicative of a reduced vector, the reduced vector representative, at least in part, of a spatial component of a sound

obtaining, from the frame, a bit indicative of a transition of an ambient higher-order ambisonic coefficient, the ambient higher-order ambisonic coefficient representative, at least in part, of an ambient component of the sound field, wherein the reduced vector includes a vector element associated with the ambient higher-order ambisonic coefficient in transition;

performing a fade-in operation with respect to the ambient higher-order ambisonic coefficient during the frame; and

performing a fade-out operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-in of the ambient higher-order ambisonic coefficient.

44. The method of claim 43 , further comprising:

rendering, based on the reduced vector, one or more speaker feeds; and

outputting the one or more speaker feeds to one or more speakers.

45. The method of claim 43 , wherein performing the fade-out operation comprises performing the fade-out operation with respect to the vector element during the frame to compensate for the fade-in of the ambient higher-order ambisonic coefficient.

46. An audio decoding device configured to decode a bitstream of encoded audio data, the audio decoding device comprising:

a memory configured to store a frame of the bitstream of encoded audio data; and

one or more processors coupled to the memory, and configured to:

obtain, from the frame, a bit indicative of a reduced vector, the reduced vector representative, at least in part, of a spatial component of a sound field;

obtain, from the frame, an indication of a transition of an ambient higher-order ambisonic coefficient, the ambient high-order ambisonic coefficient representative, at least in part, of an ambient component of the sound field, wherein the reduced vector includes a vector element associated with the ambient higher-order ambisonic coefficient in transition;

perform a fade-in operation with respect to the ambient higher-order ambisonic coefficient during the frame; and

perform a fade-out operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-in of the ambient higher-order ambisonic coefficient.

47. The audio decoding device of claim 46 , wherein the one or more processors are further configured to:

render, based on the reduced vector, one or more speaker feeds; and

output the one or more speaker feeds to one or more speakers.

48. The audio decoding device of claim 46 , the one or more processors configured to perform the fade-out operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-in of the ambient higher-order ambisonic coefficient.

49. An audio decoding device configured to decode a bitstream of encoded audio data, the audio decoding device comprises:

means for storing a frame of the bitstream;

means for obtaining, from the frame, a bit indicative of a reduced vector, the reduced vector representative, at least in part, of a spatial component of a sound field;

means for obtaining, from the frame, a bit indicative of a transition of an ambient higher-order ambisonic coefficient, the ambient higher-order ambisonic coefficient representative, at least in part, of an ambient component of the sound field, wherein the reduced vector includes a vector element associated with the ambient higher-order ambisonic coefficient in transition;

means for perform a fade-in operation with respect to the ambient higher-order ambisonic coefficient during the frame; and

means for perform a fade-out operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-in of the ambient higher-order ambisonic coefficient.

50. The audio decoding device of claim 49 , further comprising:

means for rendering, based on the reduced vector, one or more speaker feeds; and

means for outputting the one or more speaker feeds to one or more speakers.

51. The audio decoding device of claim 49 , wherein the means for performing the fade-out operation comprises means for performing the fade-out operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-in of the ambient higher-order ambisonic coefficient.

52. A non-transitory computer-readable storage medium having stored thereon instructions that when executed cause one or more processors of an audio decoding device to:

obtain, from a frame of a bitstream of encoded audio data, a bit indicative of a reduced vector, the reduced vector representative, at least in part, of a spatial component of a sound field;

obtain, from the frame, a bit indicative of a transition of an ambient higher-order ambisonic coefficient, the ambient higher-order ambisonic coefficients representative, at least in part, of an ambient component of the sound field, wherein the reduced vector includes a vector element associated with the ambient higher-order ambisonic coefficient in transition;

perform a fade-in operation with respect to the ambient higher-order ambisonic coefficient during the frame; and

perform a fade-out operation with respect to the vector element during the frame to compensate for energy change occurring as a result of the fade-in of the ambient higher-order ambisonic coefficient.

53. The non-transitory computer-readable storage medium of claim 52 having further stored thereon instructions that when executed cause the one or more processors of the audio decoding device to:

render, based on the reduced vector, one or more speaker feeds; and

output the one or more speaker feeds to one or more speakers.

54. The non-transitory computer-readable storage medium of claim 52 , wherein the fade-out operation is performed with respect to the vector element during the frame to compensate for energy change resulting from the fade-in of the ambient higher-order ambisonic coefficient.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 18, 2015
From: PETERS, NILS GÜNTHER; SEN, DIPANJAN
To: QUALCOMM INCORPORATED
Reel/Frame 035193/0493 →
Continuity (7)
Provisional Application 61933706 · Jan 30, 2014
Provisional Application 61933714 · Jan 30, 2014
Provisional Application 61949591 · Mar 7, 2014
Provisional Application 61949583 · Mar 7, 2014
Provisional Application 62004067 · May 28, 2014
Provisional Application 62029173 · Jul 25, 2014
Related Publication 20150213803A1 · Jul 30, 2015