Encoding of envelope information of an audio downmix signal
A method for encoding envelope information is provided. In some implementations, the method involves determining a first downmixed signal associated with a downmixed channel associated with an audio signal to be encoded. In some implementations, the method involves determining energy levels of the first downmixed signal for a plurality of frequency bands. In some implementations, the method involves determining whether to encode information indicative of the energy levels in a bitstream. In some implementations, the method involves encoding the determined energy levels. In some implementations, the method involves generating an energy control value indicating that energy levels are encoded. In some implementations, the method involves generating the bitstream, wherein the energy control value and the information indicative of the energy levels are usable by the decoder to adjust energy levels associated with the first downmixed signal.
1 . A method for adjusting energy levels of audio signals, the method comprising:
determining a first downmixed signal associated with at least one downmixed channel associated with a first frame of an audio signal to be encoded;
determining energy levels of the first downmixed signal for a plurality of frequency bands;
determining whether to encode information indicative of the energy levels in a bitstream;
responsive to a determination that information indicative of the energy levels is to be encoded in the bitstream, encoding the determined energy levels;
generating an energy control value indicating that energy levels are encoded in the bitstream; and
generating the bitstream that includes an encoded version of the first downmixed signal, the energy control value, the information indicative of the energy levels, and metadata usable to upmix the first downmixed signal by a decoder, wherein the information indicative of the energy levels comprises envelope energy information of the first downmixed signal that is at least partially redundant envelope energy information, and wherein the energy control value and the information indicative of the energy levels are for use usable by the decoder to ensure alignment of energy levels associated with the at least one first downmixed signal with the redundant envelope energy information.
2 . The method of claim 1 , wherein determining whether to encode the information indicative of the energy levels in the bitstream is determined based at least in part on a number of bits required to encode the first downmixed signal and a number of bits required to transmit the metadata usable to upmix the first downmixed signal.
3 . The method of claim 1 wherein determining whether to encode the information indicative of the energy levels in the bitstream is determined based at least in part on whether the first frame of the audio signal includes a transient.
4 . The method of claim 1 , wherein the energy control value indicates a manner in which the energy levels are encoded in the bitstream.
5 . The method of claim 4 , wherein the manner in which the energy levels are encoded in the bitstream comprise one of time-differential encoding or frequency-differential encoding.
6 . The method of claim 5 , wherein frequency-differential encoding is utilized to encode energy levels responsive to a determination that a preceding frame included a transient.
7 . The method of claim 1 , further comprising applying a delay prior to determining the energy levels of the at least one first downmixed signal for the plurality of frequency bands.
8 . The method of claim 7 , wherein the delay corresponds to a delay associated with a core encoder that generates the encoded version of the first downmixed signal and a core decoder that reconstructs the audio signal.
9 . The method of claim 1 , further comprising:
determining whether to encode information indicative of energy levels associated with a second downmixed signal corresponding to a second frame of the audio signal; and
responsive to a determination that information indicative of the energy levels associated with the second frame of the audio signal are not to be encoded, generating a second energy control value associated with the second frame that indicates that the information indicative of the energy levels are not included in the bitstream.
10 . The method of claim 9 , wherein the second energy control value indicates that energy correction gains associated with a previous frame are to be used by the decoder to adjust energy levels associated with the second downmixed signal corresponding to the second frame.
11 . The method of claim 9 , wherein the second energy control value indicates that the decoder is not to adjust energy levels associated with the second downmixed signal corresponding to the second frame.
12 . The method of claim 1 , wherein a bitrate of the bitstream is less than 50 kilobits per second (kbps).
13 . A method for adjusting energy levels of audio signals, the method comprising:
obtaining, from a bitstream, a downmixed signal, metadata for upmixing the downmixed signal, and an energy control value indicative of whether energy levels are encoded in the bitstream, wherein the downmixed signal is a spatial audio downmixed signal generated from a multi-channel audio signal;
determining a mixing matrix based on the metadata;
determining energy levels of the downmixed signal for a plurality of frequency bands based on the energy control value and information indicative of the energy levels encoded in the bitstream, wherein the information indicative of the energy levels corresponds to envelope energy information of the downmixed signal that operates as redundant envelope energy information;
determining correction gains to be applied to the mixing matrix based on the determined energy levels for the plurality of frequency bands and the energy control value;
applying the correction gains to the mixing matrix to generate an adjusted mixing matrix, wherein applying the correction gains ensures alignment of energy levels of the downmixed signal with the redundant envelope energy information prior to upmixing the downmixed signal; and
upmixing the downmixed signal using the adjusted mixing matrix to generate a reconstructed multi-channel spatial audio signal.
14 . The method of claim 13 , wherein the energy control value indicates that the energy levels are encoded in the bitstream, and wherein determining the correction gains is based on the energy levels encoded in the bitstream.
15 . The method of claim 14 , wherein the energy control value indicates one or more of:
a manner in which the energy levels are encoded in the bitstream; or
energy levels are not encoded in the bitstream and that energy levels associated with a previous frame are to be used, and wherein determining the correction gains to be applied to the mixing matrix comprises obtaining correction gains applied to the previous frame; or
energy levels are not encoded in the bitstream, and wherein determining the correction gains to be applied to the mixing matrix comprises fading correction gains applied to a previous frame toward a unity gain.
16 . The method of claim 14 , wherein the energy control value indicates a manner in which the energy levels are encoded in the bitstream, and wherein the manner in which the energy levels are encoded in the bitstream comprises one of time-differential encoding or frequency-differential encoding.
17 . The method of claim 13 , further comprising one or more of:
generating the mixing matrix to be applied to an entirety of the frame using a linear interpolation of parameters applicable to a previous frame and parameters applicable to the frame; or
causing a representation of the reconstructed audio signal to be presented via a loudspeaker or headphones; or
wherein a bitrate associated with the bitstream is less than about 40 kilobits per second (kbps).
18 . An apparatus for implementing the method of claim 1 .
19 . One or more non-transitory media having software stored thereon, the software including instructions for controlling one or more devices to perform the method of claim 1 .