Method and apparatus for polyphonic audio signal prediction in coding and networking systems
View Patent ↗A method, device, and apparatus provide the ability to predict a portion of a polyphonic audio signal for compression and networking applications. The solution involves a framework of a cascade of long term prediction filters, which by design is tailored to account for all periodic components present in a polyphonic signal. This framework is complemented with a design method to optimize the system parameters. Specialization may include specific techniques for coding and networking scenarios, where the potential of each enhanced prediction is realized to considerably improve the overall system performance for that application. One specific technique provides enhanced inter-frame prediction for the compression of polyphonic audio signals, particularly at low delay. Another specific technique provides improved frame loss concealment capabilities to combat packet loss in audio communications.
1. A method for processing an audio signal, comprising:
processing an audio signal in a codec, wherein:
the codec comprises an encoder, a decoder, or both an encoder and a decoder;
the encoder processes the audio signal to generate encoded data and the decoder processes the encoded data to reconstruct the audio signal;
the processing of the audio signal in the codec comprises processing the audio signal utilizing prediction performed by a plurality of cascaded long term prediction filters in the codec, wherein each of the plurality of cascaded long term prediction filters corresponds to one periodic component of the audio signal.
2. The method of claim 1 , further comprising adapting one or more cascaded filter parameters of the cascaded long term prediction filters to local audio signal characteristics, wherein the one or more cascaded filter parameters comprise a number of filters in a cascade, a time lag parameter, and a gain parameter.
3. The method of claim 2 , wherein one or more of the cascaded filter parameters are sent to a decoder as side information.
4. The method of claim 2 , wherein one or more of the cascaded filter parameters are estimated from a reconstructed audio signal.
5. The method of claim 2 , wherein:
adapting the cascaded filter parameters comprises adjusting one or more of the one or more cascaded filter parameters for each of the plurality of cascaded long term prediction filters, successively, while fixing all other cascaded filter parameters; and
iterating over all cascaded long term prediction filters until a desired level of performance is met.
6. The method of claim 5 , wherein the desired level of performance corresponds to a minimum prediction error energy.
7. The method of claim 6 , wherein one or more cascaded filter parameters are further adjusted to satisfy a perceptual criterion.
8. The method of claim 7 , wherein the one or more cascaded filter parameters that are adjusted to satisfy the perceptual criterion are gain parameters.
9. The method of claim 7 , wherein the perceptual criterion is obtained by calculating a noise to mask ratio.
10. The method of claim 1 , wherein:
the processing of the audio signal in the encoder further comprises time-frequency mapping, quantization, and entropy coding; and
the processing of the audio signal in the decoder further comprises corresponding inverse operations of frequency-time mapping, dequantization, and entropy decoding.
11. The method of claim 10 , wherein time-frequency mapping employs a modified discrete cosine transform (MDCT) and frequency-time mapping employs an inverse MDCT.
12. The method of claim 10 , wherein time-frequency mapping employs an analysis filter bank, and frequency-time mapping employs a synthesis filter bank.
13. The method of claim 10 , wherein time-frequency mapping, quantization, entropy coding, and their inverse operations, are based on Moving Pictures Experts Group (MPEG) Advanced Audio Coding (AAC).
14. The method of claim 10 , wherein time-frequency mapping, quantization, entropy coding, and their inverse operations, are based on a Bluetooth Subband Codec.
15. A device for processing an audio signal, comprising:
a codec for processing an audio signal, wherein:
the codec comprises an encoder, a decoder, or both an encoder and a decoder;
the encoder processes the audio signal to generate encoded data and the decoder processes the encoded data to reconstruct the audio signal; and
the processing of the audio signal in the codec comprises processing the audio signal utilizing prediction performed by a plurality of cascaded long term prediction filters in the codec, wherein each of the plurality of cascaded long term prediction filters corresponds to one periodic component of the audio signal.
16. The device of claim 15 , wherein the device is further configured to adapt one or more cascaded filter parameters of the cascaded long term prediction filters to local audio signal characteristics, wherein the one or more cascaded filter parameters comprise a number of filters in a cascade, a time lag parameter, and a gain parameter.
17. The device of claim 16 , wherein the device adapts the cascaded filter parameters by:
adjusting one or more of the one or more cascaded filter parameters for each of the plurality of cascaded long term prediction filters, successively, while fixing all other cascaded filter parameters; and
iterating over all cascaded long term prediction filters until a desired level of performance is met.