Cue-based audio coding/decoding
View Patent ↗Generic and specific C-to-E binaural cue coding (BCC) schemes are described, including those in which one or more of the input channels are transmitted as unmodified channels that are not downmixed at the BCC encoder and not upmixed at the BCC decoder. The specific BCC schemes described include 5-to-2, 6-to-5, 7-to-5, 6.1-to-5.1, 7.1-to-5.1, and 6.2-to-5.1, where “0.1” indicates a single low-frequency effects (LFE) channel and “0.2” indicates two LFE channels.
1. A method for encoding C input audio channels to generate E transmitted audio channels, the method comprising:
providing two or more of the C input channels in a frequency domain;
generating one or more cue codes for each of one or more different frequency bands in the two or more input channels in the frequency domain; and
downmixing the C input channels to generate the E transmitted channels, where C>E≧1, wherein:
at least one of the E transmitted channels is based on two or more of the C input channels; and
at least one of the E transmitted channels is based on only a single one of the C input channels.
2. The invention of claim 1 , further comprising formatting the E transmitted channels and the one or more cue codes into a transmission format such that:
the format enables a first audio decoder having no knowledge of the existence of the one or more cue codes to generate E playback audio channels based on the E transmitted channels and independent of the one or more cue codes; and
the format enables a second audio decoder having knowledge of the existence of the one or more cue codes to generate more than E playback audio channels based on the E transmitted channels and the one or more cue codes.
3. The invention of claim 2 , wherein the format enables the second audio decoder to generate C playback audio channels based on the E transmitted channels and the one or more cue codes.
4. The invention of claim 1 , wherein E=1.
5. The invention of claim 1 , wherein E>1.
6. The invention of claim 1 , wherein each of the E transmitted channels is based on two or more of the C input channels.
7. The invention of claim 1 , wherein:
the C input channels comprise a first low frequency effects (LFE) channel; and
at least one of the E transmitted channels is based on only the first LFE channel.
8. The invention of claim 1 , wherein:
the C input channels comprise at least two LFE channels; and
at least one of the E transmitted channels is based on the at least two LFE channels.
9. The invention of claim 1 , wherein the one or more cue codes comprise one of more of inter-channel level difference (ICLD) data, inter-channel time difference (ICTD) data, and inter-channel correlation (ICC) data.
10. The invention of claim 1 , wherein the downmixing comprises, for each of one or more different frequency bands, downmixing the two or more input channels in the frequency domain into one or more downmixed channels in the frequency domain.
11. Apparatus for encoding C input audio channels to generate E transmitted audio channels, the apparatus comprising:
two or more filter banks adapted to convert two or more of the C input channels from a time domain into a frequency domain;
a code estimator adapted to generate one or more cue codes for each of one or more different frequency bands in the two or more converted input channels; and
a downmixer adapted to downmix the C input channels to generate the E transmitted channels, where C>E≧1, wherein:
at least one of the E transmitted channels is based on two or more of the C input channels; and
at least one of the E transmitted channels is based on only a single one of the C input channels.
12. The invention of claim 11 , wherein:
the C input channels comprise a first LFE channel; and
at least one of the E transmitted channels is based on only the first LFE channel.
13. The invention of claim 11 , wherein:
the C input channels comprise at least two LFE channels; and
at least one of the E transmitted channels is based on the at least two LFE channels.
14. The invention of claim 11 , wherein:
the apparatus is a system selected from the group consisting of a digital video recorder, a digital audio recorder, a computer, a satellite transmitter, a cable transmitter, a terrestrial broadcast transmitter, a home entertainment system, and a movie theater system; and
the system comprises the two or more filter banks, the code estimator, and the downmixer.
15. A method for decoding E transmitted audio channels to generate C playback audio channels, the method comprising:
upmixing, for each of one or more different frequency bands, one or more of the E transmitted channels in a frequency domain to generate two or more of the C playback channels in the frequency domain, where C>E≧1;
applying one or more cue codes to each of the one or more different frequency bands in the two or more playback channels in the frequency domain to generate two or more modified channels; and
converting the two or more modified channels from the frequency domain into a time domain, wherein:
at least one of the C playback channels is based on at least one of the E transmitted channels and at least one cue code; and
at least one of the C playback channels is based on only a single one of the E transmitted channels and independent of any cue codes.
16. The invention of claim 15 , further comprising, prior to upmixing, converting the one or more of the E transmitted channels from the time domain to the frequency domain.
17. The invention of claim 15 , wherein E=1.
18. The invention of claim 15 , wherein E>1.
19. The invention of claim 15 , wherein each of the C playback channels is based on at least one of the E transmitted channels and at least one cue code.
20. The invention of claim 15 , wherein:
the E transmitted channels comprise a first LFE channel; and
at least one of the C playback channels is based on only the first LFE channel and independent of any cue codes.
21. The invention of claim 15 , wherein:
the E transmitted channels comprise a first LFE channel; and
at least two of the C playback channels are based on the first LFE channel and at least one cue code.
22. The invention of claim 15 , wherein the one or more cue codes comprise one of more of ICLD data, ICTD data, and ICC data.
23. The invention of claim 15 , wherein the upmixing comprises, for each of one or more different frequency bands, upmixing at least two of the E transmitted channels into at least one playback channel in the frequency domain.
24. An apparatus for decoding E transmitted audio channels to generate C playback audio channels, the apparatus comprising:
an upmixer adapted, for each of one or more different frequency bands, to upmix one or more of the E transmitted channels in a frequency domain to generate two or more of the C playback channels in the frequency domain, where C>E≧1;
a synthesizer adapted to apply one or more cue codes to each of the one or more different frequency bands in the two or more playback channels in the frequency domain to generate two or more modified channels; and
one or more inverse filter banks adapted to convert the two or more modified channels from the frequency domain into a time domain, wherein:
at least one of the C playback channels is based on at least one of the E transmitted channels and at least one cue code; and
at least one of the C playback channels is based on only a single one of the E transmitted channels and independent of any cue codes.
25. The invention of claim 24 , wherein:
the E transmitted channels comprise a first LFE channel; and
at least one of the C playback channels is based on only the first LFE channel and independent of any cue codes.
26. The invention of claim 24 , wherein:
the E transmitted channels comprise a first LFE channel; and
at least two of the C playback channels are based on the first LFE channel and at least one cue code.
27. The invention of claim 24 , wherein:
the apparatus is a system selected from the group consisting of a digital video player, a digital audio player, a computer, a satellite receiver, a cable receiver, a terrestrial broadcast receiver, a home entertainment system, and a movie theater system; and
the system comprises the upmixer, the synthesizer, and the one or more inverse filter banks.