Channel reconfiguration with side information
During production, at least one audio signal is processed in order to derive instructions for channel reconfiguring it. The at least one audio signal and the instructions are stored or transmitted. During consumption, the at least one audio signal is channel reconfigured in accordance with the instructions. Channel reconfiguring includes upmixing, downmixing, and spatial reconfiguration. By determining the channel reconfiguration instructions during production, processing resources during consumption are reduced.
1. A method for processing two or more audio signals, each audio signal representing an audio channel, comprising
deriving instructions for channel reconfiguring the two or more audio signals without changing the configuration of the two or more audio signals, wherein the only audio information that said deriving receives is said two or more audio signals, and
generating a formatted output that includes the two or more audio signals with unchanged channel configuration, such that the two or more audio signals with unchanged channel configuration are unchanged with respect to the number of audio channels, the intended spatial location of the audio channels, and the format of the audio channels, and the formatted output includes said instructions for channel reconfiguring.
2. The method of claim 1 wherein the audio signals are a stereophonic pair of audio signals.
3. The method of claim 1 wherein said deriving instructions for channel reconfiguring derives instructions for upmixing the two or more audio signals such that, when upmixed in accordance with the instructions for upmixing, the resulting number of audio signals is greater than the number of audio signals comprising the two or more audio signals.
4. The method of claim 1 wherein said deriving instructions for channel reconfiguring derives instructions for downmixing the two or more audio signals such that, when downmixed in accordance with the instructions for downmixing, the resulting number of audio signals is less than the number of audio signals comprising the two or more audio signals.
5. The method of claim 1 wherein said deriving instructions for channel reconfiguring derives instructions for reconfiguring the two or more audio signals such that, when reconfigured in accordance with the instructions for reconfiguring, the number of audio signals remains the same but one or more spatial locations at which such audio signals are intended to be reproduced are changed.
6. The method of claim 1 wherein the two or more audio signals in the output is a data-compressed version of the two or more audio signals, respectively.
7. The method of claim 1 wherein said two or more audio signals are divided into frequency bands and said instructions for channel reconfiguring are with respect to ones of such frequency bands.
8. The method of claim 1 wherein the audio signals are a binauralized version of a stereophonic pair of audio signals.
9. A method for processing two or more audio signals, each audio signal representing an audio channel, comprising
receiving, in a formatted output from an audio processor, said two or more audio signals and instructions for channel reconfiguring the two or more audio signals, said instructions having been derived by an instruction derivation in which the only audio information received is said two or more audio signals and the instruction derivation does not change the configuration of the two or more signals, said two or more audio signals having an unchanged channel configuration with respect to the channel configuration of the two or more signals received by the instruction derivation, such that the two or more audio signals with unchanged channel configuration are unchanged with respect to the number of audio channels, the intended spatial location of the audio channels, and the format of the audio channels, and
channel reconfiguring the two or more audio signals using said instructions.
10. The method of claim 9 wherein the instructions for channel reconfiguring are instructions for upmixing the two or more audio signals and said channel reconfiguring upmixes the two or more audio signals such that the resulting number of audio signals is greater than the number of audio signals comprising the two or more audio signals.
11. The method of claim 9 wherein the instructions for channel reconfiguring are instructions for downmixing the two or more audio signals and said channel reconfiguring downmixes the two or more audio signals such that the resulting number of audio signals is less than the number of audio signals comprising the two or more audio signals.
12. The method of claim 9 wherein the instructions for channel reconfiguring are instructions for reconfiguring the two or more audio signals such that the number of audio signals remains the same but the respective spatial locations at which such audio signals are intended to be reproduced are changed.
13. The method of claim 9 wherein the instructions for channel reconfiguring are instructions for rendering a binaural stereophonic signal having an upmixing to multiple virtual channels of the two or more audio signals.
14. The method of claim 9 wherein the instructions for channel reconfiguring are instructions for rendering a binaural stereophonic signal having a virtual spatial location reconfiguration.
15. The method of claim 9 wherein the two or more audio signals are data-compressed, the method further comprising data decompressing the two or more audio signals.
16. The method of claim 9 wherein said two or more audio signals is divided into frequency bands and said instructions for channel reconfiguring are with respect to respective ones of such frequency bands.
17. The method of claim 9 further comprising
providing an audio output, and
selecting as the audio output one of:
(1) the at least two or more audio signals, or
(2) the channel reconfigured two or more audio signals.
18. The method of claim 9 further comprising providing an audio output in response to the received two or more audio signals.
19. The method of claim 18 wherein the method further comprises matrix decoding the two or more audio signals.
20. The method of claim 9 further comprising
providing an audio output in response to the channel-reconfigured received two or more audio signals.
21. A method for processing at least two audio signals, each audio signal representing an audio channel, comprising
receiving, in a formatted output from an audio processor, said two or more audio signals and instructions for channel reconfiguring the two or more audio signals, said instructions having been derived by an instruction derivation in which the only audio information received is said two or more audio signals and the instruction derivation does not change the configuration of the two or more signals, said two or more audio signals having an unchanged channel configuration with respect to the channel configuration of the two or more signals received by the instruction derivation, such that the two or more audio signals with unchanged channel configuration are unchanged with respect to the number of audio channels, the intended spatial location of the audio channels, and the format of the audio channels, and
matrix decoding the two or more audio signals.
22. The method of claim 21 wherein the matrix decoding is without reference to the received instructions.
23. The method of claim 21 wherein the matrix decoding is with reference to the received instructions.
24. Apparatus for processing two or more audio signals, each audio signal representing an audio channel, comprising
means for deriving instructions for channel reconfiguring the two or more audio signals without changing the configuration of the two or more audio signals, wherein the only audio information that said means for deriving receives is said two or more audio signals, and
means for generating a formatted output that includes the two or more audio signals with unchanged channel configuration such that the two or more audio signals with unchanged channel configuration are unchanged with respect to the number of audio channels, the intended spatial location of the audio channels, and the format of the audio channels, and the formatted output includes said instructions for channel reconfiguring.
25. Apparatus for processing two or more audio signals, each audio signal representing an audio channel, comprising
means for deriving instructions for channel reconfiguring the two or more audio signals without changing the configuration of the two or more audio signals, wherein the only audio information that said means for deriving receives is said two or more audio signals, and
means for generating a formatted output that includes the two or more audio signals with unchanged channel configuration such that the two or more audio signals with unchanged channel configuration are unchanged with respect to the number of audio channels, the intended spatial location of the audio channels, and the format of the audio channels, and the formatted output includes said instructions for channel reconfiguring, and
means for receiving the output.
26. Apparatus for processing two or more audio signals, each audio signal representing an audio channel, comprising
means for receiving, in a formatted output from an audio processor, said two or more audio signals and instructions for channel reconfiguring the two or more audio signals, said instructions having been derived by an instruction derivation in which the only audio information received is said two or more audio signals and the instruction derivation does not change the configuration of the two or more signals, said two or more audio signals having an unchanged channel configuration with respect to the channel configuration of the two or more signals received by the instruction derivation, such that the two or more audio signals with unchanged channel configuration are unchanged with respect to the number of audio channels, the intended spatial location of the audio channels, and the format of the audio channels, and
means for channel reconfiguring the two or more audio signals using said instructions.
27. Apparatus for processing at least two audio signals, each audio signal representing an audio channel, comprising
means for receiving, in a formatted output from an audio processor, said two or more audio signals and instructions for channel reconfiguring the two or more audio signals, said instructions having been derived by an instruction derivation in which the only audio information received is said two or more audio signals and the instruction derivation does not change the configuration of the two or more signals, said two or more audio signals having an unchanged channel configuration with respect to the channel configuration of the two or more signals received by the instruction derivation, such that the two or more audio signals with unchanged channel configuration are unchanged with respect to the number of audio channels, the intended spatial location of the audio channels, and the format of the audio channels, and
means for matrix decoding the two or more audio signals.