Audio processing
An audio processing system ( 100 ) for spatial synthesis comprises an upmix stage ( 110 ) receiving a decoded m-channel downmix signal (X) and outputting, based thereon, an n-channel upmix signal (Y), wherein 2≦m<n. The upmix stage comprises a downmix modifying processor ( 120 ), which receives the m-channel downmix signal and outputting a modified downmix signal (d 1 , d 2 ) obtained by cross mixing and non-linear processing of the downmix signal, and further comprises a first mixing matrix ( 130 ) receiving the downmix signal and the modified downmix signal, forming an n-channel linear combination of the downmix signal channels and modified downmix signal channels only and outputting this as the n-channel upmix signal. In an embodiment, the first mixing matrix accepts one or more mixing parameters (g, α 1 , . . . ) controlling at least one gain in the linear combination performed by the first mixing matrix. The gains are polynomials of degree ≦2.
1. An audio processing system for performing spatial synthesis,
the system comprising an upmix stage for receiving a decoded m-channel downmix signal and for outputting, based thereon, an n-channel upmix signal, wherein 2≦m<n, the upmix stage comprising:
a downmix modifying processor for receiving the m-channel downmix signal and for outputting a modified m-channel downmix signal, the downmix modifying processor adapted to cross mix and process the downmix signal in a non-linear fashion; and
a first mixing matrix for receiving the downmix signal and the modified downmix signal, the first mixing matrix adapted to perform a n-channel linear combination of the m-channel downmix signal and modified downmix signal only and for outputting the n-channel upmix signal, wherein:
the first mixing matrix is adapted to receive one or more mixing parameters for controlling at least one gain in the linear combination performed by the first mixing matrix:
and where the mixing parameters are in quantized format; and wherein
the n-channel upmix signal comprises a set of channels that are obtained as linear combinations of both the downmix signal and the modified downmix signal; and wherein
in the linear combination performed by the first mixing matrix, all gains applied in order to obtain said set of channels are polynomials of one or more of the mixing parameters, wherein the order of each polynomial is less than or equal to 2.
2. The audio processing system of claim 1 , wherein:
the first mixing matrix is adapted to receive the mixing parameters in quantized format;
and wherein
in the linear combination performed by the first mixing matrix, all gains applied to channels in the downmix signal are polynomials of one or more of the mixing parameters, wherein the order of each polynomial is equal to 2.
3. The audio processing system of claim 1 , wherein:
the first mixing matrix is adapted to receive the mixing parameters in quantized format; and wherein
all gains applied to channels in the modified downmix signal are polynomials of one or more of the mixing parameters, wherein the order of each polynomial is less than or equal to 1.
4. The audio processing system of claim 1 , wherein a contribution from a channel in the downmix signal to a spatially corresponding channel in the upmix signal is individually controllable by means of a mixing parameter, and any other contributions to the same channel in the downmix signal are controllable by uniformly quantized mixing parameters.
5. The audio processing system of claim 1 , wherein
one of the mixing parameters encodes two gain parameters; and
one or more gains in the linear combination performed by the first mixing matrix depend linearly on one of these two gain parameters.
6. The audio processing system of claim 1 , wherein:
the upmix stage is arranged to operate on frequency-domain representations of downmix and upmix signals;
each signal and each mixing parameter is segmented into time frames and comprises a plurality of frequency subbands, wherein all signals share, for each time frame, a first single subband configuration, and all mixing parameters share, for each time frame, a second single subband configuration; and
the second subband configuration defines frequency subbands of the mixing parameters which control the gains applied, in said linear combination performed by the first mixing matrix, to associated frequency subbands of the signals.
7. The audio processing system of claim 6 , wherein all frequency subbands of at least one of the mixing parameters are quantized with respect to a uniform resolution, and optionally, wherein the uniform resolution is common to all frequency subbands of the mixing parameter.
8. The audio processing system of claim 6 , further being configured to generate the upmix signal, by means of the first mixing matrix, in a qualitatively uniform fashion for all frequency subbands.
9. The audio processing system of claim 6 , arranged to operate on partially complex frequency-domain representations of the downmix and upmix signal, wherein each of the partially complex frequency-domain representations comprises,
in an upper frequency range: first spectral components representing spectral content of the corresponding signal expressed in a first subspace of a multidimensional space, and,
in a lower frequency range: in addition to said first spectral components, second spectral components representing spectral content of the corresponding signal expressed in a second subspace of the multidimensional space that includes a portion of the multidimensional space not included in the first subspace.
10. The audio processing system of claim 9 , wherein each of the partially complex frequency-domain representations is critically sampled in the upper frequency range.
11. The audio processing system of claim 1 , the downmix modifying processor comprising:
a second mixing matrix for receiving the m-channel downmix signal, for forming a linear combination of the downmix signal channels and for outputting this as an m-channel intermediate signal; and
a decorrelator for receiving the m-channel intermediate signal and for outputting the modified downmix signal comprising m decorrelated channels,
wherein the second mixing matrix is configured to accept at least one of said one or more mixing parameters, said at least one mixing parameter controlling at least one coefficient in the linear combination performed by the second mixing matrix.
12. The audio processing system of claim 11 , wherein the decorrelator comprises an artifact attenuator configured to detect sound endings in the intermediate signal and take corrective action in response thereto.
13. The audio processing system of claim 1 , further comprising an audio decoder receiving a bitstream encoding the downmix signal and outputting, based thereon, the decoded m-channel downmix signal.
14. A spatial synthesis method, comprising the steps of:
modifying, in a downmix modifying processor, an m-channel downmix signal by cross mixing and non-linear processing of the downmix signal, to obtain a modified downmix signal; and
forming, in a first mixing matrix, an n-channel linear combination of the downmix signal and the modified downmix signal and outputting this as an n-channel upmix signal, wherein 2≦m<n,
wherein:
receiving in the first mixing matrix, one or more mixing parameters to control at least one gain in the linear combination performed by the first mixing matrix and where the mixing parameters are in quantized format; wherein:
the n-channel upmix signal comprises a set of channels that are obtained as linear combinations of both the downmix signal and the modified downmix signal; and wherein
in the linear combination performed by the first mixing matrix, all gains applied in order to obtain said set of channels are polynomials of one or more of the mixing parameters, wherein the order of each polynomial is less than or equal to 2.
15. An audio processing system for performing spatial analysis and spatial synthesis, the system comprising:
a spatial analysis system and a spatial synthesis system,
the spatial analysis system comprising:
a downmix stage for receiving an n-channel input signal, for forming an m-channel linear combination of the channels in the n-channel signal and for outputting this as an m-channel output signal, wherein 2≦m<n; and
a parameter extractor for receiving the n-channel input signal and for outputting one or more mixing parameters, the mixing parameters adapted to control at least one gain in the spatial synthesis system,
wherein the downmix stage and the parameter extractor operate in parallel without information exchange between the downmix stage and the parameter extractor and/or without the downmix stage and the parameter extractor being synchronized; and
the spatial synthesis system, comprising:
an upmix stage for receiving the m-channel downmix signal and for outputting, based thereon, an n-channel upmix signal, wherein 2≦m<n, the upmix stage comprising:
a downmix modifying processor for receiving the m-channel downmix signal and for outputting a modified downmix signal, the downmix modifying processor adapted to cross mix and process the downmix signal in a non-linear fashion; and
a first mixing matrix adapted to perform a n-channel linear combination of the m-channel downmix signal and modified downmix signal and for outputting the n-channel upmix signal, wherein
the first mixing matrix is adapted to receive one or more of the mixing parameters for controlling said gain in the linear combination performed by the first mixing matrix, wherein the mixing parameters are in quantized format, wherein
the n-channel upmix signal comprises a set of channels that are obtained as linear combinations of both the downmix signal and the modified downmix signal; and wherein
in the linear combination performed by the first mixing matrix, all gains applied in order to obtain said set of channels are polynomials of one or more of the mixing parameters, wherein the order of each polynomial is less than or equal to 2.
16. The audio processing system of claim 15 , wherein the downmix stage and the parameter extractor both have access to a downmix specification quantitatively controlling the forming of said m-channel linear combination in the downmix stage.
17. The audio processing system of claim 15 , wherein the downmix stage is arranged to operate on time-domain representations of the signals.
18. A computer program product comprising a non-transitory computer-readable medium with computer-readable instructions for performing the method of claim 14 .