Apparatus and method for encoding a plurality of audio objects using direction information during a downmixing or apparatus and method for decoding using an optimized covariance synthesis
An apparatus for encoding a plurality of audio objects and related metadata indicating direction information on the plurality of audio objects has: a downmixer for downmixing the plurality of audio objects to obtain one or more transport channels; a transport channel encoder for encoding one or more transport channels to obtain one or more encoded transport channels; and an output interface for outputting an encoded audio signal comprising the one or more encoded transport channels, wherein the downmixer is configured to downmix the plurality of audio objects in response to the direction information on the plurality of audio objects.
1 . An apparatus for encoding a plurality of audio objects and related metadata indicating direction information on the plurality of audio objects, comprising:
a downmixer for downmixing the plurality of audio objects to acquire one or more transport channels;
a transport channel encoder for encoding the one or more transport channels to acquire one or more encoded transport channels; and
an output interface for outputting an encoded audio signal comprising the one or more encoded transport channels,
wherein the downmixer is configured to downmix the plurality of audio objects in response to the direction information on the plurality of audio objects, and
wherein the downmixer is configured to derive, for each audio object of the plurality of audio objects, a weighting information for each transport channel using the direction information for a corresponding audio object, to weight the corresponding audio object using the weighting information for the audio object for a specific transport channel to acquire an object contribution for the specific transport channel, and to combine the object contributions for the specific transport channel from the plurality of audio objects to acquire the specific transport channel,
or
wherein the downmixer is configured to calculate the one or more transport channels as one or more virtual microphone signals arranged at the same position and comprising different orientations or at different positions with respect to a reference position or orientation, to which the direction information is related, and wherein the different positions or orientations are on or to a left side of a center line and on or to a right side of the center line, or wherein the different positions or orientations are equally or non-equally distributed to horizontal positions or orientations, or wherein the different positions or orientations comprise at least one position or orientation being directed upwards or downwards with respect to a horizontal plane in which a virtual listener is placed, wherein the direction information on the plurality of audio objects is related to the virtual listener position or reference position or orientation,
or
wherein the downmixer is configured to perform an analysis of the direction information on the plurality of audio objects, to place one or more virtual microphones for the generation of the transport channels depending on a result of the analysis, and to downmix the plurality of audio objects to obtain the one or more transport channels, the one or more transport channels being one or more virtual microphone signals for the one or more virtual microphones being placed depending on the result of the analysis,
or
wherein the downmixer is configured to downmix using a downmixing rule being static over a plurality of time frames, or wherein the direction information is variable over a plurality of time frames, and wherein the downmixer is configured to downmix using a downmixing rule being variable over a plurality of time frames,
or
wherein the downmixer is configured to downmix in a time domain using a sample-by-sample weighting and combining of samples of the plurality of audio objects.
2 . The apparatus of claim 1 , wherein the downmixer is configured
to generate two transport channels as two virtual microphone signals arranged at the same position and comprising different orientations or at two different positions with respect to a reference position or orientation comprising a virtual listener position or orientation, or
to generate three transport channels as three virtual microphone signals arranged at the same position and comprising different orientations or at three different positions with respect to a reference position or orientation comprising a virtual listener position or orientation, or
to generate four transport channels as four virtual microphone signals arranged at the same position and comprising different orientations or at four different positions with respect to a reference position or orientation comprising a virtual listener position or orientation, or
wherein the virtual microphone signals are virtual first order microphone signals, or virtual cardioid microphone signals, or virtual figure of 8 or dipole or bidirectional microphone signals, or virtual directional microphone signals, or virtual subcardioid microphone signals, or virtual unidirectional microphone signals, or virtual hypercardioid microphone signals, or virtual omnidirectional microphone signals.
3 . An apparatus for encoding a plurality of audio objects and related metadata indicating direction information on the plurality of audio objects, comprising:
a downmixer for downmixing the plurality of audio objects to acquire one or more transport channels;
a transport channel encoder for encoding the one or more transport channels to acquire one or more encoded transport channels;
a parameter processor for quantizing the metadata indicating the direction information on the plurality of audio objects to acquire quantized direction items for the plurality of audio objects,
wherein the downmixer is configured to downmix the plurality of audio objects in response to the quantized direction items, and
an output interface for outputting an encoded audio signal comprising the one or more encoded transport channels; and information on the quantized direction items.
4 . An apparatus for encoding a plurality of audio objects and related metadata indicating direction information on the plurality of audio objects, comprising:
a downmixer for downmixing the plurality of audio objects to acquire one or more transport channels, wherein the downmixer is configured to downmix the plurality of audio objects in response to the direction information on the plurality of audio objects;
a transport channel encoder for encoding the one or more transport channels to acquire one or more encoded transport channels; and
an object parameter calculator configured for calculating, for one or more frequency bins of a plurality of frequency bins related to a time frame, parameter data for at least two relevant audio objects, wherein a number of relevant audio objects the at least two relevant audio objects is lower than a total number of audio objects of the plurality of audio objects; and
an output interface for outputting an encoded audio signal comprising the one or more encoded transport channels and information on the parameter data for the at least two relevant audio objects for the one or more frequency bins.
5 . The apparatus of claim 4 , wherein the object parameter calculator is configured
to convert each audio object of the plurality of audio objects into a spectral representation comprising the plurality of frequency bins,
to calculate a selection information from each audio object for the one or more frequency bins, and
to derive object identifications as the parameter data indicating the at least two relevant audio objects, based on the selection information, and
wherein the output interface is configured to introduce information on the object identifications into the encoded audio signal.
6 . The apparatus of claim 5 ,
wherein the selection information of the audio object is an amplitude-related measure comprising an amplitude value, a power value or a loudness value or an amplitude raised to a power being different from one for the audio object, and
wherein the object parameter calculator is configured to calculate a combined value comprising a ratio from an amplitude related measure of a relevant audio object and a sum of two or more amplitude related measures of the relevant audio objects, and
wherein the output interface is configured to introduce an information on the combined value into the encoded audio signal, wherein a number of information items on the combined values in the encoded audio signal is equal to at least one and is lower than the number of relevant audio objects for the one or more frequency bins.
7 . The apparatus of claim 5 ,
wherein the object parameter calculator is configured to select the object identifications based on an order of the selection information of the plurality of audio objects in the one or more frequency bins.
8 . The apparatus of claim 5 , wherein the object parameter calculator is configured
to calculate a signal power as the selection information for each audio object of the total number of audio objects,
to derive the object identifications for the two or more audio objects having the two or more greatest signal power values among the signal power values for the audio objects of the total number of audio objects in the corresponding one or more frequency bins for each frequency bin separately, the two or more audio objects having the two or more greatest signal power values among the signal power values for the audio objects of the total number of audio objects being the at least two relevant audio objects,
to calculate a power ratio between a sum of the signal powers of the at least two relevant audio objects and a signal power of one audio object of the at least two relevant audio objects as the parameter data, and
to quantize and encode the power ratio, and
wherein the output interface is configured to introduce the quantized and encoded power ratio into the encoded audio signal.
9 . The apparatus of claim 5 , wherein the output interface is configured to introduce, into the encoded audio signal,
one or more encoded transport channels,
as the parameter data, two or more encoded object identifications for the relevant audio objects for each frequency bin of the one or more frequency bins of the plurality of frequency bins in the time frame, and one or more encoded combined values or encoded amplitude-related measures, and
quantized and encoded direction data for each audio object in the time frame, the direction data being constant for all frequency bins of the one or more frequency bins.
10 . The apparatus of claim 4 , wherein the object parameter calculator is configured to quantize and encode one or more amplitude related measures or one or more combined values derived from the amplitude related measures of the relevant audio objects in the one or more frequency bins as the parameter data, and
wherein the output interface is configured to introduce the quantized one or more amplitude related measure or the quantized one or more combined values into the encoded audio signal.
11 . The apparatus of claim 4 , wherein the object parameter calculator is configured to calculate the parameter data for at least a most dominant object and a second most dominant object in the one or more frequency bins, or
wherein a number of audio objects of the plurality of audio objects is three or more, the plurality of audio objects comprising a first audio object, a second audio object and a third audio object, and
wherein the object parameter calculator is configured to calculate for a first frequency bin of the one or more frequency bins, as the relevant audio objects, only a first group of audio objects, the first group of audio objects comprising the first audio object and the second audio object, and to calculate, as the relevant audio objects for a second frequency bin of the one or more frequency bins, only a second group of audio objects, the second group of audio objects comprising the second audio object and the third audio object or the first audio object and the third audio object, wherein the first group of audio objects is different from the second group of audio objects at least with respect to one group member.
12 . The apparatus of claim 4 , wherein the object parameter calculator is configured
to calculate raw parametric data with a first time or frequency resolution and to combine the raw parametric data into combined parametric data comprising a second time or frequency resolution being lower than the first time of frequency resolution, and, and to calculate the parameter data for the at least two relevant audio objects with respect to the combined parametric data comprising the second time or frequency resolution, or
to determine parameter bands comprising a second time or frequency resolution being different from a first time or frequency resolution used in a time or frequency decomposition of the plurality of audio objects, and to calculate the parameter data for the at least two relevant audio objects for the parameter bands comprising the second time or frequency resolution.
13 . A decoder for decoding an encoded audio signal comprising one or more transport channels and direction information for a plurality of audio objects, and, for one or more frequency bins of a time frame, parameter data for an audio object, the decoder comprising:
an input interface for providing the one or more transport channels in a spectral representation comprising, in the time frame, the plurality of frequency bins; and
an audio renderer for rendering the one or more transport channels into a number of audio channels using the direction information,
wherein the audio renderer is configured to calculate a direct response information from the one or more audio objects per each frequency bin of the plurality of frequency bins and the direction information associated with the relevant one or more audio objects in the frequency bins, and
wherein the audio renderer is configured to calculate a covariance synthesis information using the direct response information and an information on the number of audio channels, and to apply the covariance synthesis information to the one or more transport channels to acquire the number of audio channels,
or
wherein the direct response information is a direct response vector for each one or more audio object, and wherein the covariance synthesis information is a covariance synthesis matrix, and wherein the audio renderer is configured to perform a matrix operation per frequency bin in applying the covariance synthesis information,
or
wherein the audio renderer is configured to only use main diagonal elements of an input covariance matrix derived from the transport channels in a decomposition of the input covariance matrix, or to perform a decomposition of a target covariance matrix using a direct response matrix and a matrix of powers of the objects or transport channels, or to perform a decomposition of the input covariance matrix by taking the root of each main diagonal element of the input covariance matrix, or to calculate a regularized inverse of decomposed input covariance matrix, or to perform a singular value decomposition in calculating an optimum matrix to be used in an energy compensation without an extended identity matrix.
14 . A decoder for decoding an encoded audio signal comprising one or more transport channels and direction information for a plurality of audio objects, and, for one or more frequency bins of a time frame, parameter data for an audio object, the decoder comprising:
an input interface for providing the one or more transport channels in a spectral representation comprising, in the time frame, the plurality of frequency bins; and
an audio renderer for rendering the one or more transport channels into a number of audio channels using the direction information,
wherein the audio renderer is configured to calculate a direct response information from the one or more audio objects per each frequency bin of the plurality of frequency bins and the direction information associated with the relevant one or more audio objects in the frequency bins,
wherein the audio renderer is configured
to derive, in the calculation of the direct response information, a direct response vector for the one or more audio objects and to calculate, for the one or more audio objects, a covariance matrix from each direct response vector, and
to derive, in the calculation of a covariance synthesis information, a target covariance information from the covariance matrix of the one audio object or the covariant matrices from more audio objects,
a power information on the respective one or more audio objects, and
a power information derived from the one or more transport channels.
15 . The decoder of claim 14 , wherein the audio renderer is configured
to derive, in the calculation of the direct response information, a direct response vector for the one or more audio object and to calculate, for each one or more audio objects, a covariance matrix from each direct response vector,
to derive an input covariance information from the transport channels, and
to derive a mixing information from the target covariance information, the input covariance information and the information on the number of channels, and
to apply the mixing information to the transport channels for each frequency bin in the time frame.
16 . The decoder of claim 15 , wherein a result of the application of the mixing information for each frequency bin in the time frame is converted into a time domain to acquire the number of audio channels in the time domain.
17 . A decoder for decoding an encoded audio signal comprising one or more transport channels and direction information for a plurality of audio objects, and, for one or more frequency bins of a time frame, parameter data for an audio object, the decoder comprising:
an input interface for providing the one or more transport channels in a spectral representation comprising, in the time frame, the plurality of frequency bins; and
an audio renderer for rendering the one or more transport channels into a number of audio channels using the direction information, wherein the audio renderer is configured to calculate a direct response information from the one or more audio objects per each frequency bin of the plurality of frequency bins and the direction information associated with the relevant one or more audio objects in the frequency bins,
wherein the parameter data for the one or more audio objects comprise parameter data for at least two relevant audio objects, wherein a number of relevant audio objects of the at least two relevant audio objects is lower than a total number of audio objects of the plurality of audio objects, and
wherein the audio renderer is configured to calculate, for each one of the one or more frequency bins, a contribution from the one or more transport channels in accordance with a first direction information associated with a first one of the at least two relevant audio objects and in accordance with a second direction information associated with a second one of the at least two relevant audio objects.
18 . The decoder of claim 17 ,
wherein the audio renderer is configured to ignore, for the one or more frequency bins, a direction information of an audio object different from the at least two relevant audio objects.
19 . The decoder of claim 17 ,
wherein the encoded audio signal comprises an amplitude related measure for each relevant audio object or a combined value related to at least two relevant audio objects in the parameter data, and
wherein the audio renderer is configured to operate so that a contribution from the one or more transport channels in accordance with a first direction information associated with a first one of the at least two relevant audio objects and in accordance with a second direction information associated with a second one of the at least two relevant audio objects is accounted for, or to determine a quantitative contribution of the one or more transport channels in accordance with the amplitude-related measure or the combined value.
20 . The decoder of claim 19 , wherein the encoded signal comprises the combined value in the parameter data, and
wherein the audio renderer is configured to determine the contribution of the one or more transport channels using the combined value for one of the relevant audio objects and the direction information for the one relevant audio object, and
wherein the audio renderer is configured to determine the contribution for the one or more transport channels using a value derived from the combined value for another of the relevant audio objects in the one or more frequency bins and the direction information of the other relevant audio object.
21 . The decoder of claim 17 , wherein the audio renderer is configured
to calculate the direct response information from the relevant audio objects per each frequency bin of the plurality of frequency bins and the direction information associated with the relevant audio objects in the plurality of frequency bins.
22 . The decoder of claim 21 ,
wherein the audio renderer is configured to determine a diffuse signal per each frequency bin of the plurality of frequency bins using a diffuseness information comprising a diffuseness parameter included in the metadata or a decorrelation rule and to combine a direct response as determined by the direct response information and the diffuse signal to acquire a spectral domain rendered signal for a channel of the number of channels.
23 . A method of encoding a plurality of audio objects and related metadata indicating direction information on the plurality of audio objects, comprising:
downmixing the plurality of audio objects to acquire one or more transport channels;
encoding the one or more transport channels to acquire one or more encoded transport channels; and
outputting an encoded audio signal comprising the one or more encoded transport channels,
wherein the downmixing comprises downmixing the plurality of audio objects in response to the direction information on the plurality of audio objects,
wherein the downmixing comprises deriving, for each audio object of the plurality of audio objects, a weighting information for each transport channel using the direction information for a corresponding audio object, weighting the corresponding audio object using the weighting information for the audio object for a specific transport channel to acquire an object contribution for the specific transport channel, and combining the object contributions for the specific transport channel from the plurality of audio objects to acquire the specific transport channel,
or
wherein the downmixing comprises calculating the one or more transport channels as one or more virtual microphone signals arranged at the same position and comprising different orientations or at different positions with respect to a reference position or orientation, to which the direction information is related, and wherein the different positions or orientations are on or to a left side of a center line and on or to a right side of the center line, or wherein the different positions or orientations are equally or non-equally distributed to horizontal positions or orientations, or wherein the different positions or orientations comprise at least one position or orientation being directed upwards or downwards with respect to a horizontal plane in which a virtual listener is placed, wherein the direction information on the plurality of audio objects is related to the virtual listener position or reference position or orientation,
or
wherein the downmixing comprises performing an analysis of the direction information on the plurality of audio objects, placing one or more virtual microphones for the generation of the transport channels depending on a result of the analysis, and downmixing the plurality of audio objects to obtain the one or more transport channels, the one or more transport channels being one or more virtual microphone signals for the one or more virtual microphones being placed depending on the result of the analysis,
or
wherein the downmixing comprises downmixing using a downmixing rule being static over a plurality of time frames, or wherein the direction information is variable over a plurality of time frames, and wherein the downmixing comprises downmixing using a downmixing rule being variable over a plurality of time frames,
or
wherein the downmixing comprises downmixing in a time domain using a sample-by-sample weighting and combining of samples of the plurality of audio objects,
or
comprising quantizing the metadata indicating the direction information on the plurality of audio objects to acquire quantized direction items for the plurality of audio objects, wherein the downmixing is configured to downmix the plurality of audio objects in response to the quantized direction items, and wherein the outputting comprises outputting the encoded audio signal comprising the one or more encoded transport channels, and information on the quantized direction items,
or
comprising calculating, for one or more frequency bins of a plurality of frequency bins related to a time frame, parameter data for at least two relevant audio objects, wherein a number of relevant audio objects the at least two relevant audio objects is lower than a total number of audio objects of the plurality of audio objects; and wherein the outputting comprises outputting an encoded audio signal comprising the one or more encoded transport channels and information on the parameter data for the at least two relevant audio objects for the one or more frequency bins.
24 . A method of decoding an encoded audio signal comprising one or more transport channels and direction information for a plurality of audio objects, and, for one or more frequency bins of a time frame, parameter data for an audio object, the method comprising:
providing the one or more transport channels in a spectral representation comprising, in the time frame, the plurality of frequency bins; and
audio rendering the one or more transport channels into a number of audio channels using the direction information,
wherein the audio rendering comprises calculating a direct response information from the one or more audio objects per each frequency bin of the plurality of frequency bins and the direction information associated with the relevant one or more audio objects in the frequency bins, and
wherein the audio rendering comprises calculating a covariance synthesis information using the direct response information and an information on the number of audio channels, and applying the covariance synthesis information to the one or more transport channels to acquire the number of audio channels,
or
wherein the direct response information is a direct response vector for each one or more audio object, and wherein a covariance synthesis information is a covariance synthesis matrix, and wherein the audio rendering comprises performing a matrix operation per frequency bin in applying the covariance synthesis information,
or
wherein the audio rendering comprises only using main diagonal elements of an input covariance matrix derived from the transport channels in a decomposition of the input covariance matrix, or performing a decomposition of a target covariance matrix using a direct response matrix and a matrix of powers of the objects or transport channels, or performing a decomposition of the input covariance matrix by taking the root of each main diagonal element of the input covariance matrix, or calculating a regularized inverse of decomposed input covariance matrix, or performing a singular value decomposition in calculating an optimum matrix to be used in an energy compensation without an extended identity matrix,
or
wherein the audio rendering comprises deriving, in the calculation of the direct response information, a direct response vector for the one or more audio objects and calculating, for the one or more audio objects, a covariance matrix from each direct response vector, and deriving, in the calculation of a covariance synthesis information, a target covariance information from the covariance matrix of the one audio object or the covariant matrices from more audio objects, a power information on the respective one or more audio objects, and a power information derived from the one or more transport channels,
or
wherein the parameter data for the one or more audio objects comprise parameter data for at least two relevant audio objects, wherein a number of relevant audio objects of the at least two relevant audio objects is lower than a total number of audio objects of the plurality of audio objects, and wherein the audio rendering comprises calculating, for each one of the one or more frequency bins, a contribution from the one or more transport channels in accordance with a first direction information associated with a first one of the at least two relevant audio objects and in accordance with a second direction information associated with a second one of the at least two relevant audio objects.
25 . A non-transitory digital storage medium having stored thereon a computer program for performing a method of encoding a plurality of audio objects and related metadata indicating direction information on the plurality of audio objects, comprising:
downmixing the plurality of audio objects to acquire one or more transport channels;
encoding the one or more transport channels to acquire one or more encoded transport channels; and
outputting an encoded audio signal comprising the one or more encoded transport channels,
wherein the downmixing comprises downmixing the plurality of audio objects in response to the direction information on the plurality of audio objects, and
wherein the downmixing comprises deriving, for each audio object of the plurality of audio objects, a weighting information for each transport channel using the direction information for a corresponding audio object, weighting the corresponding audio object using the weighting information for the audio object for a specific transport channel to acquire an object contribution for the specific transport channel, and combining the object contributions for the specific transport channel from the plurality of audio objects to acquire the specific transport channel,
or
wherein the downmixing comprises calculating the one or more transport channels as one or more virtual microphone signals arranged at the same position and comprising different orientations or at different positions with respect to a reference position or orientation, to which the direction information is related, and wherein the different positions or orientations are on or to a left side of a center line and on or to a right side of the center line, or wherein the different positions or orientations are equally or non-equally distributed to horizontal positions or orientations, or wherein the different positions or orientations comprise at least one position or orientation being directed upwards or downwards with respect to a horizontal plane in which a virtual listener is placed, wherein the direction information on the plurality of audio objects is related to the virtual listener position or reference position or orientation,
or
wherein the downmixing comprises performing an analysis of the direction information on the plurality of audio objects, placing one or more virtual microphones for the generation of the transport channels depending on a result of the analysis, and downmixing the plurality of audio objects to obtain the one or more transport channels, the one or more transport channels being one or more virtual microphone signals for the one or more virtual microphones being placed depending on the result of the analysis,
or
wherein the downmixing comprises downmixing using a downmixing rule being static over a plurality of time frames, or wherein the direction information is variable over a plurality of time frames, and wherein the downmixing comprises downmixing using a downmixing rule being variable over a plurality of time frames,
or
wherein the downmixing comprises downmixing in a time domain using a sample-by-sample weighting and combining of samples of the plurality of audio objects,
or
comprising quantizing the metadata indicating the direction information on the plurality of audio objects to acquire quantized direction items for the plurality of audio objects, wherein the downmixing is configured to downmix the plurality of audio objects in response to the quantized direction items, and wherein the outputting comprises outputting the encoded audio signal comprising the one or more encoded transport channels, and information on the quantized direction items, or
comprising calculating, for one or more frequency bins of a plurality of frequency bins related to a time frame, parameter data for at least two relevant audio objects, wherein a number of relevant audio objects the at least two relevant audio objects is lower than a total number of audio objects of the plurality of audio objects; and wherein the outputting comprises outputting an encoded audio signal comprising the one or more encoded transport channels and information on the parameter data for the at least two relevant audio objects for the one or more frequency bins
when said computer program is run by a computer.
26 . A non-transitory digital storage medium having stored thereon a computer program for performing a method of decoding an encoded audio signal comprising one or more transport channels and direction information for a plurality of audio objects, and, for one or more frequency bins of a time frame, parameter data for an audio object, the method comprising:
providing the one or more transport channels in a spectral representation comprising, in the time frame, the plurality of frequency bins; and
audio rendering the one or more transport channels into a number of audio channels using the direction information,
wherein the audio rendering comprises calculating a direct response information from the one or more audio objects per each frequency bin of the plurality of frequency bins and the direction information associated with the relevant one or more audio objects in the frequency bins, and
wherein the audio rendering comprises calculating a covariance synthesis information using the direct response information and an information on the number of audio channels, and applying the covariance synthesis information to the one or more transport channels to acquire the number of audio channels,
or
wherein the direct response information is a direct response vector for each one or more audio object, and wherein a covariance synthesis information is a covariance synthesis matrix, and wherein the audio rendering comprises performing a matrix operation per frequency bin in applying the covariance synthesis information,
or
wherein the audio rendering comprises only using main diagonal elements of an input covariance matrix derived from the transport channels in a decomposition of the input covariance matrix, or performing a decomposition of a target covariance matrix using a direct response matrix and a matrix of powers of the objects or transport channels, or performing a decomposition of the input covariance matrix by taking the root of each main diagonal element of the input covariance matrix, or calculating a regularized inverse of decomposed input covariance matrix, or performing a singular value decomposition in calculating an optimum matrix to be used in an energy compensation without an extended identity matrix,
or
wherein the audio rendering comprises deriving, in the calculation of the direct response information, a direct response vector for the one or more audio objects and calculating, for the one or more audio objects, a covariance matrix from each direct response vector, and deriving, in the calculation of a covariance synthesis information, a target covariance information from the covariance matrix of the one audio object or the covariant matrices from more audio objects, a power information on the respective one or more audio objects, and a power information derived from the one or more transport channels,
or
wherein the parameter data for the one or more audio objects comprise parameter data for at least two relevant audio objects, wherein a number of relevant audio objects of the at least two relevant audio objects is lower than a total number of audio objects of the plurality of audio objects, and wherein the audio rendering comprises calculating, for each one of the one or more frequency bins, a contribution from the one or more transport channels in accordance with a first direction information associated with a first one of the at least two relevant audio objects and in accordance with a second direction information associated with a second one of the at least two relevant audio objects,
when said computer program is run by a computer.