IP Library › Granted Patent US 12,586,593
Granted Patent B2
US 12,586,593 · App. 18/296,523 · Granted Mar 24, 2026

Apparatus and method for encoding a plurality of audio objects or apparatus and method for decoding using two or more relevant audio objects

Inventors: Andrea Eichenseer (Erlangen, DE); Srikanth Korse (Erlangen, DE); Stefan Bayer (Erlangen, DE); Fabian Küch (Erlangen, DE); Oliver Thiergart (Erlangen, DE); Guillaume Fuchs (Erlangen, DE); Dominik Weckbecker (Erlangen, DE); Jürgen Herre (Erlangen, DE); Markus Multrus (Erlangen, DE)
Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
G10L19/02G10L19/008
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,586,593
App. No.
18/296,523
Granted
Mar 24, 2026
Kind
B2
Abstract

Apparatus for encoding a plurality of audio objects, having: an object parameter calculator configured for calculating, for one or more frequency bins of a plurality of frequency bins related to a time frame, parameter data for at least two relevant audio objects, wherein a number of the at least two relevant audio objects is lower than a total number of the plurality of audio objects, and an output interface for outputting an encoded audio signal having information on the parameter data for the at least two relevant audio objects for the one or more frequency bins.

Claims (134)

1 . An apparatus for encoding a plurality of audio objects, comprising:

an object parameter calculator configured for calculating, for one or more frequency bins of a plurality of frequency bins related to a time frame, parameter data for at least two relevant audio objects, wherein a number of the at least two relevant audio objects is lower than a total number of the plurality of audio objects, wherein the object parameter calculator is configured for performing a selection of the number of the at least two relevant audio objects and for not indicating the total number of audio objects as being relevant, wherein the object parameter calculator is configured

to convert each audio object of the plurality of audio objects into a spectral representation comprising the plurality of frequency bins,

to calculate a selection information from each audio object for the one or more frequency bins, wherein the selection information is an amplitude-related measure for the audio object,

to calculate a combined value from two relevant audio objects of the at least two relevant audio objects, and

to derive object identifications as the parameter data indicating the at least two relevant audio objects, based on the selection information, and

an output interface for outputting an encoded audio signal comprising information on the object identifications as the parameter data for the at least two relevant audio objects, and one or more information items on the combined value or on more combined values, wherein a number of information items on the combined value or on the more combined values is equal to at least one and is lower than the number of relevant audio objects for the one or more frequency bins.

2 . The apparatus of claim 1 , wherein the object parameter calculator is configured to quantize and encode one or more amplitude related measures or the one or more combined values derived from the amplitude related measures of the relevant audio objects in the one or more frequency bins as the parameter data, and

wherein the output interface is configured to introduce the quantized one or more amplitude related measures or the quantized one or more combined values into the encoded audio signal.

3 . The apparatus of claim 1 ,

wherein the amplitude-related measure is an amplitude value, a power value or a loudness value or an amplitude raised to a power being different from one for the audio object, and

wherein the combined value is a ratio from an amplitude related measure of a relevant audio object and a sum of two or more amplitude related measures of the relevant audio objects.

4 . The apparatus of claim 1 , wherein the object parameter calculator is configured

to calculate a signal power as the selection information,

to derive the object identifications for the two or more audio objects comprising the greatest signal power values in the corresponding one or more frequency bins for each frequency bin separately,

to calculate a power ratio between the sum of the signal powers of the two or more audio objects comprising the greatest signal power values and the signal power of each of the audio objects comprising the derived object identifications as the parameter data, and

to quantize and encode the power ratio, and

wherein the output interface is configured to introduce the quantized and encoded power ratio into the encoded audio signal.

5 . An apparatus for encoding a plurality of audio objects, comprising:

an object parameter calculator configured for calculating, for one or more frequency bins of a plurality of frequency bins related to a time frame, parameter data for at least two relevant audio objects, wherein a number of the at least two relevant audio objects is lower than a total number of the plurality of audio objects, wherein the object parameter calculator is configured for performing a selection of the number of the at least two relevant audio objects and for not indicating the total number of audio objects as being relevant, wherein the object parameter calculator is configured

to convert each audio object of the plurality of audio objects into a spectral representation comprising the plurality of frequency bins,

to calculate a selection information from each audio object for the one or more frequency bins, and

to select object identifications as the parameter data indicating the at least two relevant audio objects, based on an order of the selection information of the plurality of audio objects in the one or more frequency bins, and

an output interface for outputting an encoded audio signal comprising, as the parameter data, information on the object identifications for the at least two relevant audio objects.

6 . An apparatus for encoding a plurality of audio objects, comprising:

an object parameter calculator configured for calculating, for one or more frequency bins of a plurality of frequency bins related to a time frame, parameter data for at least two relevant audio objects, wherein a number of the at least two relevant audio objects is lower than a total number of the plurality of audio objects, wherein the object parameter calculator is configured for performing a selection of the number of the at least two relevant audio objects and for not indicating the total number of audio objects as being relevant; and

an output interface for outputting an encoded audio signal comprising the parameter data for the at least two relevant audio objects,

wherein the output interface is configured to introduce, into the encoded audio signal,

one or more encoded transport channels,

as the parameter data, two or more encoded object identifications for the relevant audio objects for the one or more frequency bins of the plurality of frequency bins in the time frame, and one or more encoded combined values or encoded amplitude related measures, and

quantized and encoded direction data for each audio object in the time frame, the direction data being constant for all frequency bins of the one or more frequency bins,

or

wherein the object parameter calculator is configured to calculate the parameter data for at least a most dominant object and a second most dominant object in the one or more frequency bins, wherein the most dominant object and the second most dominant object represent the relevant objects,

or

wherein a number of audio objects of the plurality of audio objects is three or more, the plurality of audio objects comprising a first audio object, a second audio object and a third audio object, and

wherein the object parameter calculator is configured to calculate for a first one of the one or more frequency bins, as the relevant audio objects, only a first group of audio objects, and to calculate, as the relevant audio objects for a second frequency bin of the one or more frequency bins, only a second group of audio objects, wherein the first group of audio objects is different from the second group of audio objects at least with respect to one group member,

or

wherein the object parameter calculator is configured

to calculate raw parametric data with a first time or frequency resolution and to combine the raw parametric data into combined parametric data comprising a second time or frequency resolution being lower than the first time of frequency resolution, and to calculate the parameter data for the at least two relevant audio objects with respect to the combined parametric data comprising the second time or frequency resolution, or

to determine parameter bands comprising a second time or frequency resolution being different from a first time or frequency resolution used in a time or frequency decomposition of the plurality of audio objects, and to calculate the parameter data for the at least two relevant audio objects for the parameter bands comprising the second time or frequency resolution.

7 . An apparatus for encoding a plurality of audio objects, comprising:

an object parameter calculator configured for calculating, for one or more frequency bins of a plurality of frequency bins related to a time frame, parameter data for at least two relevant audio objects, wherein a number of the at least two relevant audio objects is lower than a total number of the plurality of audio objects, wherein the object parameter calculator is configured for performing a selection of the number of the at least two relevant audio objects and for not indicating the total number of audio objects as being relevant; and

an output interface for outputting an encoded audio signal comprising the parameter data for the at least two relevant audio objects,

wherein the plurality of audio objects comprise related metadata indicating direction information on the plurality of audio objects, and

wherein the apparatus further comprises:

a downmixer for downmixing the plurality of audio objects to acquire one or more transport channels, wherein the downmixer is configured to downmix the plurality of audio objects in response to the direction information on the plurality of audio objects; and

a transport channel encoder for encoding one or more transport channels to acquire one or more encoded transport channels; and

wherein the output interface is configured to introduce the one or more transport channels into the encoded audio signal.

8 . The apparatus of claim 7 , wherein the downmixer is configured to generate two transport channels as two virtual microphone signals arranged at the same position and comprising different orientations or at two different positions with respect to a reference position or orientation, or to generate three transport channels as three virtual microphone signals arranged at the same position and comprising different orientations or at three different positions with respect to a reference position or orientation, or to generate four transport channels as four virtual microphone signals arranged at the same position and comprising different orientations or at four different positions with respect to a reference position or orientation, or wherein the virtual microphone signals are virtual first order microphone signals, or virtual cardioid microphone signals, or virtual figure of 8 or dipole or bidirectional microphone signals, or virtual directional microphone signals, or virtual subcardioid microphone signals, or virtual unidirectional microphone signals, or virtual hypercardioid microphone signals, or virtual omnidirectional microphone signals.

9 . The apparatus of claim 7 , wherein the downmixer is configured

to derive, for each audio object of the plurality of audio objects, a weighting information for each transport channel using the direction information for the corresponding audio object;

to weight the corresponding audio object using the weighting information for the audio object for a specific transport channel to acquire an object contribution for the specific transport channel, and

to combine the object contributions for the specific transport channel from the plurality of audio objects to acquire the specific transport channel.

10 . The apparatus of claim 7 ,

wherein the downmixer is configured to calculate the one or more transport channels as one or more virtual microphone signals arranged at the same position and comprising different orientations or at different positions with respect to a reference position or orientation, to which the direction information is related,

wherein the different positions or orientations are on or to a left side of a center line and on or to a right side of the center line, or wherein the different positions or orientations are equally or non-equally distributed to horizontal positions or orientations, or wherein the different positions or orientations comprise at least one position or orientation being directed upwards or downwards with respect to a horizontal plane in which a virtual listener is placed, wherein the direction information on the plurality of audio objects is related to the virtual listener position or reference position or orientation.

11 . The apparatus in accordance with claim 7 , further comprising:

a parameter processor for quantizing the metadata indicating the direction information on the plurality of audio objects to acquire quantized direction items for the plurality of audio objects,

wherein the downmixer is configured to operate in response to the quantized direction items as the direction information, and

wherein the output interface is configured to introduce information on the quantized direction items into the encoded audio signal.

12 . The apparatus of claim 7 ,

wherein the downmixer is configured to perform an analysis of the direction information on the plurality of audio objects and to place one or more virtual microphones for the generation of the transport channels depending on a result of the analysis.

13 . The apparatus of claim 7 ,

wherein the downmixer is configured to downmix using a downmixing rule being static over the plurality of time frames, or

wherein the direction information is variable over a plurality of time frames, and wherein the downmixer is configured to downmix using a downmixing rule being variable over the plurality of time frames.

14 . The apparatus of claim 7 , wherein the downmixer is configured to downmix in a time domain using a sample-by-sample weighting and combining of samples of the plurality of audio objects.

15 . A decoder for decoding an encoded audio signal comprising one or more transport channels and direction information for a plurality of audio objects, the direction information comprising a first direction information and a second direction information, and, for one or more frequency bins of a time frame, parameter data for at least two relevant audio objects, wherein a number of the at least two relevant audio objects is lower than a total number of the plurality of audio objects, wherein the number of the at least two relevant audio objects is a selection from the total number of audio objects, wherein the total number of audio objects is not indicated as being relevant, the decoder comprising:

an input interface for providing the one or more transport channels in a spectral representation comprising, in the time frame, the plurality of frequency bins; and

an audio renderer for rendering the one or more transport channels into a number of audio channels using the direction information, so that a contribution from the one or more transport channels in accordance with the first direction information associated with a first one of the at least two relevant audio objects and in accordance with the second direction information associated with a second one of the at least two relevant audio objects is accounted for, or

an audio renderer for rendering the one or more transport channels into a number of audio channels using the direction information, the audio renderer being configured to calculate, for each one of the one or more frequency bins, a contribution from the one or more transport channels in accordance with the first direction information associated with a first one of the at least two relevant audio objects and in accordance with the second direction information associated with a second one of the at least two relevant audio objects.

16 . The decoder of claim 15 ,

wherein the audio renderer is configured to ignore, for the one or more frequency bins, a direction information of an audio object different from the at least two relevant audio objects.

17 . The decoder of claim 15 ,

wherein the encoded audio signal comprises an amplitude related measure for each relevant audio object or a combined value related to at least two relevant audio objects in the parameter data, and

wherein the audio renderer is configured to determine a quantitative contribution of the one or more transport channels in accordance with the amplitude-related measure or the combined value.

18 . The decoder of claim 17 , wherein the encoded signal comprises the combined value in the parameter data, and

wherein the audio renderer is configured to determine the contribution of the one or more transport channels using the combined value for one of the relevant audio objects and the direction information for the one relevant audio object, and

wherein the audio renderer is configured to determine the contribution for the one or more transport channels using a value derived from the combined value for another of the relevant audio objects in the one or more frequency bins and the direction information of the other relevant audio object.

19 . The decoder of claim 15 , wherein the audio renderer is configured to calculate a direct response information from the relevant audio objects per each frequency bin of the plurality of frequency bins and the direction information associated with the relevant audio objects in the frequency bins.

20 . The decoder of claim 19 ,

wherein the audio renderer is configured to determine a diffuse signal per each frequency bin of the plurality of frequency bins using a diffuseness information included in the metadata or a decorrelation rule and to combine a direct response as determined by the direct response information and the diffuse signal to acquire a spectral domain rendered signal for a channel of the number of channels, or

to calculate a synthesis information using the direct response information and an information on the number of audio channels, and to apply the covariance synthesis information to the one or more transport channels to acquire the number of audio channels, or

wherein the direct response information is a direct response vector for each relevant audio object, and wherein the covariance synthesis information is a covariance synthesis matrix, and wherein the audio renderer is configured to perform a matrix operation per frequency bin in applying the covariance synthesis information.

21 . The decoder of claim 19 , wherein the audio renderer is configured

to derive, in the calculation of the direct response information, a direct response vector for each relevant audio object and to calculate, for each relevant audio object, a covariance matrix from each direct response vector,

to derive, in the calculation of the covariance synthesis information, a target covariance information from

the covariance matrices from each one of the relevant audio objects,

a power information on the respective relevant audio object, and

a power information derived from the one or more transport channels.

22 . The decoder of claim 21 , wherein the audio renderer is configured

to derive, in the calculation of the direct response information, a direct response vector for each relevant audio object and to calculate, for each relevant audio object, a covariance matrix from each direct response vector,

to derive an input covariance information from the transport channels, and

to derive a mixing information from the target covariance information, the input covariance information and the information on the number of channels, and

to apply the mixing information to the transport channels for each frequency bin in the time frame.

23 . The decoder of claim 22 , wherein a result of the application of the mixing information for each frequency bin in the time frame is converted into a time domain to acquire the number of audio channels in the time domain.

24 . The decoder of claim 19 , wherein the audio renderer is configured

to only use main diagonal elements of an input covariance matrix derived from the transport channels in a decomposition of the input covariance matrix, or

to perform a decomposition of a target covariance matrix using a direct response matrix and a matrix of powers of the objects or transport channels, or

to perform a decomposition of the input covariance matrix by taking the root of each main diagonal element of the input covariance matrix, or

to calculate a regularized inverse of a decomposed input covariance matrix, or

to perform a singular value decomposition in calculating an optimum matrix to be used in an energy compensation without an extended identity matrix.

25 . A method of encoding a plurality of audio objects, comprising:

calculating, for one or more frequency bins of a plurality of frequency bins related to a time frame, parameter data for at least two relevant audio objects, wherein a number of the at least two relevant audio objects is lower than a total number of the plurality of audio objects, wherein the calculating comprises performing a selection of the number of the at least two relevant audio objects and not indicating the total number of audio objects as being relevant, and

outputting an encoded audio signal comprising information on the parameter data for the at least two relevant audio objects,

wherein the calculating comprises converting each audio object of the plurality of audio objects into a spectral representation comprising the plurality of frequency bins, calculating a selection information from each audio object for the one or more frequency bins, wherein the selection information is an amplitude-related measure for the audio object, calculating a combined value from two relevant audio objects of the at least two relevant audio objects, and deriving object identifications as the parameter data indicating the at least two relevant audio objects, based on the selection information, and wherein the outputting comprises outputting, in the encoded audio signal, information on the object identifications as the parameter data for the at least two relevant audio objects, and one or more information items on the combined value or on more combined values, wherein a number of information items on the combined value or on the more combined values is equal to at least one and is lower than the number of relevant audio objects for the one or more frequency bins, or

wherein the calculating comprises converting each audio object of the plurality of audio objects into a spectral representation comprising the plurality of frequency bins, calculating a selection information from each audio object for the one or more frequency bins, and selecting object identifications as the parameter data indicating the at least two relevant audio objects, based on an order of the selection information of the plurality of audio objects in the one or more frequency bins, and wherein the outputting comprises outputting, in the encoded audio signal, information on the object identifications for the at least two relevant audio objects as the parameter data, or

wherein the outputting comprises outputting, in the encoded audio signal, one or more encoded transport channels, as the parameter data, two or more encoded object identifications for the relevant audio objects for the one or more frequency bins of the plurality of frequency bins in the time frame, and one or more encoded combined values or encoded amplitude related measures, and quantized and encoded direction data for each audio object in the time frame, the direction data being constant for all frequency bins of the one or more frequency bins, or

wherein the calculating comprises calculating the parameter data for at least a most dominant object and a second most dominant object in the one or more frequency bins, wherein the most dominant object and the second most dominant object represent the relevant objects, or

wherein a number of audio objects of the plurality of audio objects is three or more, the plurality of audio objects comprising a first audio object, a second audio object and a third audio object, and wherein the calculating comprises calculating for a first one of the one or more frequency bins, as the relevant audio objects, only a first group of audio objects, and calculating, as the relevant audio objects for a second frequency bin of the one or more frequency bins, only a second group of audio objects, wherein the first group of audio objects is different from the second group of audio objects at least with respect to one group member, or

wherein the calculating comprises calculating raw parametric data with a first time or frequency resolution and combining the raw parametric data into combined parametric data comprising a second time or frequency resolution being lower than the first time of frequency resolution, and calculating the parameter data for the at least two relevant audio objects with respect to the combined parametric data comprising the second time or frequency resolution, or

determining parameter bands comprising a second time or frequency resolution being different from a first time or frequency resolution used in a time or frequency decomposition of the plurality of audio objects, and calculating the parameter data for the at least two relevant audio objects for the parameter bands comprising the second time or frequency resolution, or

wherein the plurality of audio objects comprise related metadata indicating direction information on the plurality of audio objects, and wherein the method further comprises: downmixing the plurality of audio objects to acquire one or more transport channels in response to the direction information on the plurality of audio objects; and encoding one or more transport channels to acquire one or more encoded transport channels; and wherein the outputting comprises outputting, in the encoded audio signal, the one or more transport channels.

26 . A method of decoding an encoded audio signal comprising one or more transport channels and direction information for a plurality of audio objects, the direction information comprising a first direction information and a second direction information, and, for one or more frequency bins of a time frame, parameter data for at least two relevant audio objects, wherein a number of the at least two relevant audio objects is lower than a total number of the plurality of audio objects, wherein the number of the at least two relevant audio objects is a selection from the total number of audio objects, wherein the total number of audio objects is not indicated as being relevant, the method of decoding comprising:

providing the one or more transport channels in a spectral representation comprising, in the time frame, the plurality of frequency bins; and

audio rendering the one or more transport channels into a number of audio channels using the direction information,

wherein the audio rendering comprises calculating, for each one of the one or more frequency bins, a contribution from the one or more transport channels in accordance with the first direction information associated with a first one of the at least two relevant audio objects and in accordance with the second direction information associated with a second one of the at least two relevant audio objects, or

wherein the audio rendering is performed so that a contribution from the one or more transport channels in accordance with the first direction information associated with a first one of the at least two relevant audio objects and in accordance with the second direction information associated with a second one of the at least two relevant audio objects is accounted for.

27 . A non-transitory digital storage medium having stored thereon a computer program for performing, when said computer program is run by a computer, a method of encoding a plurality of audio objects, the method of encoding comprising:

calculating, for one or more frequency bins of a plurality of frequency bins related to a time frame, parameter data for at least two relevant audio objects, wherein a number of the at least two relevant audio objects is lower than a total number of the plurality of audio objects, wherein the calculating comprises performing a selection of the number of the at least two relevant audio objects and not indicating the total number of audio objects as being relevant, and

outputting an encoded audio signal comprising information on the parameter data for the at least two relevant audio objects,

wherein the calculating comprises converting each audio object of the plurality of audio objects into a spectral representation comprising the plurality of frequency bins, calculating a selection information from each audio object for the one or more frequency bins, wherein the selection information is an amplitude-related measure for the audio object, calculating a combined value from two relevant audio objects of the at least two relevant audio objects, and deriving object identifications as the parameter data indicating the at least two relevant audio objects, based on the selection information, and wherein the outputting comprises outputting, in the encoded audio signal, information on the object identifications as the parameter data for the at least two relevant audio objects, and one or more information items on the combined value or on more combined values, wherein a number of information items on the combined value or on the more combined values is equal to at least one and is lower than the number of relevant audio objects for the one or more frequency bins, or

wherein the calculating comprises converting each audio object of the plurality of audio objects into a spectral representation comprising the plurality of frequency bins, calculating a selection information from each audio object for the one or more frequency bins, and selecting object identifications as the parameter data indicating the at least two relevant audio objects, based on an order of the selection information of the plurality of audio objects in the one or more frequency bins, and wherein the outputting comprises outputting, in the encoded audio signal, information on the object identifications for the at least two relevant audio objects as the parameter data, or

wherein the outputting comprises outputting, in the encoded audio signal, one or more encoded transport channels, as the parameter data, two or more encoded object identifications for the relevant audio objects for the one or more frequency bins of the plurality of frequency bins in the time frame, and one or more encoded combined values or encoded amplitude related measures, and quantized and encoded direction data for each audio object in the time frame, the direction data being constant for all frequency bins of the one or more frequency bins, or

wherein the calculating comprises calculating the parameter data for at least a most dominant object and a second most dominant object in the one or more frequency bins, wherein the most dominant object and the second most dominant object represent the relevant objects, or

wherein a number of audio objects of the plurality of audio objects is three or more, the plurality of audio objects comprising a first audio object, a second audio object and a third audio object, and wherein the calculating comprises calculating for a first one of the one or more frequency bins, as the relevant audio objects, only a first group of audio objects, and calculating, as the relevant audio objects for a second frequency bin of the one or more frequency bins, only a second group of audio objects, wherein the first group of audio objects is different from the second group of audio objects at least with respect to one group member, or

wherein the calculating comprises calculating raw parametric data with a first time or frequency resolution and combining the raw parametric data into combined parametric data comprising a second time or frequency resolution being lower than the first time of frequency resolution, and calculating the parameter data for the at least two relevant audio objects with respect to the combined parametric data comprising the second time or frequency resolution, or

determining parameter bands comprising a second time or frequency resolution being different from a first time or frequency resolution used in a time or frequency decomposition of the plurality of audio objects, and calculating the parameter data for the at least two relevant audio objects for the parameter bands comprising the second time or frequency resolution, or

wherein the plurality of audio objects comprise related metadata indicating direction information on the plurality of audio objects, and wherein the method further comprises: downmixing the plurality of audio objects to acquire one or more transport channels in response to the direction information on the plurality of audio objects; and encoding one or more transport channels to acquire one or more encoded transport channels; and wherein the outputting comprises outputting, in the encoded audio signal, the one or more transport channels.

28 . A non-transitory digital storage medium having stored thereon a computer program for performing a method of decoding an encoded audio signal comprising one or more transport channels and direction information for a plurality of audio objects, the direction information comprising a first direction information and a second direction information, and, for one or more frequency bins of a time frame, parameter data for at least two relevant audio objects, wherein a number of the at least two relevant audio objects is lower than a total number of the plurality of audio objects, wherein the number of the at least two relevant audio objects is a selection from the total number of audio objects, wherein the total number of audio objects is not indicated as being relevant, the method of decoding comprising:

providing the one or more transport channels in a spectral representation comprising, in the time frame, the plurality of frequency bins; and

audio rendering the one or more transport channels into a number of audio channels using the direction information,

wherein the audio rendering comprises calculating, for each one of the one or more frequency bins, a contribution from the one or more transport channels in accordance with the first direction information associated with a first one of the at least two relevant audio objects and in accordance with the second direction information associated with a second one of the at least two relevant audio objects, or

wherein the audio rendering is performed so that a contribution from the one or more transport channels in accordance with the first direction information associated with a first one of the at least two relevant audio objects and in accordance with the second direction information associated with a second one of the at least two relevant audio objects is accounted for,

when said computer program is run by a computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 28, 2023
From: EICHENSEER, ANDREA; KORSE, SRIKANTH; BAYER, STEFAN; KÜCH, FABIAN; THIERGART, OLIVER; FUCHS, GUILLAUME; WECKBECKER, DOMINIK; HERRE, JÜRGEN; MULTRUS, MARKUS
To: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 064092/0784 →
Priority Claims (3)
EP 20201633 · Oct 13, 2020 · regional
EP 20215651 · Dec 18, 2020 · regional
EP 21184367 · Jul 7, 2021 · regional
Continuity (2)
Continuation PCTEP2021078217 · Oct 12, 2021
Related Publication 20230298602A1 · Sep 21, 2023
References Cited (78)
US 7720230B2 · Allamanche et al. · 2010 [cited by applicant]
US 10249311B2 · Adami et al. · 2019 [cited by applicant]
US 20090326958A1 · Kim · 2009 [cited by applicant]
US 20100169103A1 · Pulkki · 2010 [cited by applicant]
US 20110029113A1 · Ishikawa et al. · 2011 [cited by applicant]
US 20120114126A1 · Thiergart · 2012 [cited by examiner]
US 20130013323A1 · Subbaraman et al. · 2013 [cited by applicant]
US 20150049872A1 · Virette et al. · 2015 [cited by applicant]
US 20150081312A1 · Subbaraman et al. · 2015 [cited by applicant]
US 20160064006A1 · Disch et al. · 2016 [cited by applicant]
US 20160104496A1 · Purnhagen · 2016 [cited by applicant]
US 20160125887A1 · Purnhagen · 2016 [cited by applicant]
US 20160142846A1 · Herre · 2016 [cited by applicant]
US 20160142853A1 · Herre et al. · 2016 [cited by applicant]
US 20160189718A1 · Davis · 2016 [cited by applicant]
US 20170251321A1 · Samuelsson et al. · 2017 [cited by applicant]
US 20200221230A1 · Fuchs · 2020 [cited by applicant]
CN 101506875A · 2009 [cited by applicant]
CN 101199121B · 2012 [cited by applicant]
CN 102176311B · 2014 [cited by applicant]
CN 104769671A · 2015 [cited by applicant]
CN 105229731A · 2016 [cited by applicant]
EP 2830050A1 · 2015 [cited by applicant]
EP 2702776B1 · 2015 [cited by applicant]
JP 2012198556A · 2012 [cited by applicant]
JP 2017199034A · 2017 [cited by applicant]
JP 6268180B2 · 2018 [cited by applicant]
JP 2020110007A · 2020 [cited by applicant]
RU 2339088C1 · 2008 [cited by applicant]
RU 2641481C2 · 2018 [cited by applicant]
TW 201207846A · 2012 [cited by applicant]
TW 201503112A · 2015 [cited by applicant]
TW 201923744A · 2019 [cited by applicant]
TW 202016925A · 2020 [cited by applicant]
TW 202032538A · 2020 [cited by applicant]
WO 2005086139A1 · 2005 [cited by applicant]
WO 2007074401A2 · 2007 [cited by applicant]
WO 2007111568A2 · 2007 [cited by applicant]
WO 2008131903A1 · 2008 [cited by applicant]
WO 2011110591A1 · 2011 [cited by applicant]
WO 2014053548A1 · 2014 [cited by applicant]
WO 2015011024A1 · 2015 [cited by applicant]
WO 2019067620A1 · 2019 [cited by applicant]
WO 2019068638A1 · 2019 [cited by applicant]
WO 2019097017A1 · 2019 [cited by applicant]
WO 2020084170A1 · 2020 [cited by applicant]
WO 2020152154A1 · 2020 [cited by applicant]
WO 2020249815A2 · 2020 [cited by applicant]
International Search Report and Written Opinion issued in application No. PCT/EP2021/078217. [cited by applicant]
Pulkki, V., et al.l; “Directional audio coding perception-based reproduction of spatial sound;” International Workshop on the Principles and Application on Spatial Hearing; Nov. 2009; pp. 1-4. [cited by applicant]
Herre, J., et al.; “MPEG spatial audio object coding—the ISO/MPEG standard for efficient coding of interactive audio scenes;” J. AES; vol. 60; No. 9; Sep. 2012; pp. 655-673. [cited by applicant]
Herre, J., et al.; “MPEG-H Audio—The new standard for universal spatial/3D audio coding;” Proc. 137th AES Conv; 2014; pp. 1-12. [cited by applicant]
Herre, J., et al.l; “MPEG-H 3D Audio—The New Standard for Coding of Immersive Spatial Audio;” IEEE Journal of Selected Topics in Signal Processing; vol. 9; No. 5; Aug. 2015; pp. 770-779. [cited by applicant]
“Information technology—High efficiency coding and media delivery in heterogeneous environments—Part 3: 3D audio;” Text of ISO/MPEG 23008-3/DIS 3D Audio, Sapporo, ISO/IEC JTC1/SC29/WG11 N14747; Jul. 2014; pp. 1-441. [cited by applicant]
Pulkki, V.; “Virtual sound source positioning using vector base amplitude panning;” J. Audio Eng. Soc.; vol. 45; No. 6; Jun. 1997; pp. 456-466. [cited by applicant]
Barber, C.B., et al.; “The quickhull algorithm for convex hulls;” Proc. ACM Trans. Math. Software (TOMS); vol. 22; Dec. 1996; pp. 469-483. [cited by applicant]
Hirvonen, T., et al.; “Perceptual compression methods for metadata in Directional Audio Coding applied to audiovisual teleconference;” AES 126th Convention 2009; May 2009; pp. 1-8. [cited by applicant]
Borß, C.; “A Polygon-Based Panning Method for 3D Loudspeaker Setups;” AES 137th Convention 2014; Oct. 2014; pp. 1-10. [cited by applicant]
Faller, C., et al.; “Efficient representation of spatial audio using perceptual parametrization;” Proceedings of the 2001 IEEE Workshop on the Applications of Signal Processing to Audio and Acoustics; Oct. 2001; pp. 199… [cited by applicant]
Purnhagen, H., et al.; “Immersive Audio Delivery Using Joint Object Coding;” 140th AES Convention, Paper No. 9587; May 2016; pp. 1-9. [cited by applicant]
Norling, K., et al.; “AC-4—The Next Generation Audio Codec;” 140th AES Convention, Paper No. 9491; May 2016; pp. 1-10. [cited by applicant]
Vilkamo, J., et al.; “Optimized covariance domain framework for time-frequency processing of spatial audio;” Journal of the Audio Engineering Society; vol. 61; No. 6; Jun. 2013; pp. 403-411. [cited by applicant]
Golub, G.H, et al.; “Matrix Computations;” Johns Hopkins University Press, 4th edition; 2013; pp. 1-780. [cited by applicant]
Japanese language office action dated Jul. 29, 2024, issued in application No. JP 2023-522513. [cited by applicant]
English language translation of office action issued in JP 2023-522513 (pp. 1-9 of attachment). [cited by applicant]
Japanese language office action dated Jul. 29, 2024, issued in application No. JP 2023-522519. [cited by applicant]
English language translation of office action issued in JP 2023-522519 (pp. 1-7 of attachment). [cited by applicant]
Office Action dated Jan. 17, 2025, issued in application No. IN 202337027043. [cited by applicant]
Russian language office action dated Oct. 17, 2023, issued in application No. RU 2023112160. [cited by applicant]
English language translation of office action dated Oct. 17, 2023 (pp. 1-5 of attachment). [cited by applicant]
Extended European Search Report dated Nov. 20, 2024, issued in application No. EP 24203322.3. [cited by applicant]
“MPEG audio technologies Part 2: Spatial Audio Object Coding (SAOC);” ISO/IEC JTC1/SC29/WG11 (MPEG) International Standard 23003-2; 2017; pp. 1-181. [cited by applicant]
Russian language office action dated Aug. 1, 2023, issued in application No. RU 2023112171. [cited by applicant]
English language translation of office action dated Aug. 1, 2023 (pp. 1-6 of attachment). [cited by applicant]
Japanese language office action dated Oct. 7, 2025, issued in application No. JP 2023-522519 (English language translation, pp. 1-4 of attachment). [cited by applicant]
Indian language office action dated Nov. 13, 2025, issued in application No. IN 202337027043 (English language translation included). [cited by applicant]
Engdegard, J., et al.; “Spatial Audio Object Coding (SAOC)—The Upcoming MPEG Standard on Parametric Object Based Audio Coding;” Journal of The Audio Engineering Society; 2008; pp. 1-15 https://api.semanticscholar.org/Co… [cited by applicant]
Chinese language office action dated Nov. 30, 2025, issued in application No. CN 202180077244.8 (English language translation, pp. 11-22 of attachment). [cited by applicant]