Granted Patent B2

US 12,744,046 · App. 18/823,006 · Granted Sep 22, 2026

Inventors: Guillaume Fuchs (Bubenreuth, DE); Jürgen Herre (Erlangen, DE); Fabian Küch (Erlangen, DE); Stefan Döhla (Erlangen, DE); Markus Multrus (Nuremberg, DE); Oliver Thiergart (Erlangen, DE); Oliver Wübbolt (Hannover, DE); Florin Ghido (Nuremberg, DE); Stefan Bayer (Nuremberg, DE); Wolfgang Jaegers (Nuremberg, DE)

Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.

G10L19/008G10L19/0204G10L19/032G10L19/038G10L19/167G10L19/26H03M7/3082H03M7/6005H03M7/6011

Abstract

Claims (47)

1 . An apparatus for encoding, comprising:

an interface for receiving directional audio coding parameters comprising diffuseness parameters and direction parameters; and

a parameter calculator for calculating the diffuseness parameters with a first time or frequency resolution and for calculating the direction parameters with a second time or frequency resolution.

2 . The apparatus of claim 1 , wherein the parameter calculator is configured to calculate the diffuseness parameters and the direction parameters so that the first time resolution is lower than the second time resolution, or the second frequency resolution Is greater than the first frequency resolution, or the first time resolution is lower than the second time resolution and the first frequency resolution is equal to the second frequency resolution, or

wherein the parameter calculator is configured to calculate the diffuseness parameters and the direction parameters for a set of frequency bands, wherein a band having a lower center frequency is narrower than a band having a higher center frequency, or

wherein the parameter calculator is configured to obtain initial diffuseness parameters having a third time or frequency resolution and to obtain initial direction parameters having a fourth time or frequency resolution, and wherein the parameter calculator is configured to group and average the initial diffuseness parameters so that the third time or frequency resolution is higher than the first time or frequency resolution, or wherein the parameter calculator is configured to group and average the initial direction parameters so that the fourth time or frequency resolution is higher than the second time or frequency resolution.

3 . The apparatus of claim 1 ,

wherein the parameter calculator is configured to calculate the initial direction parameters so that the initial direction parameters each comprise a Cartesian vector having a component for each of two or three directions, and wherein the parameter calculator is configured to perform the averaging for each individual component of the Cartesian vector separately, or wherein the components are normalized so that the sum of squared components of the Cartesian vector for a direction parameter is equal to unity.

4 . The apparatus of claim 3 , further comprising:

a time-frequency decomposer for decomposing an input signal having a plurality of input channels into a time-frequency representation for each input channel, or

wherein the time-frequency decomposer is configured for decomposing the input signal having a plurality of input channels into a time-frequency representation for each input channel having the third time or frequency resolution or the fourth time or frequency resolution.

5 . The apparatus of claim 1 ,

wherein the apparatus is configured to associate an indication of the first or the second time or frequency resolution into the quantized and encoded representation for transmission to a decoder or for storage, or

comprising a quantizer and encoder processor for generating a quantized and encoded representation of the diffuseness parameters and the direction parameters, wherein the quantizer and encoder processor comprises a parameter quantizer for quantizing the diffuseness parameters and the direction parameters and a parameter encoder for encoding quantized diffuseness parameters and quantized direction parameters.

6 . A method for encoding, the method comprising:

receiving directional audio coding parameters comprising diffuseness parameters and direction parameters; and

calculating the diffuseness parameters with a first time or frequency resolution and calculating the direction parameters with a second time or frequency resolution.

7 . A decoder for decoding, comprising:

a parameter processor for decoding encoded directional audio coding parameters comprising encoded diffuseness parameters and encoded direction parameters to obtain decoded diffuseness parameters with a first time or frequency resolution and decoded direction parameters with a second time or frequency resolution, the second time or frequency resolution being different from the first time or frequency resolution; and

a parameter resolution converter for converting the encoded or decoded diffuseness parameters or the encoded or decoded direction parameters into converted diffuseness parameters or converted direction parameters having a third time or frequency resolution.

8 . The decoder of claim 7 , further comprising an audio renderer operating in a spectral domain, the spectral domain comprising, for a frame, a first number of time slots and a second number of frequency bands, so that a frame comprises a number of time/frequency bins being equal to a multiplication result of the first number and the second number, wherein the first number and the second number define the third time or frequency resolution, or

further comprising an audio renderer operating in a spectral domain, the spectral domain comprising, for a frame, a first number of time slots and a second number of frequency bands, so that a frame comprises a number of time/frequency bins being equal to a multiplication result of the first number and the second number, wherein the first number and the second number define a fourth time-frequency resolution, wherein the fourth time or frequency resolution is higher than the third time or frequency resolution, or

wherein the first time or frequency resolution is lower than the second time or frequency resolution, and wherein the parameter resolution converter is configured to generate, from a decoded diffuseness parameter, a first multitude of converted diffuseness parameters and to generate, from a decoded direction parameter, a second multitude of converted direction parameters, wherein the second multitude is greater than the first multitude, or

wherein the encoded audio signal comprises a sequence of frames, wherein each frame is organized in frequency bands, wherein each frame comprises only one encoded diffuseness parameter per frequency band and at least two time-sequential direction parameters per frequency band, and wherein the parameter resolution converter is configured to associate the decoded diffuseness parameter to all time bins in the frequency band or to each time/frequency bin included in the frequency band in the frame, and to associate one direction parameter of the at least two time-sequential direction parameters of the frequency band to a first group of time bins included in the frequency band, and to associate a second direction parameter of the at least two direction parameters to a second group of the time bins included in the frequency band, wherein the second group of the time bins does not include any of the time bins in the first group of the time bins, or

wherein the encoded audio signal comprises an encoded audio transport signal, wherein the decoder comprises: an audio decoder for decoding the encoded transport audio signal to obtain a decoded audio signal, and a time/frequency converter for converting the decoded audio signal into a frequency representation having the third time or frequency resolution.

9 . The decoder of claim 8 , comprising:

an audio renderer for applying the converted diffuseness parameters and the converted direction parameters to the frequency representation of the decoded audio signal in the third time or frequency resolution to obtain a synthesis spectrum representation; and

a spectrum/time converter for converting the synthesis spectrum representation in the third or fourth time or frequency resolution to obtain a synthesized time domain spatial audio signal having a time resolution being higher than the resolution of the third time or frequency resolution.

10 . The decoder of claim 7 ,

wherein the parameter resolution converter is configured to copy a decoded direction parameter or to copy a decoded diffuseness parameter or to smooth or low pass filter a set of copied direction parameters or a set of copied diffuseness parameters.

11 . The decoder of claim 7 , wherein the second time or frequency resolution is different from the first time or frequency resolution, or

wherein the first time resolution is lower than the second time resolution, or the second frequency resolution is greater than the first frequency resolution, or the first time resolution is lower than the second time resolution and the first frequency resolution is equal to the second frequency resolution, or

wherein the parameter resolution converter is configured to copy the decoded diffuseness parameters and decoded direction parameters into a corresponding number of frequency adjacent converted parameters for a set of bands, wherein a band having a lower center frequency receives less copied parameters than a band having a higher center frequency, or

wherein the parameter processor is configured to decode an encoded diffuseness parameter for a frame of the encoded audio signal to obtain a quantized diffuseness parameter for the frame, and wherein the parameter processor is configured to determine a dequantization precision for the dequantization of at least one direction parameter for the frame using the quantized or dequantized diffuseness parameter, and wherein the parameter processor is configured to dequantize a quantized direction parameter using the dequantization precision.

12 . The decoder of claim 7 , wherein the parameter processor is configured to determine, from a dequantization precision, to be used by the parameter processor for dequantizing, a decoding alphabet for decoding an encoded direction parameter for a frame, and

wherein the parameter processor is configured to decode the encoded direction parameter using the determined decoding alphabet and to determine a dequantized direction parameter.

13 . The decoder of claim 7 , wherein the parameter processor is configured to determine, from a dequantization precision to be used by the parameter processor for dequantizing the direction parameter, an elevation alphabet for the processing of an encoded elevation parameter and to determine, from an elevation index obtained using the elevation alphabet, an azimuth alphabet, and

wherein the parameter processor is configured to dequantize an encoded azimuth parameter using the azimuth alphabet.

14 . A method of decoding, the method comprising:

decoding encoded directional audio coding parameters comprising encoded diffuseness parameters and encoded direction parameters to obtain decoded diffuseness parameters with a first time or frequency resolution and decoded direction parameters with a second time or frequency resolution, the second time or frequency resolution being different from the first time or frequency resolution; and

converting the encoded or decoded diffuseness parameters or the encoded or decoded direction parameters into converted diffuseness parameters or converted direction parameters having a third time or frequency resolution.

15 . A non-transitory storage medium having stored there on a computer program for performing, when running on a computer or a processor, a method of encoding, the method comprising:

receiving directional audio coding parameters comprising diffuseness parameters and direction parameters; and

calculating the diffuseness parameters with a first time or frequency resolution and calculating the direction parameters with a second time or frequency resolution.

16 . A non-transitory storage medium having stored there on a computer program for performing, when running on a computer or a processor, a method of decoding, the method comprising:

decoding encoded directional audio coding parameters comprising encoded diffuseness parameters and encoded direction parameters to obtain decoded diffuseness parameters with a first time or frequency resolution and decoded direction parameters with a second time or frequency resolution, the second time or frequency resolution being different from the first time or frequency resolution; and

converting the encoded or decoded diffuseness parameters or the encoded or decoded direction parameters into converted diffuseness parameters or converted direction parameters having a third time or frequency resolution.

Assignments (1)

Priority Claims (1)

Continuity (4)

References Cited (123)