Granted Patent B2

US 12,369,008 · App. 18/482,478 · Granted Jul 22, 2025

Inventors: Guillaume Fuchs (Erlangen, DE); Oliver Thiergart (Erlangen, DE); Srikanth Korse (Erlangen, DE); Stefan Döhla (Erlangen, DE); Markus Multrus (Erlangen, DE); Fabian Küch (Erlangen, DE); Alexandre Bouthéon (Erlangen, DE); Andrea Eichenseer (Erlangen, DE); Stefan Bayer (Erlangen, DE)

Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FÖRDERUNG DER ANGEWANDTEN FORSCHUNG E.V.

H04S7/307G10L19/02G10L19/0212H04N19/119H04N19/176H04N19/593H04S2400/01H04S2420/11H04S2420/13

Abstract

Claims (52)

1. Apparatus for generating a sound field description using an input signal comprising a mono-signal or a multi-channel signal, the apparatus comprising:

an input signal analyzer for analyzing the input signal to derive direction data and diffuseness data;

a low-order components generator for generating a low-order sound field description from the input signal up to a predetermined order and mode, wherein the low-order components generator is configured to derive the low-order sound field description by copying or taking the input signal or performing a weighted combination of the channels of the input signal;

a mid-order components generator for generating a mid-order sound field description above the predetermined order or at the predetermined order and above the predetermined mode and below or at a high order using a synthesis of at least one direct portion and of at least one diffuse portion using the direction data and the diffuseness data so that the mid-order sound field description comprises a direct contribution and a diffuse contribution; and

a high-order components generator for generating a high-order sound field description comprising a sound field component above the high order using a synthesis of at least one direct portion, wherein the high-order sound field description comprises a direct contribution only,

wherein the input signal comprises at least two channels, and wherein the low-order components generator is configured to generate a zero order Ambisonics signal by adding the two channels and to generate a first order Ambisonics signal based on a difference of the two channels, or

wherein the input signal comprises an A-format signal comprising four channels, and wherein the low-order components generator is configured to calculate a first order Ambisonics signal by performing a weighted linear combination of the four channels, or

wherein the low-order components generator is configured to perform an energy compensation to one or more sound field components of the low-order sound field description to compensate for an energy loss due to the high-order sound field description only comprising the direct contribution, and wherein the energy compensation depends on the diffuseness data and at least one of a number of sound field components generated by the high-order components generator, a number of diffuse components generated by the low-order components generator and/or the mid-order components generator, a maximum order of sound field components generated by the low-order components generator and/or the mid-order components generator and a maximum order of the number of sound field components generated by the high-order components generator, the number of sound field components generated by the high-order components generator being one or greater than one; or

wherein the low-order components generator comprises: an estimator for estimating a first energy-or amplitude-related measure for an omnidirectional component derived from the input signal and for estimating a second energy-or amplitude-related measure for a directional component derived from the input signal; and wherein the low-order components generator is configured to perform an energy compensation of the directional component using the first energy-or amplitude-related measure, the second energy- or amplitude-related measure, the direction data and the diffuseness data, or

wherein the low-order components generator comprises an energy compensator for performing an energy compensation, the energy compensator comprising a compensation gain calculator for calculating a compensation gain using the diffuseness data, a maximum order of the sound field components of a first group and a maximum order of the sound field components of a second group, wherein the maximum order of the sound field components of the second group depends on the number of sound field components in the second group.

2. Apparatus of claim 1 , wherein the input signal analyzer is configured to extract the diffuseness data from metadata associated with the input signal or to extract the diffuseness data from the input signal by a signal analysis of the input signal.

3. Apparatus for generating a sound field description using an input signal comprising a mono-signal or a multi-channel signal, the apparatus comprising:

an input signal analyzer for analyzing the input signal to derive direction data and diffuseness data;

a low-order components generator for generating a low-order sound field description from the input signal up to a predetermined order and mode, wherein the low-order components generator is configured to derive the low-order sound field description by copying or taking the input signal or performing a weighted combination of the channels of the input signal;

a mid-order components generator for generating a mid-order sound field description above the predetermined order or at the predetermined order and above the predetermined mode and below or at a high order using a synthesis of at least one direct portion and of at least one diffuse portion using the direction data and the diffuseness data so that the mid-order sound field description comprises a direct contribution and a diffuse contribution;

a high-order components generator for generating a high-order sound field description comprising a sound field component above the high order using a synthesis of at least one direct portion, wherein the high-order sound field description comprises a direct contribution only; and

a directional gain calculator for the sound field component of the high-order sound field description configured for evaluating a spatial basis function for an order and a mode of the sound field component of the high-order sound field description to derive a directional gain, and wherein the high-order components generator is configured to derive the sound field component from a reference signal and the directional gain.

4. Apparatus of claim 3 , wherein the input signal comprises a first order Ambisonics signal with three or four channels, and wherein the low-order components generator is configured to generate a first order Ambisonics signal by taking or copying the three or four channels of the input signal.

5. Apparatus of claim 1 , wherein the high-order components generator is configured to only synthesize, as the direct contribution, a direct portion for the sound field component of the high-order sound field description using the direction data.

6. Apparatus of claim 3 , wherein the input signal comprises the mono signal, and wherein the low-order components generator is configured to generate a zero order Ambisonics signal by taking or copying the mono signal.

7. Apparatus of claim 3 , wherein the high-order components generator is configured to multiply the reference signal by the directional gain for the order and mode of the sound field component and to multiply by a factor derived from the diffuseness data to acquire the sound field component of the high-order sound field description.

8. The apparatus of claim 1 , wherein the mid-order components generator is configured to perform an energy compensation to the at least one diffuse portion of the mid-order sound field description or to a sound field component of the mid-order sound field description to compensate for an energy loss due to the high-order sound field description only comprising the direct contribution, and

wherein the energy compensation depends on the diffuseness data and at least one of the number of sound field components generated by the high-order components generator, a number of diffuse components generated by the low-order components generator and/or the mid-order components generator, a maximum order of sound field components generated by the low-order components generator and/or the mid-order components generator and a maximum order of sound field components generated by the high-order components generator.

9. Apparatus of claim 1 , wherein the first group of sound field components and the second group of sound field components are orthogonal to each other.

10. Apparatus of claim 1 , wherein the sound field components are at least one of coefficients of orthogonal basis functions, coefficients of spatial basis functions, and coefficients of spherical or circular harmonics.

11. Apparatus of claim 1 , wherein the sound field components are Ambisonics coefficients.

12. Apparatus of claim 1 further comprising:

an analysis filter bank for generating the one or more sound field components of the first group and the second group for a plurality of different time-frequency tiles,

wherein the input signal analyzer is configured to acquire a direction data item and a diffuseness data item for each time-frequency tile, and

wherein the low-order components generator, the mid-order components generator, or the high-order components generator is configured to operate separately for each time-frequency tile.

13. Method for generating a sound field description using an input signal comprising a mono-signal or a multi-channel signal, comprising:

analyzing the input signal to derive direction data and diffuseness data;

generating a low-order sound field description from the input signal up to a predetermined order and mode, wherein the generating the low-order sound field description comprises deriving the low-order sound field description by copying the input signal or performing a weighted combination of the channels of the input signal;

generating a mid-order sound field description above the predetermined order or at the predetermined order and above the predetermined mode and below a high order using a synthesis of at least one direct portion and of at least one diffuse portion using the direction data and the diffuseness data so that the mid-order sound field description comprises a direct contribution and a diffuse contribution; and

generating a high-order sound field description comprising a component at or above the high order using a synthesis of at least one direct portion without any diffuse component synthesis so that the high-order sound field description comprises a direct contribution only,

wherein the input signal comprises at least two channels, and wherein the generating a low-order sound field description comprises generating a zero order Ambisonics signal by adding the two channels and generating a first order Ambisonics signal based on a difference of the two channels, or

wherein the input signal comprises an A-format signal comprising four channels, and wherein the generating a low-order sound field description comprises calculating a first order Ambisonics signal by performing a weighted linear combination of the four channels, or

wherein the generating a low-order sound field description comprises performing an energy compensation to one or more sound field components of the low-order sound field description to compensate for an energy loss due to the high-order sound field description only comprising the direct contribution, and wherein the energy compensation depends on the diffuseness data and at least one of a number of sound field components generated by the generating a high-order sound field description, a number of diffuse components generated by the generating a low-order sound field description and/or the generating a mid-order sound field description, a maximum order of sound field components generated by the generating a low-order sound field description and/or the generating a mid-order sound field description and a maximum order of sound field components generated by the generating a high-order sound field description; or

wherein the generating a low-order sound field description comprises: estimating a first energy-or amplitude-related measure for an omnidirectional component derived from the input signal and estimating a second energy-or amplitude-related measure for a directional component derived from the input signal; and performing an energy compensation of the directional component using the first energy-or amplitude-related measure, the second energy- or amplitude-related measure, the direction data and the diffuseness data, or

wherein the generating a low-order sound field description comprises performing an energy compensation comprising calculating a compensation gain using the diffuseness data, a maximum order of the sound field components of a first group and a maximum order of the sound field components of a second group, wherein the maximum order of the sound field components of the second group depends on the number of sound field components in the second group, or

wherein the method comprises calculating a directional gain for the sound field component of the high-order sound field description comprising evaluating a spatial basis function for an order and a mode of the sound field component of the high-order sound field description to derive a directional gain, and wherein the generating a high-order sound field description comprises deriving the sound field component from a reference signal and the directional gain.

14. A non-transitory digital storage medium having a computer program stored thereon to perform, when said computer program is run by a computer, the method for generating a sound field description using an input signal comprising a mono-signal or a multi-channel signal, the method comprising:

analyzing the input signal to derive direction data and diffuseness data;

generating a low-order sound field description from the input signal up to a predetermined order and mode, wherein the generating the low-order sound field description comprises deriving the low-order sound field description by copying the input signal or performing a weighted combination of the channels of the input signal;

generating a mid-order sound field description above the predetermined order or at the predetermined order and above the predetermined mode and below a high order using a synthesis of at least one direct portion and of at least one diffuse portion using the direction data and the diffuseness data so that the mid-order sound field description comprises a direct contribution and a diffuse contribution; and

generating a high-order sound field description comprising a component at or above the high order using a synthesis of at least one direct portion without any diffuse component synthesis so that the high-order sound field description comprises a direct contribution only,

wherein the input signal comprises at least two channels, and wherein the generating a low-order sound field description comprises generating a zero order Ambisonics signal by adding the two channels and generating a first order Ambisonics signal based on a difference of the two channels, or

wherein the input signal comprises an A-format signal comprising four channels, and wherein the generating a low-order sound field description comprises calculating a first order Ambisonics signal by performing a weighted linear combination of the four channels, or

wherein the generating a low-order sound field description comprises performing an energy compensation to one or more sound field components of the low-order sound field description to compensate for an energy loss due to the high-order sound field description only comprising the direct contribution, and wherein the energy compensation depends on the diffuseness data and at least one of a number of sound field components generated by the generating a high-order sound field description, a number of diffuse components generated by the generating a low-order sound field description and/or the generating a mid-order sound field description, a maximum order of sound field components generated by the generating a low-order sound field description and/or the generating a mid-order sound field description and a maximum order of sound field components generated by the generating a high-order sound field description; or

wherein the generating a low-order sound field description comprises: estimating a first energy-or amplitude-related measure for an omnidirectional component derived from the input signal and estimating a second energy- or amplitude-related measure for a directional component derived from the input signal; and performing an energy compensation of the directional component using the first energy- or amplitude-related measure, the second energy- or amplitude-related measure, the direction data and the diffuseness data, or

wherein the generating a low-order sound field description comprises performing an energy compensation comprising calculating a compensation gain using the diffuseness data, a maximum order of the sound field components of a first group and a maximum order of the sound field components of a second group, wherein the maximum order of the sound field components of the second group depends on the number of sound field components in the second group, or

wherein the method comprises calculating a directional gain for the sound field component of the high-order sound field description comprising evaluating a spatial basis function for an order and a mode of the sound field component of the high-order sound field description to derive a directional gain, and wherein the generating a high-order sound field description comprises deriving the sound field component from a reference signal and the directional gain.

Assignments (1)

Priority Claims (1)

Continuity (3)

References Cited (131)