Direction estimation enhancement for parametric spatial audio capture using broadband estimates

1. An apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:

obtain at least two audio signals;

determine at least one direction of arrival parameter associated with at least one sound source of a sound field based on the at least two audio signals, wherein the at least one direction of arrival parameter at least in part represents a spatial impression of the at least one sound source within the sound field;

determine at least one direction of the at least one sound source of the sound field based on the at least two audio signals;

modify the at least one direction of arrival parameter in accordance with the determined at least one direction; and

output the modified at least one direction of arrival parameter.

2. The apparatus as claimed in claim 1 , wherein the apparatus being caused to obtain at least two audio signals comprises the apparatus being caused to obtain at least one of:

at least two microphone audio signals;

at least one ambisonic audio signal; and

at least one spatial audio signal, wherein the at least one spatial audio signal is associated with at least one metadata parameter, wherein the at least one metadata parameter comprises at least one of: a direction or direction-of-arrival; an energy ratio; or a diffuseness ratio.

3. The apparatus as claimed in claim 1 , wherein the apparatus being caused to determine at least one direction of arrival parameter comprises the apparatus being caused to determine at least one of:

at least one direction of arrival parameter of at least one propagating sound;

at least one direction of arrival parameter of at least one audio source;

at least one direction of arrival parameter of at least one reflection from at least one audio source; and

at least one energy ratio parameter associated with the at least one direction of arrival parameter.

4. The apparatus as claimed in claim 1 , wherein the apparatus being caused to determine at least one direction of arrival parameter comprises the apparatus being caused to determine the at least one direction of arrival parameter associated with at least one frequency band of the at least two audio signals.

5. The apparatus as claimed in claim 1 , wherein the at least one sound source of the sound field comprises at least one of:

a direct sound associated with at least one audio source within a space;

a reflected sound associated with at least one audio source within a space;

a sound associated with at least one virtual source;

a reverberation sound;

an ambient sound; and

a superposition of any of the direct sound, reflected sound, reverberation sound and ambient sound.

6. The apparatus as claimed in claim 1 , wherein the at least one sound source of the sound field is relative to a recording position from which the at least two audio signals is captured.

7. The apparatus as claimed in claim 1 wherein the apparatus being caused to determine the at least one direction of at least one sound source comprises the apparatus being caused to at least one of:

analyze at least one signal from at least one infra-red sensor to determine the at least one direction of at least one sound source;

analyze at least one signal from at least one sensor to determine the at least one direction of at least one sound source;

obtain at least one user-input signal identifying the at least one direction of at least one sound source;

obtain at least one positioning signal associated with an object, from which the at least one direction of at least one sound source is determined;

analyze the at least two audio signals, when the at least two audio signals comprise two or more microphone audio signals; and

obtain metadata associated with the at least two audio signals, the metadata comprising directional or location information, from which the at least one direction of the at least one sound source is determined when the at least one direction of arrival parameter is determined from an analysis of the at least two audio signals.

8. The apparatus as claimed in claim 1 , wherein the apparatus being caused to modify the at least one direction of arrival parameter causes the apparatus to:

determine an angular difference between the at least one direction of arrival parameter and the at least one direction of the at least one sound source; and

compare the angular difference against a threshold value, wherein where the angular difference is larger than the threshold value then the at least one direction of arrival parameter is passed unmodified but where the angular difference is smaller than the threshold value then the at least one direction of arrival parameter is modified towards the at least one direction of the at least one sound source.

9. The apparatus as claimed in claim 8 , wherein the apparatus being caused to modify the at least one direction of arrival parameter towards the at least one direction of the at least one sound source comprises the apparatus being caused to modify the at least one direction of arrival parameter to be at the at least one direction of the at least one sound source when the angular difference is less than a determined smaller threshold value and apply an interpolated modification to the at least one direction of arrival parameter when the angular difference is more than the determined smaller threshold value but less than the threshold value.

10. The apparatus as claimed in claim 1 , wherein the apparatus is further caused to at least one of:

determine at least one transport audio signal based on the at least two audio signals; and output the at least one transport audio signal with the modified at least one direction of arrival parameter; or

analyze the at least two audio signals, when the at least two audio signals comprise at least two microphone audio signals, to determine at least one metadata parameter, wherein the at least one metadata parameter comprises at least one of: an energy ratio; and a diffuseness ratio; and

output the at least one metadata parameter with the modified at least one direction of arrival parameter.

11. An apparatus comprising at least one processor and at least one memory including a computer program code, the at least one memory and the computer program code configured to, with the at least one processor, cause the apparatus at least to:

obtain at least two transport audio signals;

determine at least one direction of arrival parameter associated with at least one sound source of a sound field based on the at least two transport audio signals, wherein the at least one direction of arrival parameter at least in part represents a spatial impression of the at least one sound source within the sound field;

determine at least one direction of the at least one sound source of the sound field based on the at least two transport audio signals;

modify the at least one direction of arrival parameter in accordance with the determined at least one direction; and

output the modified at least one direction of arrival parameter.

12. A method comprising:

obtaining at least two audio signals;

determining at least one direction of arrival parameter associated with at least one sound source of a sound field based on the at least two audio signals, wherein the at least one direction of arrival parameter at least in part represents a spatial impression of the at least one sound source within the sound field;

determining at least one direction of the at least one sound source of the sound field based on the at least two audio signals;

modifying the at least one direction of arrival parameter in accordance with the determined at least one direction; and

outputting the modified at least one direction of arrival parameter.

13. The method as claimed in claim 12 , wherein determining the at least one direction of arrival parameter comprises determining the at least one direction of arrival parameter associated with at least one frequency band of the at least two audio signals.

14. The method as claimed in claim 12 , further comprises at least one of:

determining at least one transport audio signal based on the at least two audio signals; and outputting the at least one transport audio signal with the modified at least one direction of arrival parameter; or

analysing the at least two audio signals, when the at least two audio signals comprise at least two microphone audio signals, to determine at least one metadata parameter, wherein the at least one metadata parameter comprises at least one of: an energy ratio; and a diffuseness ratio; and

outputting the at least one metadata parameter with the modified at least one direction of arrival parameter.

15. The method as claimed in claim 12 , wherein determining the at least one direction of at least one sound source comprises at least one of:

analysing at least one signal from at least one infra-red sensor to determine the at least one direction of at least one sound source;

analysing at least one signal from at least one sensor to determine the at least one direction of at least one sound source;

obtaining at least one user-input signal identifying the at least one direction of at least one sound source;

obtaining at least one positioning signal associated with an object, from which the at least one direction of at least one sound source is determined;

analyzing the at least two audio signals, when the at least two audio signals comprise two or more microphone audio signals; and

obtaining metadata associated with the at least two audio signals, the metadata comprising directional or location information, from which the at least one direction of the at least one sound source is determined when the at least one direction of arrival parameter is determined from an analysis of the at least two audio signals.

16. The method as claimed in claim 12 , wherein modifying the at least one direction of arrival parameter comprises at least one of:

determining an angular difference between the at least one direction of arrival parameter and the at least one direction of the at least one sound source; and

comparing the angular difference against a threshold value, wherein where the angular difference is larger than the threshold value then the at least one direction of arrival parameter is passed unmodified but where the angular difference is smaller than the threshold value then the at least one direction of arrival parameter is modified towards the at least one direction of the at least one sound source.

17. A method comprising:

obtaining at least two transport audio signals;

determining at least one direction of arrival parameter associated with at least one sound source of a sound field based on the at least two transport audio signals, wherein the at least one direction of arrival parameter at least in part represents a spatial impression of the at least one sound source within the sound field;

determining at least one direction of the at least one sound source of the sound field based on the at least two transport audio signals;

modifying the at least one direction of arrival parameter in accordance with the determined at least one direction; and

outputting the modified at least one direction of arrival parameter.