Granted Patent B2

US 12,389,159 · App. 18/012,543 · Granted Aug 12, 2025

Inventors: Juha Vilkamo (Helsinki, FI); Mikko-Ville Laitinen (Espoo, FI)

Assignee: Nokia Technologies Oy

H04R3/005H04R3/04H04R5/027H04S7/30H04R2201/401H04R2410/01H04R2410/07H04R2430/01H04S2400/15

Abstract

Claims (64)

1. An apparatus comprising:

at least one processor; and

at least one memory storing instructions that, when executed with the at least one processor, cause the apparatus at least to:

obtain at least two microphone audio signals;

determine audio data comprising different directivity configurations that are able to capture sound from substantially a same or similar direction;

determine at least one value related to sound arriving from at least the same or similar direction based on the audio data;

determine further audio data comprising at least one configuration which provides a more omnidirectional directivity configuration than the audio data;

determine at least one value related to sound based on the further audio data; and

determine at least one spatial noise suppression parameter based on the at least one value related to sound arriving from the same or similar direction and the at least one value related to sound based on the further audio data, wherein the at least one spatial noise suppression parameter is configured to be applied to the at least two microphone audio signals in a generation of at least one playback audio signal.

2. The apparatus as claimed in claim 1 , wherein the instructions, when executed with the at least one processor, cause the apparatus to determine at least one first audio signal combination or selection from the at least two microphone audio signals and at least one second audio signal combination or selection from the at least two microphone audio signals.

3. The apparatus as claimed in claim 2 , wherein the instructions, when executed with the at least one processor, cause the apparatus to process at least one of:

the at least one first audio signal combination or selection; or

the at least one second audio signal combination or selection.

4. The apparatus as claimed in claim 3 , wherein the instructions, when executed with the at least one processor, cause the apparatus to at least one of:

select and equalize the at least one first audio signal combination or selection;

select and equalize the at least one second audio signal combination or selection;

weight and combine the at least one first audio signal combination or selection; or

weight and combine the at least one second audio signal combination or selection.

5. The apparatus as claimed in claim 2 , wherein the instructions, when executed with the at least one processor, cause the apparatus to determine the at least one value related to an amount of sound arriving from the same or similar direction based on the at least one first audio signal combination or selection and at least one second audio signal combination or selection.

6. The apparatus as claimed in claim 2 , wherein the instructions, when executed with the at least one processor, cause the apparatus to determine at least one further audio signal combination or selection from the at least two microphone audio signals, the at least one further audio signal combination or selection providing more omnidirectional audio signal capture than at least one of the at least one first audio signal combination or selection from the at least two microphone audio signals and the at least one second audio signal combination or selection.

7. The apparatus as claimed in claim 6 , wherein the instructions, when executed with the at least one processor, cause the apparatus to determine at least one value related to sound based on further audio data which further causes the apparatus to determine at least one value related to sound based on the at least one further audio signal combination or selection.

8. The apparatus as claimed in claim 2 , wherein the at least first audio signal combination or selection and the at least one second audio signal combination or selection represents spatially selective audio signals steered with respect to the same or similar direction but having different spatial configurations.

9. The apparatus as claimed in claim 2 , wherein

the instructions, when executed with the at least one processor, cause the apparatus to determine the at least one first audio signal combination or selection for at least two frequency bands and the at least one second audio signal combination or selection for the at least two frequency bands,

the instructions, when executed with the at least one processor, cause the apparatus to determine at least one target value based on the at least one first audio signal combination and at least one second audio signal combination for the at least two frequency bands,

the instructions, when executed with the at least one processor, cause the apparatus to determine at least one further audio signal combination or selection for the at least two frequency bands,

the instructions, when executed with the at least one processor, cause the apparatus to determine the at least one overall value based on the at least one further audio signal combination or selection for the at least two frequency bands, and

the instructions, when executed with the at least one processor, cause the apparatus to determine the at least one spatial noise suppression parameter based on the at least one target value and the at least one overall value for the at least two frequency bands.

10. The apparatus as claimed in claim 5 , wherein the instructions, when executed with the at least one processor, cause the apparatus to determine at least one of:

at least one target energy value;

at least one target normalised amplitude value; or

at least one target prominence value.

11. The apparatus as claimed in claim 7 , wherein the instructions, when executed with the at least one processor, cause the apparatus to determine at least one of:

at least one overall energy value;

at least one overall normalised amplitude value; or

at least one overall prominence value, such that the apparatus is caused to determine the at least one spatial noise suppression parameter based on the at least one value related to sound arriving from the same or similar direction and the at least one value related to the sound and cause the apparatus to determine the at least one spatial noise suppression parameter based on a ratio between the at least one value related to sound arriving from the same or similar direction and the at least one value related to the sound.

12. The apparatus as claimed in claim 6 , wherein the at least one second audio signal combination or selection is the at least one further audio signal combination or selection.

13. The apparatus as claimed in claim 8 , wherein the different spatial configurations comprise one of:

different directivity patterns;

different beam patterns; or

different spatial selectivity.

14. The apparatus as claimed in claim 1 , wherein the instructions, when executed with the at least one processor, cause the apparatus to determine at least one first set of weights and at least one second set of weights, such that when the at least one first set of weights and the at least one second set of weights are applied to the microphone audio signals, a produced signal combination or selection represents sound from substantially a same or similar direction.

15. The apparatus as claimed in claim 14 , wherein the instructions, when executed with the at least one processor, cause the apparatus to determine the at least one value related to sound arriving from the same or similar direction based on the at least one first set of weights, the at least one second set of weights, and at least one determined covariance matrix based on the least two microphone audio signals.

16. The apparatus as claimed in claim 14 , wherein the instructions, when executed with the at least one processor, cause the apparatus to determine at least one third set of weights, such that when applied to the microphone audio signals a produced signal combination or selection represents sound which provides a more omnidirectional audio signal than the produced signal when at least one of the at least one first set of weights or the at least one second set of weights are applied to the microphone audio signals.

17. The apparatus as claimed in claim 15 , wherein the instructions, when executed with the at least one processor, cause the apparatus to determine the at least one value related to sound based on at least one third set of weights and at least one determined covariance matrix based on the least two microphone audio signals.

18. The apparatus as claimed in claim 15 , wherein the instructions, when executed with the at least one processor, cause the apparatus to:

time-frequency domain transform the at least two microphone audio signals; and

determine the at least one covariance matrix based on the time-frequency domain transform of the at least two microphone audio signals.

19. The apparatus as claimed in claim 1 , wherein the instructions, when executed with the at least one processor, cause the apparatus to:

spatially noise suppression process the at least two microphone audio signals based on the at least one spatial noise suppression parameter.

20. The apparatus as claimed in claim 19 , wherein the instructions, when executed with the at least one processor, cause the apparatus to at least one of:

apply a microphone signal equalization to the at least two microphone audio signals;

apply a microphone noise reduction to the at least two microphone audio signals;

apply a wind noise reduction to the at least two microphone audio signals;

apply an automatic gain control to the at least two microphone audio signals; or

generate at least two output audio signals based on the spatially noise suppression process of the at least two microphone audio signals.

21. A method comprising:

obtaining at least two microphone audio signals;

determining audio data comprising different directivity configurations that are able to capture sound from substantially a same or similar direction;

determining at least one value related to sound arriving from at least the same or similar direction based on the audio data;

determining further audio data comprising at least one configuration which provides a more omnidirectional directivity configuration than the audio data;

determining at least one value related to sound based on the further audio data; and

determining at least one spatial noise suppression parameter based on the at least one value related to sound arriving from the same or similar direction and the at least one value related to sound based on the further audio data, wherein the at least one spatial noise suppression parameter is configured to be applied to the at least two microphone audio signals in a generation of at least one playback audio signal.

22. A non-transitory program storage device readable with an apparatus, tangibly embodying a program of instructions executable with the apparatus for performing the operations of claim 21 .

Assignments (1)

Priority Claims (1)

Continuity (1)

References Cited (12)