IP Library › Granted Patent US 9,781,507
Granted Patent B2
US 9,781,507 · App. 14/782,409 · Granted Oct 3, 2017

Audio apparatus

Inventors: Jorma Mäkinen (Tampere, FI); Anu Huttunen (Tampere, FI); Mikko Tammi (Tampere, FI); Miikka Vilermo (Siuro, FI)
Assignee: Nokia Technologies Oy
H04R1/406H04R3/005H04S1/00G10L21/0216H04R2203/12H04R2420/07H04R2430/23H04R2499/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,781,507
App. No.
14/782,409
Granted
Oct 3, 2017
Kind
B2
Abstract

An apparatus comprising: an input configured to receive at least two groups of at least two audio signals; a first audio former configured to generate a first formed audio signal from a first of the at least two groups of at least two audio signals; a second audio former configured to generate a second formed audio signal from the second of the at least two groups of at least two audio signals; an audio analyzer configured to analyze the first formed audio signal and the second formed audio signal to determine at least one audio source and an associated audio source signal; and an audio signal synthesizer configured to generate at least one output audio signal based on the at least one audio source and the associated audio source signal.

Claims (38)

1. A method comprising:

receiving at least two groups of at least two audio signals wherein the at least two audio signals for each group are provided from at least two closely spaced microphones;

generating a first formed audio signal from a first of the at least two groups of the at least two audio signals towards a recording direction;

generating a second formed audio signal from the second of the at least two groups of the at least two audio signals towards the same recording direction;

analysing the first formed audio signal and the second formed audio signal to estimate a direction of at least one audio source and determine an associated audio source signal; and

generating at least one output audio signal based on the associated audio source signal.

2. The method as claimed in claim 1 , wherein the first group of the at least two audio signals are a front left and back left microphone; and generating the first formed audio signal from the first of the at least two groups of the at least two audio signals comprises generating a virtual left microphone signal.

3. The method as claimed in claim 1 , wherein the second group of the at least two audio signals are a front right and back right microphone; and generating the second formed audio signal from the second of the at least two groups of the at least two audio signals comprises generating a virtual right microphone signal.

4. The method as claimed in claim 1 , wherein analysing the first formed audio signal and the second formed audio signal to determine at least one audio source and the associated audio source signal comprises determining at least one source location.

5. The method as claimed in claim 4 , further comprising:

receiving a source displacement factor; and

processing the at least one source location by the source displacement factor such that the source location is displaced away from the audio mid-line by the source displacement factor.

6. The method as claimed in claim 5 , wherein receiving the source displacement factor can comprise generating the source displacement factor based on a zoom factor associated with a camera configured to capture at least one frame image substantially when receiving the at least two groups of the at least two audio signals.

7. The method as claimed in claim 4 , wherein generating at least one output audio signal based on the at least one audio source and the associated audio source signal comprises generating the at least one output audio signal based on the at least one audio source location.

8. The method as claimed in claim 7 , wherein generating the at least one output audio signal based on the at least one audio source location comprises: determining at least-one output audio signal location; and audio panning the at least one audio source signal based on the at least one audio source location to generate the at least one output audio signal at the at least one output audio signal location.

9. The method as claimed in claim 1 , wherein generating the first formed audio signal from the first of the at least two groups of the at least two audio signals comprises generating a first beamformed audio signal from the first of the at least two groups of the at least two audio signals; and generating the second formed audio signal from the second of the at least two groups of the at least two audio signals comprises generating a second beamformed audio signal from the second of the at least two groups of the at least two audio signals.

10. The method as claimed in claim 1 , wherein generating the first formed audio signal from the first of the at least two groups of the at least two audio signals comprises generating a first mixed audio signal from the first of the at least two groups of the at least two audio signals such that the first mixed audio signal creates a first order gradient pattern with a first direction; and generating the second formed audio signal from the second of the at least two groups of the at least two audio signals comprises generating a second mixed audio signal from the second of the at least two groups of the at least two audio signals such that the second mixed audio signal creates a further first order gradient pattern with a second direction.

11. The method as claimed in claim 1 , wherein the analyzing further comprises analyzing the first formed audio signal and the second formed audio signal to estimate a direction of at least one audio source in the recording direction.

12. An apparatus comprising at least one processor and at least one memory including computer code for one or more programs, the at least one memory and the computer code configured to with the at least one processor cause the apparatus to at least:

receive at least two groups of at least two audio signals wherein the at least two audio signals for each group are provided from at least two closely spaced microphones;

generate a first formed audio signal from a first of the at least two groups of the at least two audio signals towards a recording direction;

generate a second formed audio signal from the second of the at least two groups of the at least two audio signals towards the same recording direction;

analyse the first formed audio signal and the second formed audio signal to estimate a direction of at least one audio source and determine an associated audio source signal; and

generate at least one output audio signal based on the associated audio source signal.

13. The apparatus as claimed in claim 12 , wherein the first group of the at least two audio signals are a front left and back left microphone; and generating the first formed audio signal from the first of the at least two groups of the at least two audio signals causes the apparatus to generate a virtual left microphone signal.

14. The apparatus as claimed in claim 12 , wherein the second group of the at least two audio signals are a front right and back right microphone; and generating the second formed audio signal from the second of the at least two groups of the at least two audio signals causes the apparatus to generate a virtual right microphone signal.

15. The apparatus as claimed in claim 12 , wherein analysing the first formed audio signal and the second formed audio signal to determine at least one audio source and the associated audio source signal causes the apparatus to determine at least one source location.

16. The apparatus as claimed in claim 15 , further causes to: receive a source displacement factor; and process the at least one source location by the source displacement factor such that the source location is displaced away from the audio mid-line by the source displacement factor.

17. The apparatus as claimed in claim 16 , wherein receiving the source displacement factor causes the apparatus to generate the source displacement factor based on a zoom factor associated with a camera configured to capture at least one frame image substantially when receiving the at least two groups of the at least two audio signals.

18. The apparatus as claimed in claim 15 , wherein generating at least one output audio signal based on the at least one audio source and the associated audio source signal causes the apparatus to generate the at least one output audio signal based on the at least one audio source location.

19. The apparatus as claimed in claim 18 , wherein generating the at least one output audio signal based on the at least one audio source location causes the apparatus to: determine at least one output audio signal location; and audio pan the at least one audio source signal based on the at least one audio source location to generate the at least one output audio signal at the at least one output audio signal location.

20. An apparatus comprising:

an input configured to receive at least two groups of at least two audio signals wherein the at least two audio signals for each group are provided from at least two closely spaced microphones;

a first audio former configured to generate a first formed audio signal from a first of the at least two groups of the at least two audio signals towards a recording direction;

a second audio former configured to generate a second formed audio signal from the second of the at least two groups of the at least two audio signals towards the same recording direction;

an audio analyser configured to analyse the first formed audio signal and the second formed audio signal to estimate a direction of at least one audio source and determine an associated audio source signal; and

an audio signal synthesiser configured to generate at least one output audio signal based on the associated audio source signal.

21. The apparatus as claimed in claim 20 , wherein the audio signal synthesiser comprises: an output location determiner configured to determine at least one output audio signal location; and an amplitude panner configured to pan the at least one audio source signal based on the at least one audio source location to generate the at least one output audio signal at the at least one output audio signal location.

Assignments (2)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2015
From: MÄKINEN, JORMA; HUTTUNEN, ANU; TAMMI, MIKKO; VILERMO, MIIKKA
To: NOKIA CORPORATION
Reel/Frame 036726/0648 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Oct 5, 2015
From: NOKIA CORPORATION
To: NOKIA TECHNOLOGIES OY
Reel/Frame 036726/0698 →
Continuity (1)
Related Publication 20160044410A1 · Feb 11, 2016