IP Library Granted Patent US 11,115,739
Granted Patent B2
US 11,115,739 · App. 15/742,611 · Granted Sep 7, 2021

Capturing sound

Inventors: Miikka Vilermo (Siuro, FI); Mikko-Ville Laitinen (Helsinki, FI); Koray Ozcan (Farnborough Hampshire, GB)
Assignee: Nokia Technologies Oy
H04R1/005H04R1/406H04R3/005H04R5/027H04S7/30H04R2201/401H04S2400/15H04S2420/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,115,739
App. No.
15/742,611
Granted
Sep 7, 2021
Kind
B2
Abstract

An apparatus including a body, a plurality of microphones arranged in a predetermined geometry relative to the body such that the apparatus is configured to capture sound substantially from all directions around the body to produce direction and ambience information for the captured sound, and electronics for processing signals from the plurality of microphones.

Claims (41)

1. Apparatus comprising

a body,

a plurality of microphones arranged in a predetermined geometry on the body such that the apparatus is configured to capture a sound field in a plurality of directions around the body based on the predetermined geometry, wherein the plurality of microphones of the predetermined geometry are configured to enable capture of the sound field from any direction around the body such that substantially at least three microphones of the plurality of microphones receive sound without acoustic shadowing in any direction around the body while at least one other microphone of the plurality of microphones receives said sound with acoustic shadowing relative to a capture direction of said at least three microphones so as to ensure that sounds from the capture direction are captured without acoustic shadowing using the at least three microphones, and

electronics for processing signals from the plurality of microphones, where the electronics is configured to determine ambience information of the sound field and direction information of at least one sound source within said sound field around the body based, at least partially, upon the plurality of microphones.

2. An apparatus according to claim 1 , wherein the plurality of microphones are arranged such that a predefined minimum number of microphones is visible from any direction, and where the ambience information is determined separately from the direction information based, at least partially, upon the sound field as captured in the plurality of directions with the plurality of microphones, wherein the predetermined geometry is configured to enable the electronics to determine the ambience information of the sound field.

3. An apparatus according to claim 1 , where the plurality of microphones comprises at least eight microphones arranged such that sound from any direction is captured with at least four of the at least eight microphones while at least two other microphones of the plurality of microphones are substantially shadowed.

4. An apparatus according to claim 1 , further comprising a plurality of second type of sensors, wherein the predetermined geometry and/or a number of the plurality of microphones forming the predetermined geometry depends on location and/or number of the plurality of second type of sensors.

5. An apparatus according to claim 4 , wherein the plurality of second type of sensors comprise cameras and/or motion sensors.

6. An apparatus according to claim 1 , wherein the body has a substantially spherical outer shape.

7. An apparatus according to claim 1 , wherein the plurality of microphones are arranged symmetrically around the body.

8. An apparatus according to claim 1 , wherein the plurality of microphones are arranged in at least one of:

a manner relative to the body such that sound is captured with each microphone;

a manner relative to the electronics such that sound signals from each microphone is subjected to a similar disturbance cause with other components and/or delays within the apparatus; or

a manner such that no directing of the body is required in use.

9. An apparatus according to claim 1 , comprising a protruding element extending from the body at a location where the element and/or use of the element causes least interference for the sound field capture.

10. An apparatus according to claim 9 , wherein the protruding element is for controlling the direction of the body and/or handling the apparatus and/or indicating a preferred direction.

11. An apparatus according to claim 1 , wherein the determined ambience information and the determined direction information are configured to be used for reproduction of said sound field for playback, wherein the electronics is configured to at least one of:

produce a predetermined number of sound channels for reproduction based on the signals received from the plurality of microphones;

generate at least one signal for a reproduction device included in the body of the apparatus; or

at least in part, generate at least one signal for a reproduction device external to the body of the apparatus.

12. An apparatus according to claim 1 , wherein the predetermined geometry is at least one of:

formed with at least eight microphones of the plurality of microphones; or

substantially a cube geometry and each microphone of the plurality of microphones is located at a corner of the cube geometry.

13. An apparatus according to claim 1 further comprising:

a plurality of video cameras on the body arranged in a further predetermined geometry relative to the body such that the apparatus is configured to capture video around the body,

where the plurality of microphones are arranged relative to the plurality of video cameras, and where the apparatus is configured to associate different subsets of the plurality of microphones with each respective one of the plurality of video cameras, and

where the electronics for processing the signals received from the plurality of microphones determine the ambience information and the direction information based, at least partially, upon the video camera associated with the subsets of the plurality of microphones.

14. An apparatus according to claim 1 , further comprising:

one or more speakers configured to render sound.

15. A method for capturing sound, comprising:

capturing a sound field with a plurality of microphones, located in a predetermined geometry on a body of a capture apparatus, from a plurality of directions around the body based on the predetermined geometry, wherein the plurality of microphones of the predetermined geometry are configured to enable capture of the sound field from any direction around the body such that substantially at least three microphones of the plurality of microphones receive sound without acoustic shadowing in any direction around the body while at least one other microphone of the plurality of microphones receives said sound with acoustic shadowing relative to a capture direction of said at least three microphones so as to ensure that sounds from the capture direction are captured without acoustic shadowing using the at least three microphones, and

processing signals from the plurality of microphones, where the processing of the signals from the plurality of microphones is configured to produce direction information of at least one sound source within said sound field and ambience information of said sound field around the body based, at least partially, upon the plurality of microphones.

16. A method according to claim 15 , wherein the plurality of microphones are arranged such that a predefined minimum number of microphones is visible from any direction, and where the ambience information is determined based, at least partially, upon the sound field as captured in the plurality of directions with the plurality of microphones.

17. A method according to claim 15 , further comprising capturing information with a plurality of second type of sensors, wherein the predetermined geometry and/or a number of the plurality of microphones forming the predetermined geometry depends on location and/or number of the plurality of second type of sensors.

18. A method according to claim 17 , wherein the plurality of second type of sensors comprise cameras and/or motion sensors.

19. A method according to claim 16 , comprising capturing the sound field in one of:

a same manner with each of the predefined minimum number of microphones; or

from different directions and/or from moving sources of sound without changing a direction and/or position of the body.

20. A method as in claim 15 where the capture apparatus comprises a plurality of video cameras on the body arranged in a predetermined geometry relative to the body such that the apparatus is configured to capture video around the body, where the method further comprises associating different subsets of the plurality of microphones with each respective one of the plurality of video cameras, and processing the signals received from the plurality of microphones based, at least partially, upon the video camera associated with the subsets of the plurality of microphones.

21. A method according to claim 15 , further comprising:

rendering sound with one or more speakers associated with the capture apparatus.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 15, 2018
From: VILERMO, MIIKKA; LAITINEN, MIKKO-VILLE; OZCAN, KORAY
To: NOKIA TECHNOLOGIES OY
Reel/Frame 044619/0324 →
Priority Claims (2)
GB 1511949 · Jul 8, 2015 · national
GB 1513198 · Jul 27, 2015 · national
Continuity (1)
Related Publication 20180206039A1 · Jul 19, 2018
Cited By (1)
US 12,652,488