Granted Patent B2

US 12,538,073 · App. 18/218,840 · Granted Jan 27, 2026

Inventors: Timothy Dick (San Francisco, CA); Eric Steven Penrod (Brentwood, CA); Erich Tisch (San Francisco, CA)

Assignee: GoPro, Inc.

H04R3/005H04R1/028H04R1/406H04R29/005H04R2201/401H04R2410/01H04R2410/07H04R2430/03H04R2499/11

Abstract

Claims (54)

1 . An image capture device comprising:

a housing comprising:

a forward wall;

an integrated sensor and lens assembly that is configured to capture a video, the integrated sensor and lens assembly extending through the forward wall of the housing,

a rear wall located opposite the forward wall, and

a top wall connecting the forward wall and the rear wall;

three or more microphones configured to capture sound, wherein the three or more microphones comprise a first microphone, a second microphone, and a third microphone; and

a processor configured to:

receive sound from the three or more microphones in conjunction with the video as the video is captured and to estimate a direction of arrival, reduce or remove wind noise, perform beamforming, or a combination thereof,

select one of a first microphone, a second microphone, or a third microphone of the three or more microphones with a lowest amount of the wind noise based upon the sound captured by the three or more microphones, and

divide the sound captured by the three or more microphones into individual frequency sub-bands so that the direction of arrival is estimated based on the sound captured by the three or more microphones,

wherein the first microphone is located on or within the forward wall adjacent to the integrated sensor and lens assembly, the second microphone is located on or within the rear wall so that the second microphone is spaced apart from the first microphone, and the third microphone is spaced apart from the first microphone and the second microphone.

2 . The image capture device of claim 1 , wherein the first microphone, the second microphone, and the third microphone are located with respect to the housing to form vertices of a triangle.

3 . The image capture device of claim 2 , wherein the triangle is an equilateral triangle.

4 . The image capture device of claim 1 , wherein the first microphone and the second microphone are located directly opposite one another with respect to the housing so that the first microphone and the second microphone are spaced a distance apart that is equal to a thickness of the image capture device.

5 . The image capture device of claim 4 , wherein the first microphone is located in a corner of the forward wall and the second microphone is located in a corner of the rear wall.

6 . The image capture device of claim 1 , wherein the three or more microphones comprise a drainage microphone.

7 . The image capture device of claim 1 , wherein the forward wall includes a drainage channel.

8 . An image capture device comprising:

a housing;

an integrated sensor and lens assembly, extending through a first wall of the housing, that is configured to capture a video;

three or more microphones configured to capture sound in conjunction with capturing the video, wherein a first microphone is located on or within the first wall of the housing adjacent to the integrated sensor and lens assembly and a second microphone is located on or within a second wall that is located opposite the first wall; and

a processor configured to:

monitor the sound captured by the three or more microphones;

divide the sound captured by the three or more microphones into individual frequency sub-bands;

estimate an azimuth and an elevation for the individual frequency sub-bands;

calculate angles for the individual frequency sub-bands based upon the azimuth, the elevation, or both;

estimate a direction of arrival of the sound captured by the three or more microphones based upon the angles for the individual frequency sub-bands from the sound captured by the three or more microphones; and

select one of the first microphone, the second microphone, or a third microphone of the three or more microphones with a lowest amount of wind noise based upon the sound captured by the three or more microphones.

9 . The image capture device of claim 8 , wherein the three of more microphones are located on or within the housing in a shape of a triangle.

10 . The image capture device of claim 8 , wherein the first wall comprising the first microphone is a rear wall, a top wall, or a forward wall of the housing, and wherein the third microphone is located on the top wall, the forward wall, or a side wall of the housing.

11 . The image capture device of claim 10 , wherein the three or more microphones are located in a straight line.

12 . The image capture device of claim 8 , wherein the processor is configured to calculate the angles for the individual frequency sub-bands by statistically calculating an angle of a given sound in each of the individual frequency sub-bands.

13 . The image capture device of claim 12 , wherein the processor is configured to calculate the angles by analyzing a time block from a single microphone or two or more of the three or more microphones.

14 . The image capture device of claim 8 , wherein the processor is configured to report the angles to provide a direction of sounds within a predetermined frequency range.

15 . A method comprising:

capturing, with an integrated sensor and lens assembly of an image capture device, a video;

monitoring capture of microphone signals, during the capturing of the video, for three or more microphones in the image capture device, wherein a first microphone is located on a first wall of the image capture device and a second microphone is located on a second wall of the image capture device directly opposite the first wall;

applying beamforming delays and weights to the microphone signals based on microphone array geometry to determine a desired polar response;

reducing wind noise by switching the capture of the microphone signals between the three or more microphones or by combining the microphone signals captured by the three or more microphones;

estimating a direction of arrival of sound captured by the three or more microphones as the microphone signals; and

generating frequency sub-bands from the microphone signals to determine a noise metric of the frequency sub-bands, wherein a frequency sub-band with a lowest noise metric is selected from the frequency sub-bands.

16 . The method of claim 15 , further comprising:

plotting frequencies of the sound captured to generate the desired polar response.

17 . The method of claim 15 , further comprising:

receiving the sound through a channel; and

determining a signal to noise ratio (SNR) of the channel.

18 . The method of claim 15 , further comprising:

splitting the microphone signals to generate time blocks, and

splitting the time blocks into the frequency sub-bands before estimating the direction of arrival of the sound.

19 . The method of claim 15 , further comprising:

processing the microphone signals to generate virtual audio channels.

20 . The method of claim 19 , further comprising:

combining the virtual audio channels into an audio stream.

Assignments (3)

Continuity (2)

References Cited (12)