IP Library Granted Patent US 11,356,786
Granted Patent B2
US 11,356,786 · App. 17/002,131 · Granted Jun 7, 2022

Method and apparatus for wind noise detection and beam pattern processing

Inventors: Erich Tisch (San Francisco, CA); Eric Penrod (Brentwood, CA); Mark Hardin (Guerneville, CA); Timothy Dick (San Francisco, CA); Hakim Mesiwala (Cupertino, CA)
Assignee: GoPro, Inc.
H04R29/005H04N5/2258H04R1/08H04R2410/07H04R2499/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,356,786
App. No.
17/002,131
Granted
Jun 7, 2022
Kind
B2
Abstract

An image capture device includes a sensor, a microphone array, and a processor. The microphone array may include a first microphone, a second microphone, a third microphone, or any combination thereof. The first microphone may be configured to face a first direction. The second microphone may be configured to face a second direction. The second direction may be diametrically opposed to the first direction. The third microphone may be configured to face a third direction. The third direction may be substantially perpendicular to the first direction, the second direction, or both. The processor may be configured to determine a microphone capture pattern and detect wind noise. The microphone capture pattern may be determined based on data obtained from the sensor. The sensor data may include image data, audio data, image capture device orientation data, location data, accelerometer data, or any combination thereof.

Claims (46)

1. An image capture device comprising:

a first image sensor facing a first direction, the first image sensor configured to obtain first image data;

a second image sensor facing a second direction, the second direction being diametrically opposed to the first direction, the second image sensor configured to obtain second image data;

a first microphone assembly facing the first direction, wherein the first microphone assembly comprises a first microphone and a second microphone;

a second microphone assembly facing the second direction, wherein the second microphone assembly comprises a third microphone;

a third microphone assembly facing a third direction that is perpendicular to the first and second directions, wherein the third microphone assembly comprises a fourth microphone and a fifth microphone; and

a processor configured to:

determine an activity based on at least one of the first image data or the second image data;

determine a microphone capture pattern using at least two microphones based on the activity; and

detect wind noise based on a coherence value between the at least two microphones.

2. The image capture device of claim 1 , wherein the microphone capture pattern is created using the first microphone assembly, the second microphone assembly, or the third microphone assembly.

3. The image capture device of claim 1 , wherein the microphone capture pattern is created using the first microphone and the second microphone, and the at least two microphones comprise the first microphone and the second microphone.

4. The image capture device of claim 1 , wherein the microphone capture pattern is created using the first microphone and the second microphone, and the at least two microphones comprise the fourth microphone and the fifth microphone.

5. The image capture device of claim 1 , wherein the microphone capture pattern is created using the third microphone, and the at least two microphones comprise the fourth microphone and the fifth microphone.

6. The image capture device of claim 1 , wherein the microphone capture pattern is created using the fourth microphone and the fifth microphone, and the at least two microphones comprise the first microphone and the second microphone.

7. The image capture device of claim 1 , wherein the microphone capture pattern is created using the fourth microphone and the fifth microphone, and the at least two microphones comprise the fourth microphone and the fifth microphone.

8. The image capture device of claim 1 , wherein the processor is further configured to segment a signal from each of the at least two microphones into bins to detect wind noise.

9. The image capture device of claim 1 , wherein the processor is further configured to determine whether the coherence value is below a threshold.

10. The image capture device of claim 9 , wherein on a condition that the coherence value is below the threshold, the processor is further configured to determine that wind noise is present.

11. The image capture device of claim 9 , wherein on a condition that the coherence value is above the threshold, the processor is further configured to determine that wind noise is not present.

12. A method comprising:

obtaining first image data from a first image sensor facing a first direction;

obtaining second image data from a second image sensor facing a second direction, the second direction being diametrically opposed to the first direction;

determining an activity based on at least one of the first image data or the second image data;

determining a microphone capture pattern using at least two microphones based on the activity; and

detecting wind noise based on a coherence value between the at least two microphones.

13. The method of claim 12 , wherein detecting wind noise comprises:

segmenting a signal from each of the at least two microphones into bins;

determining, for each bin, the coherence value between the at least two microphones; and

determining whether the coherence value is below a threshold.

14. The method of claim 13 further comprising:

determining that wind noise is present on a condition that the coherence value is below a threshold; and

transitioning the microphone capture pattern to a wind processing mode.

15. The method of claim 13 , wherein a first set of bins may be processed differently than a second set of bins, wherein the first set of bins is for wind processing.

16. The method of claim 12 , wherein the coherence value is a measurement of correlation for each bin of a signal between two microphones.

17. An image capture device comprising:

a sensor;

a first microphone assembly facing a first direction;

a second microphone assembly facing a second direction, the second direction being diametrically opposed to the first direction;

a third microphone assembly facing a third direction that is perpendicular to the first and second directions; and

a processor configured to:

determine an activity based on image data; and

determine a microphone capture pattern and a microphone assembly for wind noise detection based on the activity and data obtained from the sensor.

18. The image capture device of claim 17 , wherein the sensor is an inertial measurement unit (IMU).

19. The image capture device of claim 17 , wherein the microphone capture pattern is associated with a sound field of the first microphone assembly, and the microphone assembly for wind noise detection is the third microphone assembly.

20. The image capture device of claim 17 , wherein the microphone capture pattern is associated with a sound field of the first microphone assembly, and the microphone assembly for wind noise detection is the first microphone assembly.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 23, 2023
From: TISCH, ERICH; PENROD, ERIC; HARDIN, MARK; DICK, TIMOTHY; MESIWALA, HAKIM
To: GOPRO, INC.
Reel/Frame 062784/0921 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
Continuity (2)
Provisional Application 62900936 · Sep 16, 2019
Related Publication 20210084422A1 · Mar 18, 2021