IP Library Granted Patent US 11,109,154
Granted Patent B2
US 11,109,154 · App. 17/002,122 · Granted Aug 31, 2021

Method and apparatus for dynamic reduction of camera body acoustic shadowing in wind noise processing

Inventor: Erich Tisch (San Francisco, CA)
Assignee: GoPro, Inc.
H04R3/005G10L21/0232G10L21/0272G10L25/51H04N5/2258H04R1/406H04R29/005G10L2021/02166H04R2410/01H04R2499/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,109,154
App. No.
17/002,122
Granted
Aug 31, 2021
Kind
B2
Abstract

An image capture device includes a processor for wind noise processing. The processor receives signals from a first microphone, a first plurality of microphones, and a second plurality of microphones. The processor may segment each signal into low frequency bins and high frequency bins. The processor may select a minimum level signal bin for each low frequency bin. For the high frequency bins, the processor may select a minimum level signal bin for a first group of microphones or a second group of microphones. The processor may generate a composite signal by combining the selected minimum level signal bins for each low frequency bin and the selected minimum level signal bins for each high frequency bin.

Claims (49)

1. An image capture device comprising:

a first image sensor facing a first direction, the first image sensor configured to obtain first image data;

a second image sensor facing a second direction, the second direction being diametrically opposed to the first direction, the second image sensor configured to obtain second image data;

a microphone facing the first direction;

a first plurality of microphones facing the second direction;

a second plurality of microphones facing a third direction that is perpendicular to the first and second directions; and

a processor configured to:

receive a signal from the microphone, the first plurality of microphones, and the second plurality of microphones;

segment each signal into low frequency bins and high frequency bins;

select a minimum level signal bin for each low frequency bin;

for the high frequency bins, determine a minimum level signal bin for a first group of microphones comprising the microphone, the first plurality of microphones, and the second plurality of microphones, and determine a minimum signal level bin for a second group of microphones comprising the second plurality of microphones;

determine a difference between the minimum level signal bin of the first group of microphones and the minimum level signal bin of the second group of microphones;

select a minimum level signal bin for each high frequency bin based on the difference; and

generate a composite signal by combining the selected minimum level signal bins for each low frequency bin and the selected minimum level signal bins for each high frequency bin.

2. The image capture device of claim 1 , wherein the first plurality of microphones comprises three microphones.

3. The image capture device of claim 1 , wherein the second plurality of microphones experience lower acoustic shadowing than the first plurality of microphones.

4. The image capture device of claim 1 , wherein the processor is configured to select the minimum level signal bin for each low frequency bin from the microphone, the first plurality of microphones, and the second plurality of microphones.

5. The image capture device of claim 1 , wherein the difference between the minimum level signal bin of the first group of microphones and the minimum level signal bin of the second group of microphones is greater than a threshold, the processor further configured to select the minimum level signal bin of the first group of microphones.

6. The image capture device of claim 1 , wherein the difference between the minimum level signal bin of the first group of microphones and the minimum level signal bin of the second group of microphones is less than a threshold, the processor further configured to select the minimum level signal bin of the second group of microphones.

7. The image capture device of claim 1 , wherein the low frequency bins comprise signals having frequencies less than 1200 Hz and the high frequency bins comprise signals having frequencies greater than 1200 Hz.

8. A method comprising:

receiving signals from a plurality of microphones;

segmenting each signal into low frequency bins and high frequency bins;

selecting, for each low frequency bin, a minimum level signal bin for each signal from the plurality of microphones;

processing, for each high frequency bin, signals from the plurality of microphones and signals from a subset of the plurality of microphones;

comparing the signals from the plurality of microphones and the signals from the subset of the plurality of microphones;

selecting, for each high frequency bin, a minimum signal level bin for each signal from the plurality of microphones or a minimum signal level bin for each signal from the subset of the plurality of microphones; and

concatenating the selected minimum level signal bins of the low frequency bins with the selected minimum level signal bins of the high frequency bins.

9. The method of claim 8 , further comprising determining a difference between the minimum level signal bin of the plurality of microphones and the minimum level signal bin of the subset of the plurality of microphones.

10. The method of claim 9 , wherein on a condition that the difference is greater than a threshold, selecting the minimum level signal bin of the plurality of microphones for each high frequency bin.

11. The method of claim 9 , wherein on a condition that the difference is less than a threshold, selecting the minimum level signal bin of the subset of the plurality of microphones.

12. The method of claim 8 , wherein the subset of the plurality of microphones is based on an image capture device orientation or geometry.

13. The method of claim 8 , wherein the subset of the plurality of microphones include a pair of microphones on a top surface of a body of an image capture device.

14. The method of claim 8 , wherein the processing includes filtering the signals to remove low level noise.

15. An integrated circuit comprising:

a first extractor configured to receive signals from a microphone, a first plurality of microphones, and a second plurality of microphones and segment each signal into low frequency bins and high frequency bins;

a second extractor configured to receive the signals from the microphone, the first plurality of microphones, and the second plurality of microphones and segment each signal into low frequency bins and high frequency bins;

a first sampler configured to select a minimum level signal bin for each low frequency bin;

a second sampler for the high frequency bins, the second sampler configured to determine a minimum level signal bin for a first group of microphones comprising the microphone, the first plurality of microphones, and the second plurality of microphones,

a third sampler for the high frequency bins, the third sampler configured to determine a minimum signal level bin for a second group of microphones comprising the second plurality of microphones;

a comparator configured to determine a difference between the minimum level signal bin of the first group of microphones and the minimum level signal bin of the second group of microphones;

a switch configured to select a minimum level signal bin for each high frequency bin based on the difference; and

a concatenator configured to generate a composite signal by combining the selected minimum level signal bins for each low frequency bin and the selected minimum level signal bins for each high frequency bin.

16. The integrated circuit of claim 15 , wherein the difference between the minimum level signal bin of the first group of microphones and the minimum level signal bin of the second group of microphones is greater than a threshold, and the switch is further configured to select the minimum level signal bin of the first group of microphones.

17. The integrated circuit of claim 15 , wherein the difference between the minimum level signal bin of the first group of microphones and the minimum level signal bin of the second group of microphones is less than a threshold, and the switch is further configured to select the minimum level signal bin of the second group of microphones.

18. The integrated circuit of claim 15 further comprising:

a router configured to receive the signals from the microphone, the first plurality of microphones, and the second plurality of microphones and output a subset of signals.

19. The integrated of claim 18 , wherein the subset of signals comprises signals from the second group of microphones.

20. The integrated circuit of claim 15 , wherein the comparator is configured to transmit a control signal to the switch.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Feb 15, 2023
From: TISCH, ERICH
To: GOPRO, INC.
Reel/Frame 062707/0929 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Oct 19, 2020
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 054113/0594 →
Continuity (2)
Provisional Application 62900903 · Sep 16, 2019
Related Publication 20210084409A1 · Mar 18, 2021