IP Library Granted Patent US 11,589,178
Granted Patent B2
US 11,589,178 · App. 17/245,517 · Granted Feb 21, 2023

Generating an audio signal from multiple microphones based on uncorrelated noise detection

Inventors: Erich Tisch (San Francisco, CA); Joyce Rosenbaum (Mountain View, CA); Magnus Hansson (Los Altos, CA); Ke Li (San Jose, CA); David Wurtz (Santa Clara, CA)
Assignee: GoPro, Inc.
H04R29/005G06F3/165H04R1/083H04R3/005H04R5/027G06V10/462H04R1/406H04R2410/01H04R2410/07H04R2430/03H04R2430/21H04R2499/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,589,178
App. No.
17/245,517
Granted
Feb 21, 2023
Kind
B2
Abstract

An audio capture device selects between multiple microphones to generate an output audio signal depending on detected conditions. The audio capture device determines whether one or more microphones are wet or dry and selects one or more audio signals from the one or more microphones depending on their respective conditions. The audio capture device generates a mono audio output signal or a stereo output signal depending on the respective conditions of the one or more microphones.

Claims (56)

1. A method for generating an output audio signal in an audio capture device, the method comprising:

determining that a first reference microphone of the audio capture device is wet;

determining that a second reference microphone of the audio capture device is wet;

selecting a first audio signal from a drainage microphone of the audio capture device, wherein the drainage microphone is adjacent to a drainage channel for draining liquid away from the drainage channel; and

generating a first mono audio output signal based on the first audio signal.

2. The method of claim 1 , further comprising:

determining that the audio capture device is submerged in liquid;

selecting a second audio signal from the first reference microphone and a third audio signal from the second reference microphone; and

generating a second mono audio output signal based on the second audio signal and the third audio signal.

3. The method of claim 2 , wherein determining that the audio capture device is submerged in liquid comprises:

performing an image analysis to detect visual features representative of the audio capture device being submerged.

4. The method of claim 2 , wherein determining that the audio capture device is submerged in liquid comprises:

detecting, via a touch screen integrated with the audio capture device, a change in capacitance indicative of the audio capture device being submerged.

5. The method of claim 1 , wherein determining that the both the first reference microphone and the second reference microphone are wet comprises:

detecting that a spectral response change over a predefined frequency range meets a predefined criteria.

6. The method of claim 1 , wherein determining that the both the first reference microphone and the second reference microphone are wet comprises:

detecting a sound pattern indicative of a wet microphone condition.

7. A non-transitory computer readable storage medium storing instructions for generating an output audio signal in an audio capture device, the instructions when executed by a processor cause the processor to perform steps including:

determine whether a first reference microphone of the audio capture device is wet or dry;

determine whether a second reference microphone of the audio capture device is wet or dry; and

on a condition that the first reference microphone and the second reference microphone are determined to be dry, select a first audio signal from the first reference microphone, select a second audio signal from the second reference microphone, and generating a stereo audio output signal by processing the first and second audio signals.

8. The non-transitory computer readable storage medium of claim 7 , the instructions when executed further causing the processor to perform steps including:

on a condition that the first reference microphone and the second reference microphone are determined to be wet, select a third audio signal from a drainage microphone, and generate a first mono audio output signal based on the third audio signal.

9. The non-transitory computer readable storage medium of claim 8 , the instructions when executed further causing the processor to perform steps including:

determine if the audio capture device is submerged in liquid; and

responsive to a determination that the audio capture device is submerged in liquid, select the first audio signal from the first reference microphone and the second audio signal from the second reference microphone, and generate a second mono audio output signal based on the first audio signal and the second audio signal.

10. The non-transitory computer readable storage medium of claim 9 , wherein the determination that the audio capture device is submerged in liquid comprises:

perform an image analysis to detect visual features representative of the audio capture device being submerged.

11. The non-transitory computer readable storage medium of claim 9 , wherein the determination that the audio capture device is submerged in liquid comprises:

detect, via a touch screen integrated with the audio capture device, a change in capacitance indicative of the audio capture device being submerged.

12. The non-transitory computer readable storage medium of claim 8 , wherein the determination that the both the first reference microphone and the second reference microphone are wet comprises:

detect that a spectral response change over a predefined frequency range meets a predefined criteria.

13. The non-transitory computer readable storage medium of claim 8 , wherein the determination that the both the first reference microphone and the second reference microphone are wet comprises:

detect a sound pattern indicative of a wet microphone condition.

14. The non-transitory computer readable storage medium of claim 7 , wherein generation of the stereo audio output signal comprises an application of a beamforming process to the first and second audio signals.

15. An audio capture device comprising:

a first reference microphone configured to capture a first audio signal;

a second reference microphone configured to capture a second audio signal;

a drainage microphone configured to capture a third audio signal;

a drainage channel adjacent to the drainage microphone configured to drain liquid away from the drainage microphone; and

a processor configured to:

determine whether the first reference microphone is wet or dry;

determine whether the second reference microphone is wet or dry; and

on a condition that the first reference microphone is determined to be dry and the second reference microphone is determined to be wet, select the first audio signal from the first reference microphone and generate a mono audio output signal based on the first audio signal.

16. The audio capture device of claim 15 , wherein the processor is further configured to:

determine if the audio capture device is submerged in liquid.

17. The audio capture device of claim 16 , wherein on a condition that the audio capture device is determined to be submerged in liquid, the processor further configured to:

select the first audio signal from the first reference microphone;

select the second audio signal from the second reference microphone; and

generate a second mono audio output signal based on the first audio signal and the second audio signal.

18. The audio capture device of claim 16 , wherein the processor is further configured to:

perform an image analysis to detect visual features representative of the audio capture device being submerged.

19. The audio capture device of claim 16 , wherein the processor is further configured to:

detect, via a touch screen integrated with the audio capture device, a change in capacitance indicative of the audio capture device being submerged.

20. The audio capture device of claim 15 , wherein the processor is further configured to:

detect that a spectral response change over a predefined frequency range meets a predefined criteria.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: TISCH, ERICH; ROSENBAUM, JOYCE; HANSSON, MAGNUS
To: GOPRO, INC.
Reel/Frame 056097/0800 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: LI, KE; WURTZ, DAVID
To: DSP CONCEPTS, LLC
Reel/Frame 056097/0954 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 30, 2021
From: DSP CONCEPTS, LLC
To: GOPRO, INC.
Reel/Frame 056108/0285 →
Continuity (4)
Continuation 15721192 · Sep 29, 2017
Continuation 15396380 · Dec 30, 2016
Provisional Application 62396002 · Sep 16, 2016
Related Publication 20210250715A1 · Aug 12, 2021
Cited By (1)
US 12,586,601