IP Library Granted Patent US 9,872,006
Granted Patent B2
US 9,872,006 · App. 15/395,986 · Granted Jan 16, 2018

Audio signal level estimation in cameras

Inventors: Paul Beckmann (Sunnyvale, CA); Erich Tisch (San Francisco, CA); Zhinian Jing (Belmont, CA)
Assignee: GoPro, Inc.
H04N9/802G10L21/0216G10L21/0264H04N9/7908H04R3/005G10L2021/02166H04R2499/11
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,872,006
App. No.
15/395,986
Granted
Jan 16, 2018
Kind
B2
Abstract

A camera system includes a first microphone, a second microphone, and a microphone controller. The first microphone and the second microphone are configured to capture audio over a time interval to produce a first captured audio signal and a second captured audio signal, respectively. The second captured audio signal is dampened relative to the first captured audio signal by a dampening factor. The microphone controller is configured to store the first captured audio signal in response to a determination that the first captured audio signal does not clip. In response to a determination that the first captured audio signal clips, the microphone controller is configured to identify a gain between the first captured audio signal and the second captured audio signal representative of the dampening factor, amplify the second captured audio signal based on the identified gain, and store the amplified second captured audio signal.

Claims (69)

1. A camera, comprising:

a first microphone;

a second microphone, the first microphone and the second microphone configured to capture audio simultaneously to produce a first audio signal and a second audio signal, respectively, and the second audio signal dampened relative to the first audio signal by a damping factor such that an amplitude of the second audio signal is less than an amplitude of the first audio signal; and

a microphone controller coupled to the first microphone and the second microphone, the microphone controller configured to:

in response to a determination that the first audio signal does not clip, store the first audio signal, and

in response to a determination that the first audio signal clips:

identify a gain between the first audio signal and the second audio signal representative of the damping factor,

amplify the second audio signal by the identified gain, and

store the amplified second audio signal.

2. The camera of claim 1 , wherein identifying a gain between the first audio signal and the second audio signal comprises:

determining a first averaged Root Mean Square (RMS) representation of the first audio signal and a second averaged RMS representation of the second audio signal;

wherein the identified gain is a ratio of the first averaged RMS to the second averaged RMS.

3. The camera of claim 1 , wherein identifying a gain between the first audio signal and the second audio signal comprises:

identifying a first slope of the first audio signal at a first zero crossing of a measure of amplitude of the first audio signal; and

identifying a second slope of the second audio signal at a second zero crossing of the measure of amplitude of the second audio signal, the second zero crossing corresponding to the first zero crossing;

wherein the identified gain comprises the ratio of the first slope to the second slope.

4. The camera of claim 3 , wherein identifying a gain between the first audio signal and the second audio signal comprises:

identifying a first set of slopes of the first audio signal at a first set of zero crossings of measures of amplitude of the first audio signal;

identifying a second set of slopes of the second audio signal at a second set of zero crossings of the measures of amplitude of the second audio signal, each of the second set of zero crossings corresponding to a different one of the first set of zero crossings; and

determining a first average of the identified first set of slopes and a second average of the identified second set of slopes;

wherein the identified gain is a ratio of the first average of the identified first set of slopes to the second average of the identified second set of slopes.

5. The camera of claim 3 , wherein the first slope is the value of a derivative of the first audio signal at the first zero crossing and the second slope is the value of a derivative of the second audio signal at the second zero crossing.

6. The camera of claim 1 , wherein the first microphone and the second microphone comprise a membrane microphone.

7. The camera of claim 1 , wherein the second audio signal is dampened by at least 20 dB relative to the first audio signal.

8. A method of recording audio and video, comprising:

producing a first audio signal by using a first microphone;

producing a second audio signal by using a second microphone, the first microphone and the second microphone configured to capture audio simultaneously to produce the first audio signal and the second audio signal, respectively, and the second audio signal dampened relative to the first audio signal by a damping factor such that an amplitude of the second audio signal is less than an amplitude of the first audio signal;

in response to a determination that the first audio signal does not clip, storing the first audio signal; and

in response to a determination that the first audio signal clips:

identifying a gain between the first audio signal and the second audio signal representative of the damping factor,

amplifying the second audio signal by the identified gain, and

storing the amplified second audio signal.

9. The method of claim 8 , wherein identifying a gain between the first audio signal and the second audio signal comprises:

determining a first averaged Root Mean Square (RMS) representation of the first audio signal and a second averaged RMS representation of the second audio signal;

wherein the identified gain is a ratio of the first averaged RMS to the second averaged RMS.

10. The method of claim 8 , wherein identifying a gain between the first audio signal and the second audio signal comprises:

identifying a first slope of the first audio signal at a first zero crossing of a measure of amplitude of the first audio signal; and

identifying a second slope of the second audio signal at a second zero crossing of the measure of amplitude of the second audio signal, the second zero crossing corresponding to the first zero crossing;

wherein the identified gain comprises the ratio of the first slope to the second slope.

11. The method of claim 10 , wherein identifying a gain between the first audio signal and the second audio signal comprises:

identifying a first set of slopes of the first audio signal at a first set of zero crossings of measures of amplitude of the first audio signal;

identifying a second set of slopes of the second audio signal at a second set of zero crossings of the measures of amplitude of the second audio signal, each of the second set of zero crossings corresponding to a different one of the first set of zero crossings; and

determining a first average of the identified first set of slopes and a second average of the identified second set of slopes;

wherein the identified gain is a ratio of the first average of the identified first set of slopes to the second average of the identified second set of slopes.

12. The method of claim 10 , wherein the first slope is the value of a derivative of the first audio signal at the first zero crossing and the second slope is the value of a derivative of the second audio signal at the second zero crossing.

13. The method of claim 8 , wherein the first microphone and the second microphone comprise a membrane microphone.

14. The method of claim 8 , wherein the second audio signal is dampened by at least 20 dB relative to the first audio signal.

15. A computer program product for recording audio and video in a camera, the computer program product comprising a non-transitory computer-readable storage medium containing executable computer instructions for:

producing a first audio signal by using a first microphone;

producing a second audio signal by using a second microphone, the first microphone and the second microphone configured to capture audio simultaneously to produce the first audio signal and the second audio signal, respectively, and the second audio signal dampened relative to the first audio signal by a damping factor such that an amplitude of the second audio signal is less than an amplitude of the first audio signal;

in response to a determination that the first audio signal does not clip, storing the first audio signal; and

in response to a determination that the first audio signal clips:

identifying a gain between the first audio signal and the second audio signal representative of the damping factor,

amplifying the second audio signal by the identified gain, and

storing the amplified second audio signal.

16. The computer program product of claim 15 , wherein identifying a gain between the first audio signal and the second audio signal comprises:

determining a first averaged Root Mean Square (RMS) representation of the first audio signal and a second averaged RMS representation of the second audio signal;

wherein the identified gain is a ratio of the first averaged RMS to the second averaged RMS.

17. The computer program product of claim 15 , wherein identifying a gain between the first audio signal and the second audio signal comprises:

identifying a first slope of the first audio signal at a first zero crossing of a measure of amplitude of the first audio signal; and

identifying a second slope of the second audio signal at a second zero crossing of the measure of amplitude of the second audio signal, the second zero crossing corresponding to the first zero crossing;

wherein the identified gain comprises the ratio of the first slope to the second slope.

18. The computer program product of claim 17 , wherein identifying a gain between the first audio signal and the second audio signal comprises:

identifying a first set of slopes of the first audio signal at a first set of zero crossings of measures of amplitude of the first audio signal;

identifying a second set of slopes of the second audio signal at a second set of zero crossings of the measures of amplitude of the second audio signal, each of the second set of zero crossings corresponding to a different one of the first set of zero crossings; and

determining a first average of the identified first set of slopes and a second average of the identified second set of slopes;

wherein the identified gain is a ratio of the first average of the identified first set of slopes to the second average of the identified second set of slopes.

19. The computer program product of claim 17 , wherein the first slope is the value of a derivative of the first audio signal at the first zero crossing and the second slope is the value of a derivative of the second audio signal at the second zero crossing.

20. The computer program product of claim 15 , wherein the first microphone and the second microphone comprise a membrane microphone.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SCHEDULE TO REMOVE APPLICATION 15387383 AND REPLACE WITH 15385383 PREVIOUSLY RECORDED ON REEL 042665 FRAME 0065. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Oct 23, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 050808/0824 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 042665/0065 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 30, 2016
From: BECKMANN, PAUL; TISCH, ERICH; JING, ZHINIAN
To: GOPRO, INC.
Reel/Frame 040812/0155 →
Continuity (3)
Continuation 15140260 · Apr 27, 2016
Continuation 14548146 · Nov 19, 2014
Related Publication 20170111627A1 · Apr 20, 2017