IP Library Granted Patent US 9,350,895
Granted Patent B1
US 9,350,895 · App. 14/548,146 · Granted May 24, 2016

Audio signal level estimation in cameras

Inventors: Paul Beckmann (Sunnyvale, CA); Erich Tisch (San Francisco, CA); Eric Jing (Belmont, CA)
Assignee: GoPro, Inc.
H04N1/2125
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,350,895
App. No.
14/548,146
Granted
May 24, 2016
Kind
B1
Abstract

A camera system includes a first microphone, a second microphone, and a microphone controller. The first microphone and the second microphone are configured to capture audio over a time interval to produce a first captured audio signal and a second captured audio signal, respectively. The second captured audio signal is dampened relative to the first captured audio signal by a dampening factor. The microphone controller is configured to store the first captured audio signal in response to a determination that the first captured audio signal does not clip. In response to a determination that the first captured audio signal clips, the microphone controller is configured to identify a gain between the first captured audio signal and the second captured audio signal representative of the dampening factor, amplify the second captured audio signal based on the identified gain, and store the amplified second captured audio signal.

Claims (64)

1. A camera, comprising:

a first microphone configured to capture audio over a time interval to produce a first captured audio signal;

a second microphone configured to capture audio over the time interval to produce a second captured audio signal, the second captured audio signal dampened relative to the first captured audio signal by a dampening factor; and

a microphone controller coupled to the first microphone and the second microphone, the microphone controller configured to:

in response to a determination that the first captured audio signal does not clip, store the first captured audio signal; and

in response to a determination that the first captured audio signal clips:

identify a first slope of the first captured audio signal at a first zero crossing of a measure of amplitude of the first captured audio signal;

identify a second slope of the second captured audio signal at a second zero crossing of the measure of amplitude of the second captured audio signal, the second zero crossing corresponding to the first zero crossing;

identify a gain comprising a ratio of the first slope to the second slope;

amplify the second captured audio signal based on the identified gain; and

store the amplified second captured audio signal.

2. The camera of claim 1 , wherein identifying a gain between the first captured audio signal and the second captured audio signal comprises:

determining a first averaged Root Mean Square (RMS) representation of the first captured audio signal and a second averaged RMS representation of the second captured audio signal;

wherein the identified gain is a ratio of the first averaged RMS to the second averaged RMS.

3. The camera of claim 1 , wherein identifying the gain comprises:

identifying a first set of slopes of the first captured audio signal at a first set of zero crossings of measures of amplitude of the first captured audio signal;

identifying a second set of slopes of the second captured audio signal at a second set of zero crossings of the measures of amplitude of the second captured audio signal, each of the second set of zero crossings corresponding to a different one of the first set of zero crossings; and

determining a first average of the identified first set of slopes and a second average of the identified second set of slopes;

wherein the identified gain is a ratio of the first average of the identified first set of slopes to the second average of the identified second set of slopes.

4. The camera of claim 1 , wherein the first slope is the value of a derivative of the first captured audio signal at the first zero crossing and the second slope is the value of a derivative of the second captured audio signal at the second zero crossing.

5. The camera of claim 1 , wherein the first microphone and the second microphone comprise a membrane microphone.

6. The camera of claim 1 , wherein a level difference between the first captured audio signal and the second captured audio signal is substantially 20 dB.

7. A method of recording audio and video, comprising:

producing a first captured audio signal by using a first microphone configured to capture audio over a time interval;

producing a second captured audio signal by using a second microphone configured to capture audio over the time interval, the second captured audio signal dampened relative to the first captured audio signal by a dampening factor;

in response to a determination that the first captured audio signal does not clip, storing the first capture audio signal; and

in response to a determination that the first captured audio signal does clip:

identify a first slope of the first captured audio signal at a first zero crossing of a measure of amplitude of the first captured audio signal;

identify a second slope of the second captured audio signal at a second zero crossing of the measure of amplitude of the second captured audio signal, the second zero crossing corresponding to the first zero crossing;

identify a gain comprising a ratio of the first slope to the second slope;

amplifying the second captured audio signal based on the identified gain; and

storing the amplified second captured audio signal.

8. The method of claim 7 , wherein identifying a gain between the first captured audio signal and the second captured audio signal comprises:

determining a first averaged Root Mean Square (RMS) representation of the first captured audio signal and a second averaged RMS representation of the second captured audio signal;

wherein the identified gain is a ratio of the first averaged RMS to the second averaged RMS.

9. The method of claim 7 , wherein identifying the gain comprises:

identifying a first set of slopes of the first captured audio signal at a first set of zero crossings of measures of amplitude of the first captured audio signal;

identifying a second set of slopes of the second captured audio signal at a second set of zero crossings of the measures of amplitude of the second captured audio signal, each of the second set of zero crossings corresponding to a different one of the first set of zero crossings; and

determining a first average of the identified first set of slopes and a second average of the identified second set of slopes;

wherein the identified gain is a ratio of the first average of the identified first set of slopes to the second average of the identified second set of slopes.

10. The method of claim 7 , wherein the first slope is the value of a derivative of the first captured audio signal at the first zero crossing and the second slope is the value of a derivate of the second captured audio signal at the second zero crossing.

11. The method of claim 7 , wherein the first microphone and the second microphone comprise a membrane microphone.

12. The method of claim 7 , wherein a level difference between the first captured audio signal and the second captured audio signal is substantially 20 dB.

13. A non-transitory computer-readable storage medium storing executable instructions for recording audio and video in a camera, the instructions, when executed by a hardware processor, configured to perform steps comprising:

producing a first captured audio signal by using a first microphone configured to capture audio over a time interval;

producing a second captured audio signal by using a second microphone configured to capture audio over the time interval, the second captured audio signal dampened relative to the first captured audio signal by a dampening factor;

in response to a determination that the first captured audio signal does not clip, storing the first capture audio signal; and

in response to a determination that the first captured audio signal does clip:

identifying a first slope of the first captured audio signal at a first zero crossing of a measure of amplitude of the first captured audio signal;

identifying a second slope of the second captured audio signal at a second zero crossing of the measure of amplitude of the second captured audio signal, the second zero crossing corresponding to the first zero crossing;

identifying a gain comprising a ratio of the first slope to the second slope;

identifying a gain between the first captured audio signal and the second captured audio signal representative of the dampening factor;

amplifying the second captured audio signal based on the identified gain; and

storing the amplified second captured audio signal.

14. The non-transitory computer-readable storage medium of claim 13 , wherein identifying a gain between the first captured audio signal and the second captured audio signal comprises:

determining a first averaged Root Mean Square (RMS) representation of the first captured audio signal and a second averaged RMS representation of the second captured audio signal;

wherein the identified gain is a ratio of the first averaged RMS to the second averaged RMS.

15. The non-transitory computer-readable storage medium of claim 13 , wherein identifying a gain comprises:

identifying a first set of slopes of the first captured audio signal at a first set of zero crossings of measures of amplitude of the first captured audio signal;

identifying a second set of slopes of the second captured audio signal at a second set of zero crossings of the measures of amplitude of the second captured audio signal, each of the second set of zero crossings corresponding to a different one of the first set of zero crossings; and

determining a first average of the identified first set of slopes and a second average of the identified second set of slopes;

wherein the identified gain is a ratio of the first average of the identified first set of slopes to the second average of the identified second set of slopes.

16. The non-transitory computer-readable storage medium of claim 13 , wherein the first slope is the value of a derivative of the first captured audio signal at the first zero crossing and the second slope is the value of a derivate of the second captured audio signal at the second zero crossing.

17. The non-transitory computer-readable storage medium of claim 13 , wherein the first microphone and the second microphone comprise a membrane microphone.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY AGREEMENT Recorded Aug 29, 2016
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 039851/0611 →
SECURITY AGREEMENT Recorded Mar 28, 2016
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 038184/0779 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 1, 2015
From: BECKMANN, PAUL; TISCH, ERICH; JING, ZHINIAN
To: GOPRO, INC.
Reel/Frame 035314/0423 →