IP Library Granted Patent US 10,861,473
Granted Patent B2
US 10,861,473 · App. 15/934,392 · Granted Dec 8, 2020

Multi-band noise gate

Inventors: Joyce Gorny (Mountain View, CA); Erich Tisch (San Francisco, CA); Per Magnus Fredrik Hansson (Los Altos, CA)
Assignee: GoPro, Inc.
G10L19/0208G10L19/18G10L21/0232H03G3/30H03G9/005H03G9/025G10L21/0316
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,861,473
App. No.
15/934,392
Granted
Dec 8, 2020
Kind
B2
Abstract

The present disclosure relates to processing a plurality of audio signals. The method includes receiving the plurality of audio signals in the frequency domain and determining an overall attenuation multiplier based on the plurality of audio signals and an overall lookup table that relates decibel values to different overall attenuation multipliers. The method further includes determining an attenuation vector comprising a plurality of bin-specific attenuation multipliers, each bin-specific attenuation multiplier respectively corresponding to a different frequency bin of the plurality of frequency bins. The method further includes scaling each bin-specific attenuation value in the attenuation vector with the overall attenuation multiplier, and editing each of the audio signals based on the scaled bin-specific attenuation values in the attenuation vector.

Claims (55)

1. A method for processing a plurality of audio signals comprising:

receiving the plurality of audio signals in a frequency domain, each audio signal having been captured by a respective audio recording device and transformed from a time domain to the frequency domain, wherein the frequency domain is divided into a plurality of frequency bins that collectively span the frequency domain and each audio signal is represented by a plurality of magnitudes respectively corresponding to the plurality of frequency bins of the frequency domain, wherein each magnitude represents a magnitude of the audio signal at the corresponding frequency bin;

determining an overall attenuation multiplier based on the plurality of audio signals and an overall lookup table that relates decibel values to different overall attenuation multipliers;

determining an attenuation vector comprising a plurality of bin-specific attenuation multipliers, each bin-specific attenuation multiplier respectively corresponding to a different frequency bin of the plurality of frequency bins, wherein determining the attenuation vector includes:

separating the plurality of audio signals into a plurality of frequency bands, wherein the plurality of frequency bands collectively span the frequency domain, and each respective frequency band is spanned by two or more frequency bins of the plurality of the frequency bins; and

for each respective frequency band:

obtaining a band-specific lookup table from a plurality of band-specific lookup tables, wherein the band-specific lookup table corresponds to the respective frequency band and relates decibel levels to bin-specific attenuation values; and

for each respective frequency bin within the frequency band:

 determining an approximate decibel level at the respective frequency bin based on the plurality of audio signals;

 determining a bin-specific attenuation multiplier corresponding to the respective frequency bin based on an average decibel level at the respective frequency bin and the respective band-specific lookup table; and

 inputting the bin-specific attenuation multiplier to the attenuation vector;

scaling each bin-specific attenuation value in the attenuation vector with the overall attenuation multiplier; and

editing each of the audio signals based on the scaled bin-specific attenuation values in the attenuation vector to produce an attenuated audio signal.

2. The method of claim 1 , wherein determining the approximate decibel level at the respective frequency bin comprises:

for each audio signal, determining a complex magnitude at the respective frequency bin,

calculating a root mean square value based on the complex magnitudes at the respective frequency bin; and

calculating a logarithm of the root mean square value to obtain the approximate decibel level at the respective frequency bin.

3. The method of claim 1 , wherein each bin-specific attenuation multiplier is between zero and one.

4. The method of claim 1 , wherein the method is executed by a processor of an image capture device and each band-specific lookup table is configured for a make and model of the image capture device.

5. The method of claim 1 , wherein determining the overall attenuation multiplier comprises:

determining an approximate decibel value of all of the audio signals of the plurality of audio signals; and

determining the overall attenuation multiplier from the overall lookup table using the approximate decibel value of all of the audio signals.

6. The method of claim 5 , wherein the overall attenuation multiplier is a value between zero and one.

7. The method of claim 6 , wherein scaling each of the bin-specific attenuation values based on the overall attenuation value includes multiplying the bin-specific attenuation values by the overall attenuation value.

8. The method of claim 5 , further comprising:

smoothing the approximate decibel value of all of the audio signals of the plurality of audio signals based on a previously determined approximate decibel level.

9. The method of claim 1 , wherein editing each of the audio signals comprises:

for each respective audio signal and for each respective frequency bin, multiplying a magnitude of the respective audio signal at the respective frequency bin by the scaled bin-specific attenuation value.

10. The method of claim 1 , further comprising:

smoothing the scaled bin-specific attenuation values in the attenuation vector.

11. The method of claim 1 , further comprising:

performing an inverse transform of the attenuated audio signal to the time domain; and

storing the inverse transformed attenuated audio signal.

12. A method for processing a plurality of audio signals comprising:

receiving the plurality of audio signals in a frequency domain, each audio signal having been captured by a respective audio recording device and transformed from a time domain to the frequency domain, wherein the frequency domain is divided into a plurality of frequency bins that collectively span the frequency domain and each audio signal is represented by a plurality of magnitudes respectively corresponding to the plurality of frequency bins of the frequency domain, wherein each magnitude represents a magnitude of the audio signal at the corresponding frequency bin;

determining an attenuation vector comprising a plurality of bin-specific attenuation multipliers, each bin-specific attenuation multiplier respectively corresponding to a different frequency bin of the plurality of frequency bins, wherein determining the attenuation vector includes:

separating the plurality of audio signals into a plurality of frequency bands, wherein the plurality of frequency bands collectively span the frequency domain, and each respective frequency band is spanned by two or more frequency bins of the plurality of the frequency bins; and

for each respective frequency band:

obtaining a band-specific lookup table from a plurality of band-specific lookup tables, wherein the band-specific lookup table corresponds to the respective frequency band and relates decibel levels to bin-specific attenuation values; and

for each respective frequency bin within the frequency band:

determining an approximate decibel level at the respective frequency bin based on the plurality of audio signals;

determining a bin-specific attenuation multiplier corresponding to the respective frequency bin based on an average decibel level at the respective frequency bin and the respective band-specific lookup table; and

inputting the bin-specific attenuation multiplier to the attenuation vector; and

editing each of the audio signals based on the bin-specific attenuation values in the attenuation vector to produce an attenuated audio signal.

13. The method of claim 12 , wherein determining the approximate decibel level at the respective frequency bin comprises:

for each audio signal, determining a complex magnitude at the respective frequency bin;

calculating a root mean square value based on the complex magnitudes at the respective frequency bin; and

calculating a logarithm of the root mean square value to obtain the approximate decibel level at the respective frequency bin.

14. The method of claim 12 , wherein each bin-specific attenuation multiplier is between zero and one.

15. The method of claim 12 , wherein the method is executed by a processor of an image capture device and each band-specific lookup table is configured for a make and model of the image capture device.

16. The method of claim 12 , wherein each band-specific lookup table is based on a root mean square level of a noise floor, averaged over time.

17. The method of claim 12 , further comprising:

performing an inverse transform of the attenuated audio signal to the time domain; and

storing the inverse transformed attenuated audio signal.

18. The method of claim 17 , wherein the inverse transform is an inverse Fast Fourier Transform (IFFT) or an inverse Laplace transform.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY INTEREST Recorded Sep 5, 2018
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 047016/0417 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Mar 28, 2018
From: GORNY, JOYCE; TISCH, ERICH; HANSSON, PER MAGNUS FREDRIK
To: GOPRO, INC.
Reel/Frame 045374/0135 →
Continuity (2)
Provisional Application 62563731 · Sep 27, 2017
Related Publication 20190096416A1 · Mar 28, 2019