IP Library Granted Patent US 9,613,628
Granted Patent B2
US 9,613,628 · App. 14/789,691 · Granted Apr 4, 2017

Audio decoder for wind and microphone noise reduction in a microphone array system

Inventors: Zhinian Jing (Belmont, CA); Scott Patrick Campbell (Belmont, CA)
Assignee: GoPro, Inc.
G10L19/008H04R1/406H04R3/04H04R5/04H04R2201/403H04R2203/12H04R2410/03H04R2410/05H04R2410/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,613,628
App. No.
14/789,691
Granted
Apr 4, 2017
Kind
B2
Abstract

An audio system encodes and decodes audio captured by a microphone array system in the presence of wind noise. The encoder encodes the audio signal in a way that includes beamformed audio signal and a “hidden” representation of a non-beamformed audio signal. The hidden signal is produced by modulating the low frequency signal to a high frequency above the audible range. A decoder can then either output the beamformed audio signal or can use the hidden signal to generate a reduced wind noise audio signal that includes the non-beamformed audio in the low frequency range.

Claims (46)

1. A method for decoding an encoded audio signal, the method comprising:

receiving the encoded audio signal, the encoded audio signal representing a non-beamformed audio signal modulated from a low frequency range to a high frequency range and combined with a beamformed audio signal spanning the low frequency range and a mid-frequency range between the low frequency range and the high frequency range;

responsive to receiving an input to recover the beamformed audio signal, applying a low pass filter to the encoded audio signal to filter out the non-beamformed audio signal modulated from the low frequency range to the high frequency range to generate an original audio signal; and

responsive to receiving an input to recover a reduced wind noise audio signal, processing the encoded audio signal to generate the reduced wind noise audio signal, the reduced wind noise audio signal representing the non-beamformed audio signal in the low frequency range and the beamformed audio signal in the mid-frequency range.

2. The method of claim 1 , wherein processing the encoded audio signal to generate the reduced wind noise audio signal comprises:

band-pass filtering the encoded audio signal according to a first band-pass filter corresponding to the high frequency range to obtain the band-passed non-beamformed signal;

amplifying the band-passed filtered signal to generate an amplified first band-pass filtered signal;

demodulating the amplified first band-pass filtered signal based on a carrier signal to recover the non-beamformed audio signal in the low frequency range;

band-pass filtering the encoded audio signal according to a second band-pass filter corresponding to the mid-frequency range to recover a band-passed portion of the beamformed audio signal in the mid-frequency range;

combining the recovered non-beamformed audio signal in the low frequency range with the recovered band-passed portion of the beamformed audio signal in the mid-frequency range to generate a decoded audio signal.

3. The method of claim 2 , wherein the first band pass filter has a low cutoff frequency of at least 20 kHz and a high cutoff frequency approximately 4 kHz above a frequency of the carrier signal.

4. The method of claim 2 wherein the carrier signal comprises approximately 20 kHz.

5. The method of claim 2 , wherein the second band-pass filter has a low cutoff frequency of approximately 4 kHz and a high cutoff frequency of at least 20 kHz.

6. A non-transitory computer-readable storage medium storing instructions for decoding an encoded audio signal, the instructions when executed by one or more processors cause the one or more processors to perform steps including:

receiving the encoded audio signal, the encoded audio signal representing a non-beamformed audio signal modulated from a low frequency range to a high frequency range and combined with a beamformed audio signal spanning the low frequency range and a mid-frequency range between the low frequency range and the high frequency range;

responsive to receiving an input to recover the beamformed audio signal, applying a low pass filter to the encoded audio signal to filter out the non-beamformed audio signal modulated from the low frequency range to the high frequency range to generate an original audio signal; and

responsive to receiving an input to recover a reduced wind noise audio signal, processing the encoded audio signal to generate the reduced wind noise audio signal, the reduced wind noise audio signal representing the non-beamformed audio signal in the low frequency range and the beamformed audio signal in the mid-frequency range.

7. The non-transitory computer-readable storage medium of claim 6 , wherein processing the encoded audio signal to generate the reduced wind noise audio signal comprises:

band-pass filtering the encoded audio signal according to a first band-pass filter corresponding to the high frequency range to obtain the band-passed non-beamformed signal;

amplifying the band-passed filtered signal to generate an amplified first band-pass filtered signal;

demodulating the amplified first band-pass filtered signal based on a carrier signal to recover the non-beamformed audio signal in the low frequency range;

band-pass filtering the encoded audio signal according to a second band-pass filter corresponding to the mid-frequency range to recover a band-passed portion of the beamformed audio signal in the mid-frequency range;

combining the recovered non-beamformed audio signal in the low frequency range with the recovered band-passed portion of the beamformed audio signal in the mid-frequency range to generate a decoded audio signal.

8. The non-transitory computer-readable storage medium of claim 7 , wherein the first band pass filter has a low cutoff frequency of at least 20 kHz and a high cutoff frequency approximately 4 kHz above a frequency of the carrier signal.

9. The non-transitory computer-readable storage medium of claim 7 , wherein the carrier signal comprises approximately 20 kHz.

10. The non-transitory computer-readable storage medium of claim 7 , wherein the second band-pass filter has a low cutoff frequency of approximately 4 kHz and a high cutoff frequency of at least 20 kHz.

11. A method for decoding an encoded audio signal, the method comprising:

receiving the encoded audio signal, the encoded audio signal representing a non-beamformed audio signal modulated from a low frequency range to a high frequency range and combined with a beamformed audio signal spanning the low frequency range and a mid-frequency range, the mid-frequency range between the low frequency range and the high frequency range;

band-pass filtering the encoded audio signal according to a first band-pass filter corresponding to the high frequency range to obtain a first band-pass filtered signal;

amplifying the first band-pass filtered signal to generate an amplified first band-pass filtered signal;

demodulating the amplified first band-pass filtered signal to recover the non-beamformed audio signal in the low frequency range;

band-pass filtering the encoded audio signal according to a second band-pass filter corresponding to the mid-frequency range to recover a band-passed portion of the beamformed audio signal in the mid-frequency range;

combining the recovered non-beamformed audio signal in the low frequency range with the recovered band-passed portion of the beamformed audio signal in the mid-frequency range to generate a decoded audio signal.

12. The method of claim 11 , wherein the first band pass filter has a low cutoff frequency of at least 20 kHz and a high cutoff frequency approximately 4 kHz above a frequency of the carrier signal.

13. The method of claim 11 , wherein the carrier signal comprises approximately 20 kHz.

14. The method of claim 11 , wherein the second band-pass filter has a low cutoff frequency of approximately 4 kHz and a high cutoff frequency of at least 20 kHz.

15. A non-transitory computer-readable storage medium storing instructions for decoding an encoded audio signal, the instructions when executed by one or more processors cause the one or more processors to perform steps including:

receiving the encoded audio signal, the encoded audio signal representing a non-beamformed audio signal modulated from a low frequency range to a high frequency range and combined with a beamformed audio signal spanning the low frequency range and a mid-frequency range, the mid-frequency range between the low frequency range and the high frequency range;

band-pass filtering the encoded audio signal according to a first band-pass filter corresponding to the high frequency range to obtain a first band-pass filtered signal;

amplifying the first band-pass filtered signal to generate an amplified first band-pass filtered signal;

demodulating the amplified first band-pass filtered signal to recover the non-beamformed audio signal in the low frequency range;

band-pass filtering the encoded audio signal according to a second band-pass filter corresponding to the mid-frequency range to recover a band-passed portion of the beamformed audio signal in the mid-frequency range;

combining the recovered non-beamformed audio signal in the low frequency range with the recovered band-passed portion of the beamformed audio signal in the mid-frequency range to generate a decoded audio signal.

16. The non-transitory computer-readable storage medium of claim 15 , wherein the first band pass filter has a low cutoff frequency of at least 20 kHz and a high cutoff frequency approximately 4 kHz above a frequency of the carrier signal.

17. The non-transitory computer-readable storage medium of claim 15 , wherein the carrier signal comprises approximately 20 kHz.

18. The non-transitory computer-readable storage medium of claim 15 , wherein the second band-pass filter has a low cutoff frequency of approximately 4 kHz and a high cutoff frequency of at least 20 kHz.

Assignments (5)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
SECURITY AGREEMENT Recorded Mar 28, 2016
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 038184/0779 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 2, 2015
From: JING, ZHINIAN; CAMPBELL, SCOTT PATRICK
To: GOPRO, INC.
Reel/Frame 035971/0067 →
Continuity (1)
Related Publication 20170004836A1 · Jan 5, 2017