IP Library Granted Patent US 9,858,935
Granted Patent B2
US 9,858,935 · App. 15/383,970 · Granted Jan 2, 2018

Audio decoder for wind and microphone noise reduction in a microphone array system

Inventors: Zhinian Jing (Belmont, CA); Scott Patrick Campbell (Belmont, CA)
Assignee: GoPro, Inc.
G10L19/008H04R1/406H04R3/04H04R5/04G10L21/0208G10L2021/02166H04R3/005H04R3/12H04R2201/403H04R2203/12H04R2410/03H04R2410/07H04R2430/03H04R2430/20H04R2430/23
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 9,858,935
App. No.
15/383,970
Granted
Jan 2, 2018
Kind
B2
Abstract

An audio system encodes and decodes audio captured by a microphone array system in the presence of wind noise. The encoder encodes the audio signal in a way that includes beamformed audio signal and a “hidden” representation of a non-beamformed audio signal. The hidden signal is produced by modulating the low frequency signal to a high frequency above the audible range. A decoder can then either output the beamformed audio signal or can use the hidden signal to generate a reduced wind noise audio signal that includes the non-beamformed audio in the low frequency range.

Claims (40)

1. A method for decoding an encoded audio signal, the method comprising:

receiving the encoded audio signal

applying a high frequency range band-pass filter to the encoded audio signal to obtain a first band-limited signal in a high frequency range;

demodulating the first band-limited signal to generate a demodulated signal in the low frequency range;

applying a mid-frequency range band-pass filter to the encoded audio signal to obtain a second band-limited signal in a mid-frequency range; and

combining, by a processor, the demodulated signal in the low frequency range with the second band-limited signal in the mid-frequency range to generate a decoded audio signal.

2. The method of claim 1 , further comprising:

amplifying the first band-limited signal prior to demodulating the first-band-limited signal.

3. The method of claim 2 , wherein the high-frequency range band-pass filter has a low cutoff frequency of approximately 20 kHz and a high cutoff frequency of approximately 24 kHz.

4. The method of claim 3 , wherein demodulating the first band-limited signal comprises negatively shifting a frequency of the first band-limited signal by approximately 20 kHz.

5. The method of claim 1 , wherein the mid-range band-pass filter has a low cutoff frequency of approximately 4 kHz and a high cutoff frequency of approximately 20 kHz.

6. A non-transitory computer-readable storage medium storing instructions for decoding an encoded audio signal, the instructions when executed by one or more processors cause the one or more processors to perform steps including:

receiving the encoded audio signal

applying a high frequency range band-pass filter to the encoded audio signal to obtain a first band-limited signal in a high frequency range;

demodulating the first band-limited signal to generate a demodulated signal in the low frequency range;

applying a mid-frequency range band-pass filter to the encoded audio signal to obtain a second band-limited signal in a mid-frequency range; and

combining the demodulated signal in the low frequency range with the second band-limited signal in the mid-frequency range to generate a decoded audio signal.

7. The non-transitory computer-readable storage medium of claim 6 , further comprising:

amplifying the first band-limited signal prior to demodulating the first-band-limited signal.

8. The non-transitory computer-readable storage medium of claim 7 , wherein the high-frequency range band-pass filter has a low cutoff frequency of approximately 20 kHz and a high cutoff frequency of approximately 24 kHz.

9. The non-transitory computer-readable storage medium of claim 7 , wherein demodulating the first band-limited signal comprises negatively shifting a frequency of the first band-limited signal by approximately 20 kHz.

10. The non-transitory computer-readable storage medium of claim 6 , wherein the mid-range band-pass filter has a low cutoff frequency of approximately 4 kHz and a high cutoff frequency of approximately 20 kHz.

11. A audio decoder for decoding an encoded audio signal, comprising:

one or more processors; and

a non-transitory computer-readable storage medium storing instructions for decoding an encoded audio signal, the instructions when executed by the one or more processors cause the one or more processors to perform steps including:

receiving the encoded audio signal

applying a high frequency range band-pass filter to the encoded audio signal to obtain a first band-limited signal in a high frequency range;

demodulating the first band-limited signal to generate a demodulated signal in the low frequency range;

applying a mid-frequency range band-pass filter to the encoded audio signal to obtain a second band-limited signal in a mid-frequency range; and

combining the demodulated signal in the low frequency range with the second band-limited signal in the mid-frequency range to generate a decoded audio signal.

12. The audio decoder of claim 11 , further comprising:

amplifying the first band-limited signal prior to demodulating the first-band-limited signal.

13. The audio decoder of claim 12 , wherein the high-frequency range band-pass filter has a low cutoff frequency of approximately 20 kHz and a high cutoff frequency of approximately 24 kHz.

14. The audio decoder of claim 12 , wherein demodulating the first band-limited signal comprises negatively shifting a frequency of the first band-limited signal by approximately 20 kHz.

15. The audio decoder of claim 11 , wherein the mid-range band-pass filter has a low cutoff frequency of approximately 4 kHz and a high cutoff frequency of approximately 20 kHz.

16. The method of claim 1 , wherein combining the demodulated signal in the low frequency range with the second band-limited signal in the mid-frequency range comprises applying a frequency-dependent weighted summation of the demodulated signal in the low frequency range and the second band-limited signal in the mid-frequency range.

17. The method of claim 1 , wherein the high frequency range comprises an inaudible frequency range.

18. The non-transitory computer-readable storage medium of claim 6 , wherein combining the demodulated signal in the low frequency range with the second band-limited signal in the mid-frequency range comprises applying a frequency-dependent weighted summation of the demodulated signal in the low frequency range and the second band-limited signal in the mid-frequency range.

19. The non-transitory computer-readable storage medium of claim 6 , wherein the high frequency range comprises an inaudible frequency range.

20. The audio decoder of claim 11 , wherein combining the demodulated signal in the low frequency range with the second band-limited signal in the mid-frequency range comprises applying a frequency-dependent weighted summation of the demodulated signal in the low frequency range and the second band-limited signal in the mid-frequency range.

Assignments (6)
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: FARALLON CAPITAL MANAGEMENT, L.L.C., AS AGENT
Reel/Frame 072340/0676 →
SECURITY INTEREST Recorded Aug 4, 2025
From: GOPRO, INC.
To: WELLS FARGO BANK, NATIONAL ASSOCIATION, AS AGENT
Reel/Frame 072358/0001 →
RELEASE OF PATENT SECURITY INTEREST Recorded Jan 25, 2021
From: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
To: GOPRO, INC.
Reel/Frame 055106/0434 →
CORRECTIVE ASSIGNMENT TO CORRECT THE SCHEDULE TO REMOVE APPLICATION 15387383 AND REPLACE WITH 15385383 PREVIOUSLY RECORDED ON REEL 042665 FRAME 0065. ASSIGNOR(S) HEREBY CONFIRMS THE SECURITY INTEREST. Recorded Oct 23, 2019
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 050808/0824 →
SECURITY INTEREST Recorded Jun 1, 2017
From: GOPRO, INC.
To: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT
Reel/Frame 042665/0065 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 3, 2017
From: JING, ZHINIAN; CAMPBELL, SCOTT PATRICK
To: GOPRO, INC.
Reel/Frame 040827/0852 →
Continuity (2)
Continuation 14789691 · Jul 1, 2015
Related Publication 20170103762A1 · Apr 13, 2017