IP Library Granted Patent US 11,120,814
Granted Patent B2
US 11,120,814 · App. 15/999,484 · Granted Sep 14, 2021

Multi-microphone signal enhancement

Inventor: Chunjian Li (Beijing, CN)
Assignee: Dolby Laboratories Licensing Corporation
G10L21/0208H04R3/005G10L2021/02166H04R2201/40H04R2410/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,120,814
App. No.
15/999,484
Granted
Sep 14, 2021
Kind
B2
Abstract

Microphone signals are received from microphones of a computer device. Each microphone signal of the microphone signals is acquired by a respective microphone of the microphones. A previously unselected microphone is selected from the microphones as a reference microphone, which generates a reference microphone signal. An adaptive filter is used to create, based on microphone signals of the microphones other than the reference microphone, predicted microphone signals for the reference microphone. Based on the predicted microphone signals for the reference microphone, an enhanced microphone signal is outputted for the reference microphone. The enhanced microphone signal may be used as microphone signal for the reference microphone in subsequent audio processing operations.

Claims (20)

1. A computer-implemented method, comprising:

(a) receiving a plurality of microphone signals from a plurality of microphones of a computer device, each microphone signal in the plurality of microphone signals being acquired by a respective microphone in the plurality of microphones;

(b) selecting a previously unselected microphone from among the plurality of microphones as a reference microphone, a reference microphone signal being generated by the reference microphone;

(c) using an adaptive filter to create, based on one or more microphone signals of one or more microphones in the plurality of microphones, one or more predicted microphone signals for the reference microphone, the one or more microphones in the plurality of microphones being other than the reference microphone;

(d) outputting, based at least in part on the one or more predicted microphone signals for the reference microphone, an enhanced microphone signal for the reference microphone, the enhanced microphone signal being used to replace the reference microphone signal for the reference microphone in subsequent audio processing operations.

2. The method as recited in claim 1 , further comprising repeating (b) through (d) for each microphone in the plurality of microphones.

3. The method as recited in claim 1 , wherein filter parameters of the adaptive filter are updated based on an optimization method.

4. The method as recited in claim 3 , wherein the optimization method represents a least mean squared (LMS) optimization method.

5. The method as recited in claim 3 , wherein the optimization method minimizes differences between the reference microphone signal of the reference microphone and each of the one or more microphone signals of the one or more microphones other than the reference microphone.

6. The method as recited in claim 1 , wherein the adaptive filter is configured to preserve correlated audio data portions, in the reference microphone signal of the reference microphone and each of the one or more microphone signals of the one or more microphones other than the reference microphone.

7. The method as recited in claim 1 , wherein the adaptive filter is configured to reduce uncorrelated audio data portions in the reference microphone signal of the reference microphone and each of the one or more microphone signals of the one or more microphones other than the reference microphone.

8. The method as recited in claim 1 , wherein each of the one or more microphone signals of the one or more microphones other than the reference microphone is used by the adaptive filter as an input microphone signal for generating a corresponding predicted microphone signal in the one or more predicted microphone signals.

9. The method as recited in claim 1 , wherein the subsequent audio processing operations comprises one or more of: beam forming operations, binaural audio processing operations, surround audio processing operations, spatial audio processing operations, or audio processing operations that are performed based on original spatial information of the microphone signals as preserved in the one or more predicted microphone signals.

10. The method as recited in claim 1 , wherein the enhanced microphone signal is selected from the one or more predicted microphone signals based on one or more selection criteria.

11. The method as recited in claim 1 , wherein the enhanced microphone signal represents a sum of the one or more predicted microphone signals.

12. The method as recited in claim 1 , wherein the enhanced microphone signal is selected from the reference microphone signal and the one or more predicted microphones, based on one or more selection criteria, and optionally

wherein the on one or more selection criteria including a criterion related to instantaneous signal level.

13. The method as recited in claim 1 , wherein the enhanced microphone signal represents a sum of the reference microphone signal and the one or more predicted microphone signals.

14. The method as recited in claim 1 , wherein each of the one or more predicted microphone signals is generated by removing a pure delay from a predicted signal that is created based on the reference microphone signal with the pure delay inserted into the reference microphone signal.

15. The method as recited in claim 1 , wherein each microphone in the plurality of microphones is an omnidirectional microphone, and optionally wherein at least one microphone in the plurality of microphones is a directional microphone.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 18, 2018
From: LI, CHUNJIAN
To: DOLBY LABORATORIES LICENSING CORPORATION
Reel/Frame 046900/0381 →
Priority Claims (2)
WO PCT/CN2016/074102 · Feb 19, 2016 · international
EP 16161826 · Mar 23, 2016 · regional
Continuity (2)
Provisional Application 62309380 · Mar 16, 2016
Related Publication 20210210111A1 · Jul 8, 2021