IP Library Granted Patent US 10,356,515
Granted Patent B2
US 10,356,515 · App. 15/980,942 · Granted Jul 16, 2019

Signal processor

Inventors: Bruno Gabriel Paul G. Defraene (Blanden, BE); Cyril Guillaumé (St Josse-Ten-Noode, BE); Wouter Joos Tirry (Wijgmaal, BE)
Assignee: NXP B.V.
H04R1/406G10K11/17854G10L21/0208H04R3/005H04R5/027G10K2210/1082G10L25/84G10L2021/02166H04R2201/403H04R2430/23
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,356,515
App. No.
15/980,942
Granted
Jul 16, 2019
Kind
B2
Abstract

A signal processor comprising a plurality of microphone-terminals configured to receive a respective plurality of microphone-signals. A plurality of beamforming-modules, each respective beamforming-module configured to receive and process input-signalling representative of some or all of the plurality of microphone-signals to provide a respective speech-reference-signal, a respective noise-reference-signal, and a beamformer output signal based on focusing a beam into a respective angular direction. A beam-selection-module comprising a plurality of speech-leakage-estimation-modules, each respective speech-leakage-estimation-module configured to receive the speech-reference-signal and the noise-reference-signal from a respective one of the plurality of beamforming-modules; and provide a respective speech-leakage-estimation-signal based on a similarity measure of the received speech-reference-signal with respect to the received noise-reference-signal. The beam-selection-module further comprises a beam-selection-controller configured to provide a control-signal based on the speech-leakage-estimation-signals.

Claims (31)

1. A signal processor comprising:

a plurality of microphone-terminals configured to receive a respective plurality of microphone-signals;

a plurality of beamformers, each respective beamformer configured to receive and process input-signaling representative of some or all of the plurality of microphone-signals to provide a respective speech-reference-signal, a respective noise-reference-signal, and a beamformer output signal based on focusing a beam into a respective angular direction;

a filter comprising a plurality of adaptive filters, each respective adaptive filter configured to receive the speech-reference-signal and the noise-reference-signal from a respective one of the plurality of beamformers and provide a respective speech-leakage-estimation-signal based on a similarity measure of the received speech-reference-signal with respect to the received noise-reference-signal; wherein the filter further comprises a beam-selection-controller configured to provide a control-signal based on the speech-leakage-estimation-signals; and

a multiplexer configured to: receive (i) a plurality of beamformer output signals from the beamforming modules and (ii) the control-signal, and select one or more, or a combination, of the plurality of beamformer output signals as an output-signal, in accordance with the control-signal.

2. The signal processor of claim 1 , wherein each beamformers of the plurality of beamformers is configured to focus a beam into a fixed angular direction.

3. The signal processor of claim 1 , wherein each beamformer of the plurality of beamformers is configured to focus a beam into a different angular direction.

4. The signal processor of claim 1 , wherein each respective beamformer output signal comprises a noise-canceled representation of one or more, or a combination, of the plurality of microphone-signals.

5. The signal processor of claim 1 , wherein each speech-leakage-estimation-signal is representative of speech-leakage-estimation-power, and the filter is configured to: determine a selected beamformer that is associated with the lowest speech-leakage-estimation-power; and provide a control-signal that is representative of the selected beamformer, such that the multiplexer is configured to select the beamformer output signal associated with the selected beamformer as the output-signal.

6. The signal processor of claim 1 , wherein the beam-selection-controller is configured to receive a speech activity control signal; and

after the speech activity control signal is representative of detected speech, then provide the control-signal based on most recently received speech-leakage-estimation-signals; and

after the speech activity control signal is not representative of detected speech, then provide the control-signal based on previously received speech-leakage-estimation-signals.

7. The signal processor of claim 1 , further comprising:

a frequency-selection-block configured to provide the speech-leakage-estimation-signal, by selecting one or more frequency bins representative of the some or all of the plurality of microphone-signals, the selection based on a pitch frequency of a speech signal derived from the some or all of the plurality of microphone-signals.

8. The signal processor of claim 1 , wherein the beam-selection-controller is configured to provide a control-signal such that the multiplexer is configured to select at least two different beamformer output signals that are associated with beamformers that are focused in different fixed directions.

9. The signal processor of claim 1 , wherein the adaptive filters are configured to determine the similarity measure in accordance with at least one of a statistical dependence of the received speech-reference-signal with respect to the received noise-reference-signal; a correlation of the received speech-reference-signal and the received noise-reference-signal; a mutual information of the received speech-reference-signal and the received noise-reference-signal; and an error signal provided by adaptive filtering of the received speech-reference-signal and the received noise-reference-signal.

10. The signal processor of claim 9 , wherein the adaptive filters are configured to determine the similarity measure in accordance with an error-power-signal representative of a power of the error signal and a noise-reference-power-signal representative of a power of the noise-reference-signal.

11. The signal processor of claim 10 , wherein the adaptive filters are configured to determine a selected subset of frequency bins based on a pitch-estimate representative of a pitch of a speech-component of the plurality of microphone-signals and determine the error-power-signal and the noise-reference-power-signal based on the selected subset of frequency bins.

12. The signal processor of claim 1 , further comprising:

a pre-processing block configured to receive and process the plurality of microphone-signals to provide the input-signaling by one or more of performing echo-cancellation on one or more of the plurality of microphone-signals, performing interference cancellation on one or more of the plurality of microphone-signals, and performing frequency transformation on one or more of the plurality of microphone-signals.

13. The signal processor of claim 1 , wherein each beamformer comprises:

a noise-canceller block configured to adaptively filter the respective noise-reference-signal to provide a respective filtered-noise-signal and subtract the filtered-noise-signal from the respective speech-reference-signal to provide the respective beamformer output signal.

14. The signal processor of claim 1 , wherein the multiplexer is configured to provide the output-signal as a linear combination of the selected plurality of beamformer output signals.

15. An article of manufacture including at least one non-transitory, tangible, machine-readable storage medium containing machine-executable instructions, wherein the article of manufacture comprises:

instructions for receiving, with a plurality of microphone-terminals, a respective plurality of microphone-signals;

instructions for receiving and processing, with a plurality of beamformers, input-signaling representative of some or all of the plurality of microphone-signals to provide a respective speech-reference-signal, a respective noise-reference-signal, and a beamformer output signal based on focusing a beam into a respective angular direction;

instructions for receiving, with a respective adaptive filter, the speech-reference-signal and the noise-reference-signal from a respective one of the plurality of beamformers;

instructions for providing, with each respective adaptive filter, a respective speech-leakage-estimation-signal based on a similarity measure of the received speech-reference-signal with respect to the received noise-reference-signal;

instructions for providing, with a beam-selection-controller, a control-signal based on the speech-leakage-estimation-signals;

instructions for receiving, with a multiplexer, a plurality of beamformer output signals from the beamforming modules and the control-signal; and

instructions for selecting, with the multiplexer, one or more, or a combination, of the plurality of beamformer output signals as an output-signal, in accordance with the control-signal.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded May 16, 2018
From: DEFRAENE, BRUNO GABRIEL PAUL G.; TIRRY, WOUTER JOOS; GUILLAUMÉ, CYRIL
To: NXP B.V.
Reel/Frame 045816/0763 →
Priority Claims (1)
EP 17175847 · Jun 13, 2017 · regional
Continuity (1)
Related Publication 20180359560A1 · Dec 13, 2018