IP Library Granted Patent US 8,238,574
Granted Patent B2
US 8,238,574 · App. 12/636,160 · Granted Aug 7, 2012

Method for determining a time delay for time delay compensation

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,238,574
App. No.
12/636,160
Granted
Aug 7, 2012
Kind
B2
Abstract

The invention provides a computer-implemented method for determining a time delay for time delay compensation of a microphone signal from a microphone array in a beamformer arrangement. For a given time, an instantaneous estimate of a position of a wanted sound source and/or of a direction of arrival of a signal originating from the wanted sound source is determined. The computer system then determines whether the instantaneous estimate deviates from a preset estimate of a position of the wanted sound source and/or of a direction of arrival of a signal originating from the wanted sound source according to a predetermined criterion. The predetermined criterion comprises a check whether the instantaneous estimate deviates from the preset estimate by at least a predetermined deviation threshold. If the predetermined criterion is fulfilled, the instantaneous estimate for the given time is set by the computer system as the preset estimate, and the computer system determines the time delay for time delay compensation of the microphone signal based on the instantaneous estimate.

Claims (79)

1. A computer-implemented method for determining a time delay for time delay compensation of a microphone signal from a microphone array in a beamformer arrangement, comprising:

determining in a processor, for a given time, an instantaneous estimate of a position of at least one of a wanted sound source and a direction of arrival of a signal originating from the wanted sound source;

determining in the processor whether the instantaneous estimate deviates from a preset estimate of at least one of a position of the wanted sound source and a direction of arrival of a signal originating from the wanted sound source according to a predetermined criterion, wherein the predetermined criterion comprises a check whether the instantaneous estimate deviates from the preset estimate by at least a predetermined deviation threshold;

if the predetermined criterion is fulfilled, setting the instantaneous estimate for the given time as the preset estimate in a memory location for the preset estimate; and

determining in the processor the time delay for time delay compensation of the microphone signal based on the instantaneous estimate.

2. The computer-implemented method according to claim 1 , wherein the predetermined deviation threshold corresponds to at least one of a minimum distance and a minimum angular distance between the instantaneous estimate and the preset estimate.

3. The computer-implemented method according to claim 1 , wherein the method further comprises:

determining a confidence measure and wherein the predetermined criterion further comprises a check whether the confidence measure exceeds a predetermined threshold value.

4. The computer-implemented method according to claim 3 , wherein the confidence measure is determined based on at least one of:

a signal-to-noise ratio of at least one microphone signal of the microphone array,

a deviation between the instantaneous estimate for the given time and an instantaneous estimate for a previous time, and

a sum of deviations between instantaneous estimates of subsequent times.

5. The computer-implemented method according to claim 1 , wherein the predetermined criterion is fulfilled, if at least one of the checks of the predetermined criterion yields a positive result.

6. The computer-implemented method according to claim 1 , wherein the beamformer arrangement operates in conjunction with an adaptive filter, and

if the predetermined criterion is fulfilled, initializing adaptation of the adaptive filter.

7. The computer-implemented method according to claim 6 , wherein initializing adaptation of the adaptive filter comprises applying a scaling factor to a preset parameter of the adaptive filter.

8. The computer-implemented method according to claim 6 , further comprising:

storing in a memory a parameter of the adaptive filter; and

storing in the memory at least one of the corresponding estimate for the position of the wanted sound source and the direction of arrival of a signal originating from the wanted sound source.

9. The computer-implemented method according to claim 6 , wherein after setting the instantaneous estimate for the given time as the preset estimate, the method further comprising:

resetting the parameters of the adaptive filter to a plurality of stored initialized values in the memory if, for the given time, the preset estimate deviates by a predetermined value from a stored estimate of at least one of the position of the wanted sound source and the direction of arrival of a signal originating from the wanted sound source.

10. The computer-implemented method according to claim 1 , wherein the beamformer arrangement operates in conjunction with residual echo cancellation logic if the predetermined criterion is fulfilled.

11. The computer-implemented method according to claim 1 further comprising: buffering the microphone signal, thereby obtaining a buffered microphone signal.

12. The computer-implemented method according to claim 11 , wherein subsequent to determining the time delay, the method comprises performing time delay compensation of the buffered microphone signal using the determined time delay.

13. The computer-implemented method according to claim 1 , wherein the predetermined criterion comprises a check whether the instantaneous estimate lies within at least one of a predetermined region, a predetermined sector, and a solid angle with respect to the microphone array.

14. The computer-implemented method according to claim 1 further comprising:

fixing after a predetermined time the time delay for time delay compensation to a preset value.

15. A computer program product comprising a non-transitory computer readable storage medium having computer code thereon for determining a time delay for time delay compensation of a microphone signal from a microphone array in a beamformer arrangement, the computer code comprising:

computer code for determining, for a given time, an instantaneous estimate of at least one of a position of a wanted sound source, and a direction of arrival of a signal originating from the wanted sound source;

computer code for determining whether the instantaneous estimate deviates from a preset estimate of at least one of a position of the wanted sound source, and a direction of arrival of a signal originating from the wanted sound source according to a predetermined criterion, wherein the predetermined criterion comprises a check whether the instantaneous estimate deviates from the preset estimate by at least a predetermined deviation threshold;

computer code for setting the instantaneous estimate for the given time as the preset estimate if the predetermined criterion is fulfilled; and

computer code for determining the time delay for time delay compensation of the microphone signal based on the instantaneous estimate.

16. The computer program product according to claim 15 , wherein the predetermined deviation threshold corresponds to at least one of:

a minimum distance, and

a minimum angular distance between the instantaneous estimate and the preset estimate.

17. The computer program product according to claim 15 , wherein the computer code further comprises:

computer code for determining a confidence measure; and

computer code for determining whether the confidence measure exceeds a predetermined threshold value.

18. The computer program product according to claim 17 , wherein the confidence measure is determined based on at least one of:

a signal-to-noise ratio of at least one microphone signal of the microphone array,

a deviation between the instantaneous estimate for the given time and an instantaneous estimate for a previous time, and

a sum of deviations between instantaneous estimates of subsequent times.

19. The computer program product according to claim 15 , wherein the predetermined criterion is fulfilled if at least one of the checks of the predetermined criterion yields a positive result.

20. The computer program product according to claim 15 , wherein the beamformer operates in conjunction with an adaptive filter if the predetermined criterion is fulfilled.

21. The computer program product according to claim 20 , wherein the computer code for initializing adaptation of the adaptive filter comprises computer code for applying a scaling factor to a preset parameter of the adaptive filter.

22. The computer program product according to claim 20 , further comprising:

computer code for storing in a memory a parameter of the adaptive filter; and

computer code for storing in the memory the corresponding estimate for at least one of the position of the wanted sound source and the direction of arrival of a signal originating from the wanted sound source.

23. The computer program product according to claim 20 , wherein after setting the instantaneous estimate for the given time as the preset estimate, the computer program product further comprising:

computer code for resetting the parameters of the adaptive filter to a plurality of stored initialized values in the memory if, for the given time, the preset estimate deviates by a predetermined value from a stored estimate of at least one of the position of the wanted sound source and the direction of arrival of a signal originating from the wanted sound source.

24. The computer program product according to claim 15 , wherein the predetermined criterion comprises a check whether the instantaneous estimate lies within at least one of a predetermined region, a predetermined sector, and a solid angle with respect to the microphone array.

25. The computer program product according to claim 15 , further comprising:

computer code for fixing after a predetermined time the time delay for time delay compensation to a preset value.

26. A system for determining a time delay for time delay compensation of a microphone signal from a microphone array in a beamformer arrangement, comprising:

a processor for determining, for a given time, an instantaneous estimate of at least one of a position of a wanted sound source and a direction of arrival of a signal originating from the wanted sound source; and

a logic circuitry determining whether the instantaneous estimate deviates from a preset estimate of at least one of a position of the wanted sound source and a direction of arrival of the signal originating from the wanted sound source according to a predetermined criterion, wherein the predetermined criterion comprises a check whether the instantaneous estimate deviates from the preset estimate by at least a predetermined deviation threshold;

the logic circuitry setting the instantaneous estimate for the given time as the preset estimate in a memory location for the preset estimate if the predetermined criterion is fulfilled;

the logic circuitry determining the time delay for time delay compensation of the microphone signal based on the instantaneous estimate.

27. The system according to claim 26 , wherein the predetermined deviation threshold corresponds to at least one of a minimum distance and a minimum angular distance between the instantaneous estimate and the preset estimate.

28. The system according to claim 26 , wherein the processor determines a confidence measure based on at least one of:

a signal-to-noise ratio of at least one microphone signal of the microphone array,

a deviation between the instantaneous estimate for the given time and an instantaneous estimate for a previous time, and

a sum of deviations between instantaneous estimates of subsequent times.

29. The system according to claim 28 , wherein the logic circuitry determines whether the confidence measure exceeds a predetermined threshold value.

30. The system according to claim 26 , wherein the predetermined criterion is fulfilled, if at least one of the checks of the predetermined criterion yields a positive result.

31. The system according to claim 26 , wherein the microphone array operates in conjunction with an adaptive filter if the predetermined criterion is fulfilled.

32. The system according to claim 31 , wherein the logic circuitry initializes the adaptive filter by applying a scaling factor to a preset parameter of the adaptive filter.

33. The system according to claim 31 , wherein the logic circuitry stores in a memory at least one of:

the parameters of the adaptive filter,

an estimate for the position of the wanted sound source, and

the direction of arrival of a signal originating from the wanted sound source.

34. The system according to claim 33 , wherein after setting the instantaneous estimate for the given time as the preset estimate, the logic circuitry resets the parameters of the adaptive filter to a plurality of stored initialized values in the memory if, for the given time, the preset estimate deviates by a predetermined value from at least one of:

the stored estimate of the position of the wanted sound source, and

the stored direction of arrival of a signal originating from the wanted sound source.

35. The system according to claim 26 , wherein the beamformer arrangement operates in conjunction with a residual echo cancellation logic if the predetermined criterion is fulfilled.

36. The system according to claim 26 , wherein the logic circuitry buffers the microphone signal to the beamformer arrangement.

37. The system according to claim 36 , wherein the logic circuitry performs time delay compensation to the microphone signal going to the beamformer arrangement using the determined time delay.

38. The system according to claim 26 , wherein the logic circuitry predetermines if the criterion is fulfilled by checking whether the instantaneous estimate lies within at least one of a predetermined region, a predetermined sector, and a solid angle with respect to the microphone array.

39. The system according to claim 26 , wherein the logic circuitry resets the time delay compensation to a preset value after a predetermined time.

Assignments (8)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Dec 17, 2009
From: BUCK, MARKUS; WOLFF, TOBIAS; SCHMIDT, GERHARD; HAULICK, TIM
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 023666/0275 →