IP Library Granted Patent US 8,705,753
Granted Patent B2
US 8,705,753 · App. 12/174,595 · Granted Apr 22, 2014

System for processing sound signals in a vehicle multimedia system

View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,705,753
App. No.
12/174,595
Granted
Apr 22, 2014
Kind
B2
Abstract

The present invention relates to a method for processing sound signals in a vehicle multimedia system. A sound signal is recorded by a microphone. A voice signal component resulting from reproducing a voice signal and an audio signal component resulting from reproducing an audio signal are compensated in the recorded sound signal. The invention further relates to a system for processing sound signals and a vehicle multimedia system.

Claims (48)

1. Method for processing sound signals in a vehicle multimedia system, comprising:

detecting a sound signal with a microphone, where the sound signal has a first voice signal component that corresponds to a voice signal, a second voice signal component that results from a loudspeaker, and an audio signal component resulting from an audio signal;

estimating an impulse response between the loudspeaker and the microphone in an adaptive echo cancellation filter;

computing a simulated audio signal component with the impulse response in the adaptive echo cancellation filter;

computing a simulated second voice signal component based on the impulse response determined by the adaptive echo cancellation filter in a feedback filter, wherein the same impulse response is used for computing the simulated audio component and for computing the simulated second voice signal;

removing the simulated audio signal component and simulated second voice signal component from the detected sound signal that results in a compensated signal;

estimating a background noise level based on the compensated signal; and

adjusting a sound output volume by the vehicle multimedia system based on the estimated background noise level.

2. The method of claim 1 , where estimating the impulse response includes employing a gradient approach.

3. The method of claim 1 , further including processing the compensated signal.

4. The method of claim 1 , where estimating the background noise level further includes, estimating the background noise level with a previously detected background noise level, a short-time power of the detected sound signal and a short-time power of the audio- and echo-compensated signal.

5. The method of claim 1 , where estimating of the background noise level includes: determining a minimum value from a previously estimated background noise level, a short-time power of the detected sound signal and a short-time power of the compensated signal; and multiplying the minimum value by a time-dependent factor greater than one but smaller than two.

6. The method of claim 5 , further including: setting the time-dependent factor to a first value when the short time power of the audio signal is larger than a predetermined power level, and setting the time-dependent factor to a second value when the short-time power of the audio signal is smaller than said predetermined power level.

7. The method of claim 1 , where the adjustment of the volume of the sound output by the vehicle multimedia system includes: amplifying the compensated signal by an amplification factor based on the estimated background noise level to obtain the processed voice signal; combining the processed voice signal and the audio signal to a combined signal; and reproducing the combined signal by means of the loudspeaker.

8. The method of claim 1 , further including: detecting with a plurality of microphones, and a beamforming unit a plurality of sound signals; and processing the sound signals using the beamforming unit that results in directional detected sound signals.

9. The method of claim 8 , where removing of the simulated audio signal component and the simulated second voice signal component is performed before the processing of the detected sound signals for beamforming, and processing of the detected sound signals for beamforming further includes filtering the sound signals using adaptive filters.

10. The method of claim 8 , further including, estimating a background noise level based on the directional detected sound signal for a respective position, where at least one loudspeaker and at least one microphone is provided at each of the respective positions, amplifying the compensated sound signal with an amplification factor for the respective position, and reproducing a sound signal using the at least one loudspeaker of the respective position.

11. The method of claim 1 , where estimating a background noise level includes, estimating the background noise level for a passenger position and the volume of the sound output, and individually adjusting the sound output for the passenger position, based on the respective estimated background noise level.

12. The method of claim 1 , further including: determining a passenger position from which the first voice signal components originate; and attenuating the volume of sound output of a loudspeaker associated with the passenger position.

13. The method of claim 1 , where the multimedia system is a karaoke system, where the first voice signal component comprises a sound signal created by a singing passenger, and where the audio signal originates from a karaoke source.

14. The method of claim 1 , further including, controlling at least one function of the multimedia system by voice.

15. The method of claim 1 , where the multimedia system is a communication system.

16. The method of claim 1 , further including transferring data between the multimedia system and another multimedia system.

17. The method of claim 16 , where transferring data further includes transferring data associated with the audio signal.

18. A system for sound signal processing in a vehicle multimedia system, comprising:

at least one loudspeaker that is able to reproduce an audio signal from an audio source and a processed voice signal;

at least one microphone for detection of a sound signal, where the sound signal includes a first voice signal component that corresponds to a voice signal, a second voice signal component that corresponds to the reproduced processed voice signal, and an audio signal component corresponding to the reproduced audio signal;

an estimator that estimates an impulse response between the loudspeaker used to reproduce the audio signal and the microphone;

a first processing unit that compensates for the audio signal component in the detected sound signal where a first error signal is obtained with a first filter using the impulse response as filter coefficients;

a second processing unit that compensates for the second voice signal component in the detected sound signal where a second error signal is obtained with a second filter, wherein the some impulse response is used for compensating for the audio signal component and for compensating for the second voice signal component;

a processor that estimates a background noise level based on the second error signal;

a controller that controls the amplification of the second error signal based on the background noise level.

19. The system of claim 18 , includes a signal processor that processes the detected sound signal after filtering.

20. The system of claim 18 , includes a plurality of microphones, and a beamforming unit that processes the sound signals detected by the plurality of microphones and generates a directional detected sound signal.

21. The system of claim 18 , includes de-correlation filters that filter the detected sound signal and the audio signal.

22. The system of claim 18 , further comprising a stability control unit for weighting the impulse response based on a predetermined criterion.

23. The system of claim 18 , where the controller that controls the amplification associated with each passenger position and independently controls sound volume for each passenger positions.

24. The system of claim 18 , where the multimedia system is a karaoke system.

25. The system of claim 18 , further includes a data transfer unit that transfers data which includes the processed voice signal to a vehicle multimedia system.

26. The system of claim 18 , further includes a voice control unit to control at least one function of the multimedia system.

27. The method of claim 1 , where simulating the simulated audio signal component includes obtaining a first error signal by subtracting the simulated audio signal component from the detected sound signal.

28. The method of claim 27 , where simulating the simulated second voice signal component further includes obtaining a second error signal by subtracting the simulated second voice signal component from the first error signal.

29. The method of claim 28 , further includes,

determining a short-time power of the detected sound signal, the first error signal and the second error signal;

weighting the impulse response with a first weighting factor smaller than one if the first error signal short-time power is larger than the detected sound signal short-time power multiplied by a predetermined factor; and

weighting the impulse response with a second weighting factor smaller than one and smaller than the first weighting factor if the second error signal short-time power is larger than the detected sound signal short-time power multiplied by a predetermined factor.

30. The system of claim 18 , further comprising:

a stability control unit for determining the short-time power of the first and second error signals and weighting the impulse response based at least on the short-time power of the first error signal and the short-time power of the second error signal.

Assignments (9)
RELEASE (REEL 052935 / FRAME 0584) Recorded Jan 2, 2025
From: WELLS FARGO BANK, NATIONAL ASSOCIATION
To: CERENCE OPERATING COMPANY
Reel/Frame 069797/0818 →
CORRECTIVE ASSIGNMENT TO CORRECT THE REPLACE THE CONVEYANCE DOCUMENT WITH THE NEW ASSIGNMENT PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Recorded Apr 19, 2022
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 059804/0186 →
SECURITY AGREEMENT Recorded Jun 15, 2020
From: CERENCE OPERATING COMPANY
To: WELLS FARGO BANK, N.A.
Reel/Frame 052935/0584 →
RELEASE OF SECURITY INTEREST Recorded Jun 12, 2020
From: BARCLAYS BANK PLC
To: CERENCE OPERATING COMPANY
Reel/Frame 052927/0335 →
SECURITY AGREEMENT Recorded Nov 7, 2019
From: CERENCE OPERATING COMPANY
To: BARCLAYS BANK PLC
Reel/Frame 050953/0133 →
CORRECTIVE ASSIGNMENT TO CORRECT THE ASSIGNEE NAME PREVIOUSLY RECORDED AT REEL: 050836 FRAME: 0191. ASSIGNOR(S) HEREBY CONFIRMS THE INTELLECTUAL PROPERTY AGREEMENT. Recorded Oct 29, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE OPERATING COMPANY
Reel/Frame 050871/0001 →
INTELLECTUAL PROPERTY AGREEMENT Recorded Oct 23, 2019
From: NUANCE COMMUNICATIONS, INC.
To: CERENCE INC.
Reel/Frame 050836/0191 →
ASSET PURCHASE AGREEMENT Recorded Jan 19, 2010
From: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH
To: NUANCE COMMUNICATIONS, INC.
Reel/Frame 023810/0001 →
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 29, 2008
From: HAULICK, TIM; HOFF, VIOLA; SCHMIDT, GERHARD
To: HARMAN BECKER AUTOMOTIVE SYSTEMS GMBH
Reel/Frame 021645/0684 →