IP Library › Granted Patent US 8,670,570
Granted Patent B2
US 8,670,570 · App. 11/982,849 · Granted Mar 11, 2014

Environmental effects generator for digital audio signals

Inventors: Wenbo Zong (Singapore, SG); Yuan Wu (Singapore, SG); Sapna George (Singapore, SG)
Assignee: STMicroelectronics Asia Pacific PTE., Ltd.
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 8,670,570
App. No.
11/982,849
Granted
Mar 11, 2014
Kind
B2
Abstract

An device and method of generating environmental reverberation effects for digital audio signals is presented. The device includes a reverberation controller. The reverberation controller pre-processes one or more predetermined characteristics of a first audio signal to produce a pre-processed signal and generates a plurality of delayed outputs from the pre-processed signal, each output having a predetermined delay. The reverberation controller also produces a plurality of reflection outputs from the plurality of delayed outputs and combines the plurality of reflection outputs to produce a second audio signal having a desired reverberation response.

Claims (103)

1. A device comprising a reverberation controller stored in memory or other non-transitory tangible media, the reverberation controller configured to:

pre-process one or more predetermined characteristics of a first audio signal to produce a pre-processed signal;

generate a plurality of delayed outputs from the pre-processed signal, each output having a predetermined delay;

produce a plurality of reflection outputs from the plurality of delayed outputs by:

summing a plurality of outputs from a feedback matrix and the plurality of delayed outputs to produce a plurality of summed outputs, and

filtering the summed outputs to yield filtered outputs, a portion of each filtered output including a reflection output and another portion of each filtered output including a feedback output;

pass at least some of the portions including the feedback outputs back through the feedback matrix;

pass at least some of the portions including the reflection outputs to a mixing module without passing back through the feedback matrix; and

combine the plurality of reflection outputs to produce at least part of a second audio signal having a desired reverberation response.

2. The device of claim 1 , wherein the controller is further configured to pre-process one or more predetermined characteristics of the first audio signal by:

controlling a gain of the first audio signal, and

filtering high frequencies of the first audio signal.

3. The device of claim 2 , wherein the gain of the first audio signal is controlled according to a desired power of the desired reverberation response, and high frequencies of the first audio signal are filtered according to a desired attenuation at a reference frequency relative to an attenuation at direct current (DC) of the desired reverberation response.

4. The device of claim 1 , wherein the delays of the delayed outputs are determined according to a desired power of early reflections of the desired reverberation response.

5. The device of claim 1 , wherein the outputs from the feedback matrix that are summed are not further delayed prior to being summed with the plurality of delayed outputs.

6. The device of claim 1 , wherein the controller, in feeding the feedback outputs to the feedback matrix, is configured to:

filter the feedback outputs to produce filtered feedback outputs;

delay the filtered feedback outputs to produce delayed filtered feedback outputs; and

control a gain of the delayed filtered feedback outputs to produce inputs to the feedback matrix.

7. The device of claim 6 , wherein a decay characteristic of the reflection output is determined according to one or more of a desired delay time of an onset of late reverberation relative to a first reflection of the desired reverberation response and a desired reverberation decay time at low frequencies of the desired reverberation response,

wherein a characteristic of the filtered reflection output is determined according to a desired ratio of decay time at high frequencies relative to decay time at low frequencies of the desired reverberation, response,

wherein a delay of the delayed filtered reflection output is determined according to a desired modal density of late reverberations of the desired reverberation response, and

wherein the gain of the delayed filtered reflection output is controlled according to the desired reverberation decay time at low frequencies of the desired reverberation response.

8. The device of claim 1 , wherein the controller is further configured to combine the plurality of reflection outputs by:

combining at least a portion of the plurality of reflection outputs to produce a combined reflection output,

combining at least another portion of the plurality of reflection outputs to produce a combined reverberation output, and

summing the combined reflection output and the combined reverberation output to produce the second audio signal.

9. The device of claim 8 , wherein the controller, in producing the combined reverberation output., is further configured to:

individually delay one or more of the plurality of reflection outputs to produce a delayed plurality of reflection outputs;

combine the delayed plurality of reflection outputs to produce a collective reverberation output;

control the gain of the collective reverberation output; and

delay the gain-controlled collective reverberation output.

10. The device of claim 9 , wherein a gain of the combined reflection output is controlled according to a desired power of early reflections of the desired reverberation response,

wherein the one or more delays of the plurality of reflection outputs are determined according to a desired power of late reverberations of the desired reverberation response,

wherein the gain of the collective reverberation output is controlled according to the desired power of late reverberations to produce a gain-controlled collective reverberation output, and

wherein the gain-controlled collective reverberation output is delayed according to a desired delay time of an onset of late reverberation relative to a first reflection of the desired reverberation response to produce the combined reverberation output.

11. A method of adding a desired reverberation response to an audio signal, the method comprising;

pre-processing one or more predetermined characteristics of a first audio signal to produce a pre-processed signal;

generating a plurality of delayed outputs from the pre-processed signal, each output having a predetermined delay;

producing a plurality of reflection outputs from the plurality of delayed outputs by:

summing a plurality of outputs from a feedback matrix and the plurality of delayed outputs to produce a plurality of summed outputs, and

filtering the summed outputs to yield filtered outputs, a portion of each filtered output including a reflection output and another portion of each filtered output including a feedback output;

passing at least some of the portions including the feedback outputs back through the feedback matrix;

passing at least some of the portions including the reflection outputs to a mixing module without passing back through the feedback matrix; and

combining the plurality of reflection outputs to produce at least part of a second audio signal having a desired reverberation response.

12. The method of claim 11 , wherein pre-processing one or more predetermined characteristics of the first audio signal further comprises:

controlling a gain of the first audio signal; and

filtering high frequencies of the first audio signal.

13. The method of claim 12 , wherein the gain of the first audio signal is controlled according to a desired power of the desired reverberation response and high frequencies of the first audio signal are filtered according to a desired attenuation of the reverberation response at a reference frequency relative to an attenuation at direct current (DC) of the desired reverberation response.

14. The method of claim 11 , wherein the delays of the delayed outputs are determined according to a desired power of early reflections of the desired reverberation response.

15. The method of claim 11 , wherein outputs from the feedback matrix that are summed are not further delayed prior to being summed with the plurality of delayed outputs.

16. The method of claim 15 , wherein feeding the feedback outputs to the feedback matrix comprises:

filtering the feedback outputs to produce filtered feedback outputs;

delaying the filtered feedback outputs to produce delayed filtered feedback outputs; and

controlling a gain of the delayed filtered feedback outputs to produce inputs to the feedback matrix.

17. The method of claim 16 , wherein a decay characteristic of the reflection output is determined according to one or more of a desired delay time of an onset of late reverberation relative to a first reflection of the desired reverberation response and a desired reverberation decay time at low frequencies of the desired reverberation response,

wherein a characteristic of the filtered reflection output is determined according to a desired ratio or decay time at high frequencies relative to decay time at low frequencies of the desired reverberation response,

wherein a delay of the delayed filtered reflection output is determined according to a desired modal density of late reverberations of the desired reverberation response, and

wherein the gain of the delayed filtered reflection output is controlled according to the desired reverberation decay time at low frequencies of the desired reverberation response.

18. The method of claim 11 , wherein combining the plurality of reflection outputs to produce a second audio signal further comprises:

combining at least a portion of the plurality of reflection outputs to produce a combined reflection output;

combining at least another portion of the plurality of reflection outputs to produce a combined reverberation output; and

summing the combined reflection output and the combined reverberation output to produce the second audio signal.

19. The method of claim 18 , wherein producing the combined reverberation output further comprises:

individually delaying one or more of the plurality of reflection outputs to produce a delayed plurality of reflection outputs;

combining the delayed plurality of reflection outputs to produce a collective reverberation output;

controlling the gain of the collective reverberation output; and

delaying the gain-controlled collective reverberation output.

20. The method of claim 19 , wherein a gain of the combined reflection output is controlled according to a desired power of early reflections, and

wherein the one or more delays of the plurality of reflection outputs are determined according to a desired power of late reverberations of the desired reverberation response,

wherein the gain of the collective reverberation output is controlled according to the desired power of late reverberations to produce a gain-controlled collective reverberation output, and

wherein the gain-controlled collective reverberation output is delayed according to a desired delay time of an onset of late reverberation relative to a first reflection of the desired reverberation response to produce the combined reverberation output.

21. A system, comprising:

an audio source;

an audio output;

a control unit configured to receive information from a user, the information relating to a desired reverberation response; and

a reverberation generator coupled to the audio source, the audio output, and the controlling unit, the reverberation generator comprising a reverberation controller configured to:

pre-process one or more selected characteristics of a first audio signal from the audio source to produce a pre-processed signal;

generate a plurality of delayed outputs from the pre-processed signal, each output having a predetermined delay; produce a plurality of reflection outputs from the plurality of delayed outputs by:

summing a plurality of outputs from a feedback matrix and the plurality of delayed outputs to produce a plurality of summed outputs, and

filtering the summed outputs to yield filtered outputs, a portion of each filtered output including a reflection output and another portion of each filtered output including a feedback output;

pass the portions including the feedback outputs back through the feedback matrix;

pass the portions including the reflection outputs to a mixing module without passing back through the feedback matrix; and

combine the plurality of reflection outputs to produce at least part of a second audio signal to the audio output, the second audio signal having the desired reverberation response.

22. The system of claim 21 , wherein the controller is further configured to:

pre-process one or more selected characteristics of a first audio signal from the audio source to produce a pre-processed signal by:

controlling a gain of the first audio signal; and

filtering high frequencies of the first audio signal; and

feed the feedback outputs to the feedback matrix by:

filtering the feedback outputs to produce filtered feedback outputs;

delaying the filtered feedback outputs to produce delayed filtered feedback outputs; and

controlling a gain of the delayed filtered feedback outputs to produce inputs to the feedback matrix; and

combine the plurality of reflection outputs to produce a second audio signal to the audio output by:

combining at least a portion of the plurality of reflection outputs to produce a combined reflection output,

combining at least another portion of the plurality of reflection outputs to produce a combined reverberation output, and

summing the combined reflection output and the combined reverberation output to produce the second audio signal.

23. The system of claim 22 , wherein the gain of the first audio signal, is controlled according to a desired power of the desired reverberation response, and high frequencies of the first audio signal are filtered according to a desired attenuation at a reference frequency relative to an attenuation at direct current (DC) of the desired reverberation response,

wherein the delays of the delayed outputs are determined according to a desired power of early reflections of the desired reverberation response,

wherein a decay characteristic of the reflection output is determined according to one or more of a desired delay time of an onset of late reverberation relative to a first reflection of the desired reverberation response and a desired reverberation decay time at low frequencies of the desired reverberation response,

wherein a characteristic of the filtered reflection output is determined according to a desired ratio of decay time at high frequencies relative to decay time at low frequencies of the desired reverberation response,

wherein a delay of the delayed filtered reflection output is determined according to a desired modal density of late reverberations of the desired reverberation response,

wherein the gain of the delayed filtered reflection output is controlled according to the desired reverberation decay time at low frequencies of the desired reverberation response, and

wherein a gain of the combined reflection output is controlled according to a desired power of early reflections of the desired reverberation response.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 16, 2008
From: ZONG, WENBO; WU, YUAN; GEORGE, SAPNA
To: STMICROELECTRONICS ASIA PACIFIC PTE., LTD.
Reel/Frame 020372/0900 →
Continuity (2)
Provisional Application 60857308 · Nov 7, 2006
Related Publication 20080137875A1 · Jun 12, 2008