Audio depth dynamic range enhancement
View Patent ↗An audio depth dynamic range enhancement system and method for enhancing the dynamic range of depth in audio sound systems as perceived by a human listener. Embodiments of the system and method process an input audio signal by applying a gain function to at least one of a plurality of sub-signals of the audio signal having different values of a spatial depth parameter. The sub-signals are combined to produce a reconstructed audio signal carrying modified audio information. The reconstructed audio signal is output from the system and method for reproduction by the audio sound system. The gain function alters the gain of the at least one of the plurality of sub-signals such that the reconstructed audio signal, when reproduced by the audio sound system, results in modified depth dynamic range of the audio sound system with respect to the spatial depth parameter.
1. A method for modifying depth dynamic range for an audio sound system, comprising:
separating an input audio signal into a plurality of sub-signals, each of the plurality of sub-signals having different values of a spatial depth parameter that represents a relative perceived distance between a listener and an object on the screen;
altering a gain of at least one of the plurality of sub-signals by applying a gain function to the selected sub-signals such that a reconstructed audio signal models frequency-dependent attenuation of sound through air over a distance, the input audio signal carrying audio information for reproduction by the audio sound system; and
combining the plurality of sub-signals to produce a reconstructed audio signal carrying modified audio information for reproduction by the audio sound system such that the reconstructed audio signal, when reproduced by the audio sound system, results in modified depth dynamic range of the audio sound system with respect to the spatial depth parameter such that values of the spatial depth parameter in the selected sub-signals are increased or decreased in the reconstructed audio signal.
2. The method of claim 1 further comprising determining an estimated signal energy of the at least one of the plurality of sub-signals, and wherein the gain function is a function of the estimated signal energy.
3. The method of claim 1 further comprising:
determining an estimated signal energy of the at least one of the plurality of sub-signals; and
normalizing the estimated signal energy of the at least one of the plurality of sub-signals, and wherein the gain function is a function of the normalized estimated signal energy.
4. The method of claim 1 wherein the gain function is a non-linear function of normalized estimated signal energy of the sub-signal.
5. The method of claim 1 wherein the step of applying a gain function to at least one of the plurality of sub-signals further comprises applying a plurality of gain functions respectively to each of the plurality of sub-signals.
6. The method of claim 5 wherein the plurality of gain functions have the same mathematical formula.
7. The method of claim 5 wherein the plurality of gain functions have different mathematical formulas.
8. The method of claim 5 wherein the gain functions collectively alter the sub-signals in a manner such that the reconstructed audio signal has an overall signal energy that is unchanged regardless of signal energies of the plurality of sub-signals relative to each other.
9. The method of claim 1 wherein the audio sound system is part of a 3D audiovisual system.
10. The method of claim 1 wherein the audio sound system is a multichannel surround-sound system.
11. The method of claim 1 wherein the audio sound system is a stereo sound system.
12. The method of claim 1 wherein the input audio signal and the reconstructed audio signal are multi-channel audio signals containing a plurality of tracks of a multi-channel recording.
13. The method of claim 1 wherein the gain function is derived in real time solely from content of the input audio signal itself.
14. The method of claim 1 wherein the gain function is derived at least in part from data external to the input audio signal itself.
15. The method of claim 14 wherein the external data is metadata provided along with the input audio signal.
16. The method of claim 14 wherein the external data is data derived from the entirety of the input audio signal prior to playback of the reconstructed audio signal by the audio sound system.
17. The method of claim 14 wherein the external data is data derived from a video signal accompanying the input audio signal.
18. The method of claim 14 wherein the external data is data controlled interactively by a user of the audio sound system.
19. The method of claim 14 , wherein the external data is data obtained from an active room calibration of a listening environment of the audio sound system.
20. The method of claim 14 , wherein the external data is a function of reverberation time in a listening environment, and wherein the gain function applied to the at least one of the plurality of sub-signals is dependent on the reverberation time in the listening environment.
21. The method of claim 1 wherein the gain function is a function of an assumed distance between a sound source and a listener in a listening environment of the audio sound system.
22. The method of claim 1 wherein the gain function alters the gain of the at least one of the plurality of sub-signals so that the reconstructed audio signal has accentuated values of the spatial depth parameter when the spatial depth parameter is near a maximum or minimum value.
23. The method of claim 1 wherein the gain function is derived from a lookup table.
24. The method of claim 1 wherein the gain function is a mathematical formula.
25. The method of claim 1 wherein the spatial depth parameter is directness versus diffuseness of the sub-signal of the input audio signal.
26. The method of claim 1 wherein the spatial depth parameter is spatial dispersion of the sub-signal among a plurality of audio speakers.
27. The method of claim 1 wherein the spatial depth parameter is an audio spectral envelope of the sub-signal of the input audio signal.
28. The method of claim 1 wherein the spatial depth parameter is interaural time delay.
29. The method of claim 1 wherein the spatial depth parameter is interaural channel coherence.
30. The method of claim 1 wherein the spatial depth parameter is interaural intensity difference.
31. The method of claim 1 wherein the spatial depth parameter is harmonic phase coherence.
32. The method of claim 1 wherein the spatial depth parameter is psychoacoustic loudness.
33. The method of claim 1 further comprising:
applying the gain function in a time domain; and
combining the plurality of sub-signals in the time domain to produce a reconstructed audio signal.
34. The method of claim 1 further comprising:
applying the gain function in a frequency domain; and
combining the sub-signals in the frequency domain to produce a reconstructed audio signal.
35. The method of claim 1 further comprising separating the input audio signal, based on the spatial depth parameter, into the plurality of sub-signals having different values of the spatial depth parameter.
36. A method for enhancing a dynamic range of perceived depth in an input audio signal, comprising:
separating the input audio signal into a primary element signal and an ambient element signal;
multiplying the primary element signal and a primary gain to obtain a gain-multiplied primary element signal;
multiplying the ambient element signal and an ambient gain to obtain a gain-multiplied ambient element signal; and
combining the gain-multiplied primary element signal and the gain-multiplied ambient element signal to obtain a reconstructed audio signal having a modified dynamic range of perceived depth along an imaginary depth axis as compared to the input audio signal such that the primary and ambient gains produce a compression or expansion of the dynamic range of perceived depth along the imaginary depth axis.
37. The method of claim 36 , further comprising:
estimating a signal energy of the primary element signal and a signal energy of the ambient element signal;
calculating the primary gain based on the normalized signal energy of the primary element signal; and
calculating the ambient gain based on the normalized signal energy of the ambient element signal.
38. An audio depth dynamic range enhancement system for modifying depth dynamic range for an audio sound system, comprising:
an input for receiving an input audio signal carrying audio information for reproduction by the audio sound system;
a processing component programmed to process the input audio signal by:
applying a gain function to at least one of a plurality of sub-signals of the input audio signal, each of the plurality of sub-signals having different values of a spatial depth parameter that represents a relative perceived distance between a listener and an object on the screen; and
combining the sub-signals, after application of the gain function to the at least one of the sub-signals, to produce a reconstructed audio signal carrying modified audio information for reproduction by the audio sound system, the reconstructed audio signal having a modified dynamic range of perceived depth along an imaginary depth axis as compared to the input audio signal such that the gain function produces a compression or expansion of the dynamic range of perceived depth along the imaginary depth axis; and
an output for outputting the reconstructed audio signal for reproduction by the audio sound system;
the gain function altering gain of the at least one of the sub-signals such that the reconstructed audio signal, when reproduced by the audio sound system, results in modified depth dynamic range of the audio sound system with respect to the spatial depth parameter.
39. The audio depth dynamic range enhancement system of claim 38 wherein the gain function is non-linear with respect to the signal energy of the sub-signal.