Decorrelating objects based on attention
A method includes determining a measure of a user's attention to a sound source in a spatial audio environment. Based on the measure of the user's attention to the sound source, one or more filters for decorrelating the sound source are determined. The sound source is spatially rendered, including applying the one or more filters to the sound source.
1 . A method for processing audio, comprising:
determining a measure of a user's attention to a sound source,
determining one or more filters that decorrelate the sound source based on 1) the measure of the user's attention to the sound source and 2) content-type, importance, or loudness level that is associated with the sound source;
determining whether the sound source is within a threshold distance of a position of the user;
responsive to a determination that the sound source is beyond the threshold distance, spatially rendering the sound source, while omitting an application of the one or more filters; and
responsive to a determination that the sound source is within the threshold distance, spatially rendering the sound source, including applying the one or more filters to the sound source.
2 . The method of claim 1 , wherein determining the one or more filters that decorrelate the sound source includes increasing decorrelation of the sound source in response to a decrease in the measure of the user's attention to the sound source.
3 . The method of claim 1 , wherein determining the one or more filters that decorrelate the sound source includes decreasing decorrelation of the sound source in response to an increase in the measure of the user's attention to the sound source.
4 . The method of claim 1 , wherein decorrelation of the sound source is increased when the measure of the user's attention to the sound source satisfies a threshold.
5 . The method of claim 1 , wherein the measure of the user's attention is determined based on one or more of: a head position of the user, eye tracking of the user, and interaction with the sound source by the user.
6 . The method of claim 1 , wherein the one or more filters include frequency dependent phase shifts or time delays.
7 . The method of claim 1 , wherein determining the one or more filters that decorrelate the sound source comprises:
determining a decorrelation function that indicates decorrelation of the sound source with respect to the measure of user's attention to the sound source, wherein the decorrelation function comprises a constant decorrelation level between at least a first measure threshold and a second measure threshold and a variable portion between at least the second measure threshold and a third measure threshold that is greater than the first measure threshold and the second measure threshold; and
determining a decorrelation for the sound source from the decorrelation function that is associated with the measure of the user's attention.
8 . The method of claim 7 , wherein the constant decorrelation level is based on the content-type or the importance.
9 . An electronic device, including a processor that is configured to perform an operation comprising:
determining a measure of a user's attention to a sound source, among a plurality of sound sources in a spatial audio environment, based on interaction with the sound source by the user,
based on the measure of the user's attention to the sound source, determining one or more filters that decorrelate the sound source; and
spatially rendering the sound source, including applying the one or more filters to the sound source, in the spatial audio environment.
10 . The electronic device of claim 9 , wherein determining the one or more filters that decorrelate the sound source includes increasing decorrelation of the sound source in response to a decrease in the measure of the user's attention to the sound source.
11 . The electronic device of claim 9 , wherein determining the one or more filters that decorrelate the sound source includes decreasing decorrelation of the sound source in response to an increase in the measure of the user's attention to the sound source.
12 . The electronic device of claim 9 , wherein decorrelation of the sound source is increased when the measure of the user's attention to the sound source satisfies a threshold.
13 . The electronic device of claim 9 , wherein the measure of the user's attention is further determined based on one or more of: a head position of the user or eye tracking of the user.
14 . The electronic device of claim 9 , wherein the one or more filters include frequency dependent phase shifts or time delays.
15 . The electronic device of claim 9 , wherein the electronic device includes at least one of: a computer, a tablet computer, a smart phone, a headphone set, or a head mounted display (HMD).
16 . An article of manufacture that has a processor that is configured to perform the following:
determining a measure of a user's attention to a sound source, among a plurality of sound sources in a spatial audio environment;
determining one or more filters that decorrelate the sound source based on 1) the measure of the user's attention to the sound source and 2) content-type, importance, or loudness level that is associated with the sound source;
determining whether the sound source is within a threshold distance of a position of the user;
responsive to a determination that the sound source is beyond the threshold distance, spatially rendering the sound source, while omitting an application of the one or more filters; and
responsive to a determination that the sound source is within the threshold distance, spatially rendering the sound source, including applying the one or more filters to the sound source, in the spatial audio environment.
17 . The article of manufacture of claim 16 , wherein determining the one or more filters that decorrelate the sound source includes increasing decorrelation of the sound source in response to a decrease in the measure of the user's attention to the sound source.
18 . The article of manufacture of claim 16 , wherein determining the one or more filters that decorrelate the sound source includes decreasing decorrelation of the sound source in response to an increase in the measure of the user's attention to the sound source.
19 . The article of manufacture of claim 16 , wherein decorrelation of the sound source is increased when the measure of the user's attention to the sound source satisfies a threshold.
20 . The article of manufacture of claim 16 , wherein the measure of the user's attention is determined based on one or more of: a head position of the user, eye tracking of the user, and interaction with the sound source by the user.