Systems and methods for identifying and remediating sound masking
Some embodiments of the invention are directed to enabling a user to easily identify the frequency range(s) at which sound masking occurs, and addressing the masking, if desired. In this respect, the extent to which a first stem is masked by one or more second stems in a frequency range may depend not only on the absolute value of the energy of the second stem(s) in the frequency range, but also on the relative energy of the first stem with respect to the second stem(s) in the frequency range. Accordingly, some embodiments are directed to modeling sound masking as a function of the energy of the stem being masked and of the relative energy of the masked stem with respect to the masking stem(s) in the frequency range, such as by modeling sound masking as loudness loss, a value indicative of the reduction in loudness of a stem of interest caused by the presence of one or more other stems in a frequency range.
1. A method comprising acts of:
(A) identifying a plurality of sound masking events in which sound in a first audio recording during a time period in a frequency range is masked by sound in a second audio recording during the time period in the frequency range, each sound masking event having an associated loudness loss defining a magnitude of the sound masking event, the loudness loss associated with each sound masking event being based at least in part on a difference between a loudness of the sound in the first audio recording occurring in isolation and a partial loudness of the sound in the first audio recording occurring concurrently with the sound in the second audio recording;
(B) identifying a subset of the plurality of sound masking events as having a greater associated loudness loss than others of the plurality of sound masking events; and
(C) causing a representation of the identified subset of the plurality of sound masking events to be displayed to a user on a graphical user interface.
2. The method of claim 1 , wherein the act (B) comprises identifying sound masking events having an associated loudness loss in the 99 th percentile or greater.
3. The method of claim 1 , wherein the act (B) comprises identifying sound masking events having an associated loudness loss in the 95 th percentile or greater.
4. The method of claim 1 , wherein the act (B) comprises identifying sound masking events having an associated loudness loss in the 90 th percentile or greater.
5. The method of claim 1 , wherein the act (B) comprises identifying sound masking events having an associated loudness loss in the 80 th percentile or greater.
6. The method of claim 1 , wherein the representation which is caused to be displayed in the act (C) is a bar graph in which each bar represents a number of sound masking events in the identified subset observed in a frequency range.
7. The method of claim 6 , wherein each bar represents a number of sound masking events in the identified subset occurring within a predetermined amount of time prior to display.
8. The method of claim 6 , wherein each bar represents a number of sound masking events in the identified subset occurring for at least a predetermined amount of time.
9. The method of claim 1 , wherein the act (C) comprises causing display of a graphical user interface providing controls for adjusting equalization parameters for at least one of the first audio recording and the second audio recording.
10. The method of claim 9 , wherein the controls enable a user to increase an amplitude of a filter applied to at least one of the first audio recording and the second audio recording in a frequency range, decrease an amplitude of a filter applied to at least one of the first audio recording and the second audio recording in a frequency range, and/or modify a center frequency at which a filter is applied to at least one of the first audio recording and the second audio recording.
11. The method of claim 1 , wherein the act (C) comprises causing display of a graphical user interface providing controls for adjusting a threshold loudness loss defining how many sound masking events are included in the subset.
12. At least one non-transitory computer-readable storage medium having instructions encoded thereon which, when executed in a computing system, cause the computing system to perform a method comprising acts of:
(A) identifying a plurality of sound masking events in which sound in a first audio recording during a time period in a frequency range is masked by sound in a second audio recording during the time period in the frequency range, each sound masking event having an associated loudness loss defining a magnitude of the sound masking event, the loudness loss associated with each sound masking event being based at least in part on a difference between a loudness of the sound in the first audio recording occurring in isolation and a partial loudness of the sound in the first audio recording occurring concurrently with the sound in the second audio recording;
(B) identifying a subset of the plurality of sound masking events as having a greater associated loudness loss than others of the plurality of sound masking events; and
(C) causing a representation of the identified subset of the plurality of sound masking events to be displayed to a user on a graphical user interface.
13. A system, comprising:
at least one computer-readable storage medium, having instructions encoded thereon; and
at least one computer processor, programmed via the instructions to:
identify a plurality of sound masking events in which sound in a first audio recording during a time period in a frequency range is masked by sound in a second audio recording during the time period in the frequency range, each sound masking event having an associated loudness loss defining a magnitude of the sound masking event, the loudness loss associated with each sound masking event being based at least in part on a difference between a loudness of the sound in the first audio recording occurring in isolation and a partial loudness of the sound in the first audio recording occurring concurrently with the sound in the second audio recording;
identify a subset of the plurality of sound masking events as having a greater associated loudness loss than others of the plurality of sound masking events; and
cause a representation of the identified subset of the plurality of sound masking events to be displayed to a user via a graphical user interface.
14. The system of claim 13 , wherein the at least one computer processor is programmed via the instructions to identify sound masking events having an associated loudness loss in the 99 th percentile or greater.
15. The system of claim 13 , wherein the at least one computer processor is programmed via the instructions to cause to be displayed a representation comprising a bar graph in which each bar represents a number of sound masking events in the identified subset observed in a frequency range.
16. The system of claim 15 , wherein each bar represents a number of sound masking events in the identified subset occurring within a predetermined amount of time prior to display.
17. The system of claim 16 , wherein each bar represents a number of sound masking events in the identified subset occurring for at least a predetermined amount of time.
18. The system of claim 13 , wherein the at least one computer processor is programmed via the instructions to cause display of a graphical user interface providing controls for adjusting equalization parameters for at least one of the first audio recording and the second audio recording.
19. The system of claim 18 , wherein the controls enable a user to increase an amplitude of a filter applied to at least one of the first audio recording and the second audio recording in a frequency range, decrease an amplitude of a filter applied to at least one of the first audio recording and the second audio recording in a frequency range, and/or modify a center frequency at which a filter is applied to at least one of the first audio recording and the second audio recording.
20. The system of claim 13 , wherein the at least one computer processor is programmed via the instructions to cause display of a graphical user interface providing controls for adjusting a threshold loudness loss defining how many sound masking events are included in the subset.