Dialog audio signal balancing in an object-based audio program
Systems, devices, and methods are described herein for adjusting a relationship between dialog and non-dialog signals in an audio program. In an example, information about a long-term dialog balance for an audio program can be received. The long-term loudness dialog balance can indicate a dialog-to-non-dialog loudness relationship of the audio program. A dialog loudness preference can be received, such as from a user, from a database, or from another source. A desired long-term gain or attenuation can be determined according to a difference between the received long-term dialog balance for the audio program and the received dialog balance preference. The long-term gain or attenuation can be applied to at least one of the dialog signal and the non-dialog signal of the audio program to render an audio program that is enhanced according to the loudness preference.
1. A method for adjusting a loudness relationship between a dialog signal and a separate non-dialog signal in a particular audio program, the method comprising:
receiving, using a processor circuit, a long-term dialog balance metric for the particular audio program, the long-term dialog balance metric indicating a dialog-to-non-dialog loudness relationship for the dialog and non-dialog signals of the particular audio program;
receiving, using the processor circuit, an audio program-independent long-term dialog balance preference that indicates a user-specified preference for a loudness relationship for multiple different audio programs; and
determining, using the processor circuit, a long-term gain or attenuation to apply to at least one of the dialog signal and the non-dialog signal of the particular audio program, the long-term gain or attenuation determined according to a difference between the received long-term dialog balance metric for the particular audio program and the received audio program-independent long-term dialog balance preference.
2. The method of claim 1 , further comprising:
determining the long-term gain to apply to the dialog signal of the particular audio program;
applying the determined long-term gain to the dialog signal using the processor circuit to generate a gain-adjusted dialog signal; and
rendering an audio output signal that includes a combination of the gain-adjusted dialog signal and the non-dialog signal.
3. The method of claim 1 , further comprising:
determining the long-term attenuation to apply to the dialog signal of the particular audio program;
applying the determined long-term attenuation to the dialog signal using the processor circuit to generate an adjusted dialog signal; and
rendering an audio output signal that includes a combination of the adjusted dialog signal and the non-dialog signal.
4. The method of claim 1 , further comprising determining different respective long-term gain or attenuation amounts to apply to the dialog signal and the non-dialog signal.
5. The method of claim 1 , further comprising:
receiving, using the processor circuit, a long-temi dialog loudness metric corresponding to the dialog signal of the particular audio program;
receiving a long-term non-dialog loudness metric corresponding to the non-dialog signal of the particular audio program; and
providing, using the processor circuit, the long-term dialog balance metric based on a difference between the received dialog and non-dialog loudness metrics.
6. The method of claim 1 , further comprising:
receiving the dialog signal at the processor circuit, the dialog signal including first metadata with information about a global loudness of the dialog signal for the particular audio program;
receiving the non-dialog signal at the processor circuit, the non-dialog signal including second metadata with information about a global loudness of the non-dialog signal for the particular audio program; and
wherein the receiving the long-term dialog balance metric for the particular audio program includes determining, using the processor circuit, the long-term dialog balance metric based on the global loudness of the dialog signal and the global loudness of the non-dialog signal.
7. The method of claim 1 , wherein the determining the long-term gain or attenuation includes determining a static gain or attenuation to apply to the dialog signal for a duration of the particular audio program.
8. The method of claim 1 , wherein the receiving the audio program-independent long-term dialog balance preference includes receiving a genre-specific dialog loudness preference, the genre-specific dialog loudness preference corresponding to a genre of the particular audio program.
9. The method of claim 8 , further comprising determining the genre of the particular audio program based on metadata recovered from the dialog signal and/or from the non-dialog signal.
10. The method of claim 1 , wherein the receiving the audio program-independent long-term dialog balance preference includes receiving a playback device-specific dialog loudness preference, the playback device-specific dialog loudness preference corresponding to a playback device that is configured to play the particular audio program.
11. The method of claim 1 , further comprising:
receiving, using the processor circuit, a short-term dialog balance for each of multiple segments of the particular audio program, wherein each short-term dialog balance indicates a dialog-to-non-dialog loudness relationship for a specified segment;
receiving, using the processor circuit, a short-tetra dialog balance preference; and
determining, using the processor circuit, a short-term gain or attenuation to apply to at least one of the dialog signal and the non-dialog signal, the short-term gain or attenuation determined according to a difference between the received short-term loudness balance for a specified one of the segments and the short-term dialog loudness preference.
12. The method of claim 11 , further comprising:
providing a gain-adjusted dialog signal and/or a gain-adjusted non-dialog signal by (1) applying the determined long-term gain or attenuation to at least one of the dialog signal and the non-dialog signal, and (2) applying the determined short-term gain or attenuation to at least one of the dialog signal and the non-dialog signal; and
rendering an audio output signal that includes the gain-adjusted dialog signal and/or the gain-adjusted non-dialog signal.
13. An audio signal processing system comprising:
a decoder device, including:
a first data input configured to receive a dialog signal, a non-dialog signal, and metadata corresponding to the dialog signal and/or the non-dialog signal;
a second data input configured to receive an audio program-independent long-term dialog balance preference indicative of a user-specified preferred loudness relationship between dialog and non-dialog components of an audio program;
an audio signal output; and
a processor circuit configured to:
identify, using the metadata corresponding to the dialog signal and/or the non-dialog signal, a long-term dialog balance metric for a particular audio program comprising the dialog signal and the non-dialog signal, the long-term dialog balance metric indicating a dialog-to-non-dialog loudness relationship for the dialog and non-dialog signals of the particular audio program;
determine a long-term gain or attenuation to apply to one of the dialog signal and the non-dialog signal of the particular audio program, the long-term gain or attenuation based on a difference between the identified long-term dialog balance metric for the particular audio program and the received audio program-independent long-term dialog balance preference; and
provide an audio program signal at the audio signal output, the audio program signal including a combination of the one of the dialog signal and the non-dialog signal processed according to the determined long-term gain or attenuation, and the other one of the dialog signal and the non-dialog signal.
14. The system of claim 13 , wherein the decoder device includes a third input configured to receive an audio program type indication that corresponds to the dialog signal and/or the non-dialog signal; and
wherein the processor circuit is configured to determine the long-term gain or attenuation based on the audio program type indication and the difference between the identified long-term dialog balance for the particular audio program and the received audio program-independent long-term dialog balance preference.
15. The system of claim 13 , wherein the first data input is configured to receive metadata corresponding to the dialog signal and the non-dialog signal;
wherein the processor circuit is configured to identify respective long-term loudness characteristics of the dialog and non-dialog signals based on the received metadata corresponding to the dialog and non-dialog signals; and
wherein the processor circuit is configured to identify the long-term dialog balance for the particular audio program based on a relationship between the long-term loudness characteristics of the dialog and non-dialog signals.
16. The system of claim 13 , wherein the processor circuit is further configured to process the dialog signal according to a user-specified short-term dialog balance preference setting.
17. An audio signal processing system for adjusting a balance between separate dialog and non-dialog audio signals that comprise portions of a particular audio program, the system comprising:
a processor circuit configured to:
identify a long-term loudness metric for the dialog audio signal, the long-term dialog loudness metric representing a loudness characteristic of a dialog portion of the particular audio program;
identify a long-term loudness metric for the non-dialog audio signal, the long-term non-dialog loudness metric representing a loudness characteristic of a non-dialog portion of the particular audio program; and
when a loudness relationship between the long-term loudness metric for the dialog audio signal and the long-term loudness metric for the non-dialog audio signal differs from a desired loudness relationship by greater than a specified threshold amount, provide an audio program signal that includes a gain-adjusted version of at least one of the dialog signal and the non-dialog signal, wherein the specified threshold difference amount is deter mined using a received audio program-independent long-term dialog loudness preference.
18. The system of claim 17 , wherein the processor circuit is configured to determine an amount of gain to apply to the dialog signal and/or to the non-dialog signal based on a received indication of a program type corresponding to the particular audio program.
19. The system of claim 17 , wherein the processor circuit is configured to determine an amount of gain to apply to the dialog signal and/or to the non-dialog signal based on a user preference corresponding to the audio program-independent long-term dialog loudness preference.
20. The system of claim 17 , wherein the processor circuit is configured to determine an amount of gain to apply to the dialog signal and/or to the non-dialog signal based on a received indication of a playback environment or playback device.