IP Library › Granted Patent US 10,341,770
Granted Patent B2
US 10,341,770 · App. 15/275,162 · Granted Jul 2, 2019

Encoded audio metadata-based loudness equalization and dynamic equalization during DRC

Inventor: Frank Baumgarte (Sunnyvale, CA)
Assignee: Apple Inc.
H04R3/04G10L19/00G10L19/167H03G5/165H03G7/007G06F3/165H04N21/8113H04N21/84H04R2430/01
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 10,341,770
App. No.
15/275,162
Granted
Jul 2, 2019
Kind
B2
Abstract

Dynamic loudness equalization of received audio content in a playback system, using metadata that includes instantaneous loudness values for the audio content. A playback level is derived from a user volume setting of the playback system, and is compared with a mixing level that is assigned to the audio content. Parameters are computed, that define an equalization filter that is filtering the audio content before driving a speaker with the filtered audio content, based on the instantaneous loudness values and the comparing of the playback level with the assigned mixing level. Other embodiments are also described and claimed.

Claims (69)

1. A method for loudness equalization in a playback system, comprising:

receiving audio content, and metadata for the audio content, wherein the metadata includes a plurality of dynamic range control (DRC) gain values that have been computed for the audio content;

deriving a playback level from a user volume setting for the playback system;

comparing the playback level with an assigned mixing level that is assigned to the audio content;

applying an inverse DRC characteristic to the plurality of DRC gain values received in the metadata to compute a plurality of instantaneous loudness values for the audio content, wherein the inverse DRC characteristic is an inverse of a DRC characteristic that was applied to the audio content at an encoding side to produce the DRC gain values; and

computing a plurality of parameters that define an equalization filter by which the received audio content is filtered before driving a speaker in the playback system, wherein the parameters are computed based on 1) the plurality of instantaneous loudness values computed using the inverse DRC characteristic, and 2) the comparing of the playback level with the mixing level.

2. The method of claim 1 wherein the metadata does not contain a separate plurality of instantaneous loudness values for the audio content.

3. The method of claim 1 further comprising adjusting each of the computed plurality of instantaneous loudness values by a fixed offset value that represents a reference acoustic level.

4. The method of claim 1 further comprising:

filtering the received audio content by the equalization filter to produce EQ filtered audio content;

receiving a second plurality of DRC gain values in the metadata;

applying the second plurality of DRC gain values to the EQ filtered audio content to produce dynamic range control adjusted and EQ filtered audio content; and

correcting the computed plurality of instantaneous loudness values in accordance with the second plurality of DRC gain values, to produce corrected instantaneous loudness values, and wherein the plurality of parameters that define the equalization filter are computed based on the plurality of corrected instantaneous loudness values.

5. The method of claim 4 further comprising performing a DRC gain modification process in which the second plurality of DRC gain values are processed to produce modified DRC gain values,

wherein correcting the computed plurality of instantaneous loudness values comprises summing with the modified DRC gain values,

and wherein applying the second plurality of DRC gain values to the EQ filtered audio content to perform dynamic range control adjustments comprises multiplying the EQ filtered audio content by the modified DRC gain values.

6. The method of claim 1 further comprising:

receiving a second plurality of DRC gain values in the metadata;

applying the second plurality of DRC gain values to the audio content to produce dynamic range adjusted audio content;

filtering the dynamic range adjusted audio content by the equalization filter to produce EQ filtered and dynamic range adjusted audio content; and

correcting the computed plurality of instantaneous loudness values in accordance with the second plurality of DRC gain values, to produce corrected instantaneous loudness values, and wherein the plurality of parameters that define the equalization filter are computed based on the plurality of corrected instantaneous loudness values.

7. A method for dynamic audio equalization in a playback system that is applying dynamic range control, comprising:

receiving audio content, and metadata for the audio content, wherein the metadata includes a plurality of dynamic range control (DRC) gain values that have been computed for the audio content;

applying an inverse DRC characteristic to the plurality of DRC gain values received in the metadata to compute a plurality of instantaneous loudness values for the audio content, wherein the inverse DRC characteristic is an inverse of a DRC characteristic that was applied to the audio content at an encoding side to produce the DRC gain values;

computing a plurality of dynamic parameters that define an equalization filter, wherein the dynamic parameters are computed based on the computed plurality of instantaneous loudness values;

filtering the audio content by the equalization filter to produce EQ filtered audio content;

processing the plurality of DRC gain values received in the metadata to compute a plurality of DRC gain adjustment values; and

applying the plurality of DRC gain adjustment values to the EQ filtered audio content to perform dynamic range control.

8. The method of claim 7 further comprising

correcting the computed plurality of instantaneous loudness values in accordance with the plurality of DRC gain adjustment values, to produce corrected instantaneous loudness values, and wherein the plurality of dynamic parameters that define the equalization filter are computed based on the plurality of corrected instantaneous loudness values.

9. The method of claim 8 wherein correcting the computed plurality of instantaneous loudness values comprises summing the computed plurality of instantaneous loudness values with the plurality of DRC gain adjustment values, in dB format.

10. The method of claim 7 wherein the metadata includes static filter configuration data that specifies one or more of the following for defining the equalization filter: a) type, such as low-frequency cut or boost, or high-frequency cut or boost, b) filter strength, and c) adaptation or effective frequency range,

wherein the equalization filter as configured in accordance with the static filter configuration data is dynamically modified by the dynamic parameters, while the audio content is passing through it.

11. The method of claim 7 wherein computing the plurality of dynamic parameters that define the equalization filter does not use a mixing level or a playback level.

12. A method for dynamic audio equalization in a playback system that is applying dynamic range control, comprising:

receiving audio content, and metadata for the audio content, wherein the metadata includes a plurality of dynamic range control (DRC) gain values that have been computed for the audio content;

computing a plurality of dynamic parameters that define an equalization filter, wherein the dynamic parameters are computed based on applying an inverse DRC characteristic to the DRC gain values received in the metadata, wherein the inverse DRC characteristic is an inverse of a DRC characteristic that was applied to the audio content at an encoding side to produce the DRC gain values;

filtering the received audio content by the equalization filter, to produce EQ filtered audio content;

processing the plurality of DRC gain values received in the metadata to compute a plurality of DRC gain adjustment values; and

applying the computed plurality of DRC gain adjustment values to the EQ filtered audio content to perform dynamic range control.

13. An article of manufacture comprising:

a non-transitory machine readable medium having stored therein instructions that when executed by a processor of an audio playback system, perform loudness equalization in the playback system by,

receiving audio content, and metadata for the audio content, wherein the metadata includes a plurality of dynamic range control (DRC) gain values that have been computed for the audio content;

deriving a playback level from a user volume setting for the playback system;

comparing the playback level with an assigned mixing level that is assigned to the audio content;

applying an inverse DRC characteristic to the plurality of DRC gain values received in the metadata to compute a plurality of instantaneous loudness values for the audio content, wherein the inverse DRC characteristic is an inverse of a DRC characteristic that was applied to the audio content at an encoding side to produce the DRC gain values; and

computing a plurality of parameters that define an equalization filter by which the received audio content is filtered before driving a speaker in the playback system, wherein the parameters are computed based on 1) the plurality of instantaneous loudness values computed using the inverse DRC characteristic, and 2) the comparing of the playback level with the mixing level.

14. The article of manufacture of claim 13 wherein the non-transitory machine readable medium has stored therein instructions that when executed by the processor,

adjust each of the computed plurality of instantaneous loudness values by a fixed offset value that represents a reference acoustic level.

15. The article of manufacture of claim 13 wherein the non-transitory machine readable medium has stored therein instructions that when executed by the processor,

filter the received audio content using the equalization filter, to produce EQ filtered audio content,

receive a second plurality of DRC gain values in the metadata,

apply the second plurality of DRC gain values to the EQ filtered audio content to produce dynamic range control adjusted and EQ filtered audio content, and

correct the computed plurality of instantaneous loudness values in accordance with the second plurality of DRC gain values, to produce corrected instantaneous loudness values, and wherein the plurality of parameters that define the equalization filter are computed based on the plurality of corrected instantaneous loudness values.

16. The article of manufacture of claim 15 wherein the non-transitory machine readable medium has stored therein further instructions that when executed by the processor,

perform a DRC gain modification process in which the second plurality of DRC gain values are processed to produce modified DRC gain values,

wherein correcting the computed plurality of instantaneous loudness values comprises summing with the modified DRC gain values, and

wherein applying the second plurality of DRC gain values to the EQ filtered audio content to perform dynamic range control adjustments comprises multiplying the EQ filtered audio content by the modified DRC gain values.

17. The article of manufacture of claim 15 wherein the non-transitory machine readable medium has stored therein further instructions that when executed by the processor,

receive a second plurality of DRC gain values in the metadata,

apply the second plurality of DRC gain values to the audio content to produce dynamic range adjusted audio content,

filter the dynamic range adjusted audio content by the equalization filter to produce EQ filtered and dynamic range adjusted audio content, and

correct the computed plurality of instantaneous loudness values in accordance with the second plurality of DRC gain values, to produce corrected instantaneous loudness values, and wherein the plurality of parameters that define the equalization filter are computed based on the plurality of corrected instantaneous loudness values.

18. The method of claim 1 wherein computing the parameters that define the equalization filter comprises computing a low frequency shaping filter and a high frequency shaping filter, wherein the low and high frequency shaping filters are in cascade as part of the equalization filter.

19. The method of claim 1 wherein deriving the playback level further comprises using a value that represents sensitivity of the playback system.

20. The method of claim 1 wherein the assigned mixing level was received as part of the metadata and is a mixing level that was used when the audio content was being produced or played back in a production system.

21. The method of claim 1 wherein the assigned mixing level is an average mixing level.

22. The method of claim 1 wherein the assigned mixing level is as defined in any Advanced Television Systems Committee ATSC Standard.

23. The method of claim 1 wherein if the playback level is lower than the mixing level, an amount of boost imparted by the EQ filter is increased.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 27, 2016
From: BAUMGARTE, FRANK
To: APPLE INC.
Reel/Frame 039868/0941 →
Continuity (2)
Provisional Application 62235293 · Sep 30, 2015
Related Publication 20170094409A1 · Mar 30, 2017
Cited By (4)
US 12,563,339 US 12,633,887 US 12,707,199 US 12,712,509