IP Library › Granted Patent US 12,279,104
Granted Patent B1
US 12,279,104 · App. 18/984,971 · Granted Apr 15, 2025

Loudness adjustment for downmixed audio content

Inventors: Michael C. Ward (Orinda, CA); Jeffrey Riedmiller (Novato, CA); Scott Gregory Norcross (San Rafael, CA); Alexander Stahlmann (Bubenreuth, DE)
Assignees: Dolby Laboratories Licensing Corporation; DOLBY INTERNATIONAL AB
H04S7/30G10L19/008G10L21/0324H04S1/002H04S1/007H04S2400/03H04S2400/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,279,104
App. No.
18/984,971
Granted
Apr 15, 2025
Kind
B1
Abstract

Audio content coded for a reference speaker configuration is downmixed to downmix audio content coded for a specific speaker configuration. One or more gain adjustments are performed on individual portions of the downmix audio content coded for the specific speaker configuration. Loudness measurements are then performed on the individual portions of the downmix audio content. An audio signal that comprises the audio content coded for the reference speaker configuration and downmix loudness metadata is generated. The downmix loudness metadata is created based at least in part on the loudness measurements on the individual portions of the downmix audio content.

Claims (23)

1. A method for loudness adjustment of at least an audio signal, the method comprising:

receiving, by an audio decoder, the audio signal comprising audio sample data for a reference channel configuration and encoder-generated loudness metadata corresponding to a plurality of specific channel configurations, wherein the audio decoder is configured to operate in at least one of the plurality of specific channel configurations;

selecting a specific playback environment corresponding to one of the plurality of specific channel configurations;

selecting specific loudness metadata based on the encoder-generated loudness metadata and the specific playback environment;

determining loudness information based on the specific loudness metadata;

determining at least a gain as a part of overall gains to applied to the audio sample data based on the loudness information; and

applying the gain to the audio sample data to generate output audio.

2. The method of claim 1 , further comprising applying a gain limiter for the specific playback environment.

3. The method of claim 1 , further comprising clipping the gain.

4. The method of claim 3 , wherein the clipping ensures loudness levels to be no more than a clipping level for the specific playback environment.

5. The method of claim 1 , further comprising determining a downmixing and further determining the loudness information based on the downmixing.

6. A non-transitory computer readable storage medium, storing software instructions, which when executed by one or more processors cause performing the method of claim 1 .

7. An audio signal processing device for gain adjusting audio signals based on encoder-generated loudness metadata, wherein the audio signal processing device:

receives, by an audio decoder, the audio signal comprising audio sample data for a reference channel configuration and encoder-generated loudness metadata corresponding to a plurality of specific channel configurations, wherein the audio decoder is configured to operate in at least one of the plurality of specific channel configurations;

selects a specific playback environment corresponding to one of the plurality of specific channel configurations;

selects specific loudness metadata based on the encoder-generated loudness metadata and the specific playback environment;

determines loudness information based on the specific loudness metadata;

determines at least a gain as a part of overall gains to applied to the audio sample data based on the loudness information; and

applies the gain to the audio sample data to generate output audio.

8. The apparatus of claim 7 , wherein the audio signal processing device further applies a gain limiter for the specific playback environment.

9. The apparatus of claim 7 , wherein the audio signal processing device further clips the gain.

10. The apparatus of claim 9 , wherein the clipping ensures loudness levels to be no more than a clipping level for the specific playback environment.

11. The apparatus of claim 7 , wherein the audio signal processing device further determines a downmixing and further determining the loudness information based on the downmixing.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jun 25, 2025
From: WARD, MICHAEL; RIEDMILLER, JEFFREY; NORCROSS, SCOTT GREGORY; STAHLMANN, ALEXANDER
To: DOLBY LABORATORIES LICENSING CORPORATION; DOLBY INTERNATIONAL AB
Reel/Frame 071517/0922 →
Continuity (12)
Continuation 18084447 · Dec 19, 2022
Continuation 17240901 · Apr 26, 2021
Continuation 16882745 · May 26, 2020
Continuation 16505448 · Jul 8, 2019
Division 16115292 · Aug 28, 2018
Continuation 15625749 · Jun 16, 2017
Continuation 15091366 · Apr 5, 2016
Continuation 14916522
Provisional Application 61938043 · Feb 10, 2014
Provisional Application 61892313 · Oct 17, 2013
Provisional Application 61891324 · Oct 15, 2013
Provisional Application 61877230 · Sep 12, 2013
References Cited (191)
US 5297236A · Antill · 1994 [cited by applicant]
US 6530021B1 · Epstein · 2003 [cited by applicant]
US 6611607B1 · Davis · 2003 [cited by applicant]
US 6909743B1 · Ward · 2005 [cited by applicant]
US 6975254B1 · Sperschneider · 2005 [cited by applicant]
US 7072477B1 · Kincaid · 2006 [cited by applicant]
US 7369906B2 · Frindle · 2008 [cited by applicant]
US 7729673B2 · Romesburg · 2010 [cited by applicant]
US 8091025B2 · Ramos · 2012 [cited by applicant]
US 8204756B2 · Kim · 2012 [cited by applicant]
US 8285791B2 · Ratcliff · 2012 [cited by applicant]
US 8306406B2 · Morita · 2012 [cited by applicant]
US 8315396B2 · Schreiner · 2012 [cited by applicant]
US 8417531B2 · Kim · 2013 [cited by applicant]
US 8737802B2 · Baek · 2014 [cited by applicant]
US 8781820B2 · Seguin · 2014 [cited by applicant]
US 8903098B2 · Tsuji · 2014 [cited by applicant]
US 8903729B2 · Riedmiller · 2014 [cited by applicant]
US 8965774B2 · Eppolito · 2015 [cited by applicant]
US 8989884B2 · Guetta · 2015 [cited by applicant]
US 9240763B2 · Baumgarte · 2016 [cited by applicant]
US 9294062B2 · Hatanaka · 2016 [cited by applicant]
US 9300268B2 · Chen · 2016 [cited by applicant]
US 9372531B2 · Benson · 2016 [cited by applicant]
US 9542952B2 · Hatanaka · 2017 [cited by applicant]
US 9576585B2 · Bleidt · 2017 [cited by applicant]
US 9608588B2 · Baumgarte · 2017 [cited by applicant]
US 9633663B2 · Heuberger · 2017 [cited by applicant]
US 9830915B2 · Schreiner · 2017 [cited by applicant]
US 9836272B2 · Kono · 2017 [cited by applicant]
US 10318235B2 · Koppens · 2019 [cited by applicant]
US 10368181B2 · Ward · 2019 [cited by applicant]
US 10606550B2 · Koppens · 2020 [cited by applicant]
US 10956121B2 · Koppens · 2021 [cited by applicant]
US 10993062B2 · Ward · 2021 [cited by applicant]
US 11429341B2 · Koppens · 2022 [cited by applicant]
US 11842122B2 · Koppens · 2023 [cited by applicant]
US 20020001395A1 · Davis · 2002 [cited by applicant]
US 20020019733A1 · Erell · 2002 [cited by applicant]
US 20030123701A1 · Dorrell · 2003 [cited by applicant]
US 20040062267A1 · Minami · 2004 [cited by applicant]
US 20050172130A1 · Roberts · 2005 [cited by applicant]
US 20060018506A1 · Rodriguez · 2006 [cited by applicant]
US 20060106472A1 · Romesburg · 2006 [cited by applicant]
US 20070040934A1 · Ramaswamy et al. · 2007 [cited by applicant]
US 20070220168A1 · Parsons · 2007 [cited by applicant]
US 20070291959A1 · Seefeldt · 2007 [cited by applicant]
US 20080025530A1 · Romesburg · 2008 [cited by applicant]
US 20080059160A1 · Saunders · 2008 [cited by applicant]
US 20080080722A1 · Carroll · 2008 [cited by applicant]
US 20080267184A1 · Arisoylu · 2008 [cited by applicant]
US 20080288263A1 · Jung et al. · 2008 [cited by applicant]
US 20090063159A1 · Crockett · 2009 [cited by applicant]
US 20090080689A1 · Zhao · 2009 [cited by applicant]
US 20090097821A1 · Yahata · 2009 [cited by applicant]
US 20090210238A1 · Kim · 2009 [cited by applicant]
US 20090254339A1 · Seguin · 2009 [cited by applicant]
US 20100027837A1 · Levy · 2010 [cited by applicant]
US 20100076772A1 · Kim · 2010 [cited by applicant]
US 20100121647A1 · Beack et al. · 2010 [cited by applicant]
US 20100135507A1 · Kino · 2010 [cited by applicant]
US 20100286988A1 · Carroll · 2010 [cited by applicant]
US 20110002469A1 · Ojala · 2011 [cited by applicant]
US 20110013790A1 · Hilpert et al. · 2011 [cited by applicant]
US 20110150242A1 · Zong · 2011 [cited by applicant]
US 20110164855A1 · Crockett · 2011 [cited by applicant]
US 20110305344A1 · Sole · 2011 [cited by applicant]
US 20120016680A1 · Thesing · 2012 [cited by applicant]
US 20120033816A1 · Lee et al. · 2012 [cited by applicant]
US 20120046956A1 · Stewart · 2012 [cited by applicant]
US 20120057715A1 · Johnston · 2012 [cited by applicant]
US 20120063615A1 · Crockett · 2012 [cited by applicant]
US 20120065753A1 · Choo et al. · 2012 [cited by applicant]
US 20120110335A1 · Sandler · 2012 [cited by applicant]
US 20120130721A1 · Sirivara · 2012 [cited by applicant]
US 20120233467A1 · Whillock · 2012 [cited by applicant]
US 20120237039A1 · Thesing · 2012 [cited by applicant]
US 20120243692A1 · Ramamoorthy · 2012 [cited by applicant]
US 20120259643A1 · Engdegard · 2012 [cited by applicant]
US 20120275625A1 · Kono · 2012 [cited by applicant]
US 20120310654A1 · Riedmiller et al. · 2012 [cited by applicant]
US 20120328115A1 · Wolters · 2012 [cited by applicant]
US 20130054251A1 · Eppolito · 2013 [cited by applicant]
US 20130094669A1 · Kono · 2013 [cited by applicant]
US 20130246077A1 · Riedmiller · 2013 [cited by applicant]
US 20140068274A1 · Kasatkin · 2014 [cited by applicant]
US 20140074783A1 · Alsina · 2014 [cited by applicant]
US 20140297291A1 · Baumgarte · 2014 [cited by applicant]
US 20140304515A1 · Feuerman · 2014 [cited by applicant]
US 20140310010A1 · Seo et al. · 2014 [cited by applicant]
US 20150025879A1 · Liu et al. · 2015 [cited by applicant]
US 20160196830A1 · Riedmiller · 2016 [cited by applicant]
US 20160225376A1 · Honma · 2016 [cited by applicant]
US 20160307580A1 · Riedmiller et al. · 2016 [cited by applicant]
US 20160315722A1 · Holman · 2016 [cited by applicant]
US 20160322060A1 · Riedmiller et al. · 2016 [cited by applicant]
US 20160351202A1 · Baumgarte · 2016 [cited by applicant]
US 20170092280A1 · Hirabayashi · 2017 [cited by applicant]
US 20170223429A1 · Schreiner · 2017 [cited by applicant]
CN 1291377A · 2001 [cited by applicant]
CN 1520069 · 2004 [cited by applicant]
CN 1886780 · 2006 [cited by applicant]
CN 101156209 · 2008 [cited by applicant]
CN 101167250B · 2008 [cited by applicant]
CN 101189662 · 2008 [cited by applicant]
CN 101248484 · 2008 [cited by applicant]
CN 101390335 · 2009 [cited by applicant]
CN 101432965B · 2009 [cited by applicant]
CN 101513009 · 2009 [cited by applicant]
CN 101542596 · 2009 [cited by applicant]
CN 101903944 · 2010 [cited by applicant]
CN 102171755 · 2011 [cited by applicant]
CN 102203854 · 2011 [cited by applicant]
CN 102342020A · 2012 [cited by applicant]
CN 102428514 · 2012 [cited by applicant]
CN 102483925 · 2012 [cited by applicant]
CN 102610229 · 2012 [cited by applicant]
CN 102668374A · 2012 [cited by applicant]
CN 102682780B · 2012 [cited by applicant]
CN 102687198 · 2012 [cited by applicant]
CN 102739178A · 2012 [cited by applicant]
CN 102754151A · 2012 [cited by applicant]
CN 102792588 · 2012 [cited by applicant]
CN 104995677 · 2015 [cited by applicant]
CN 105556837 · 2016 [cited by applicant]
EP 2290564 · 2011 [cited by applicant]
EP 2341709 · 2011 [cited by applicant]
EP 3089161 · 2016 [cited by applicant]
JP 0746140 · 1995 [cited by applicant]
JP 11330980 · 1999 [cited by applicant]
JP 2003525466 · 2003 [cited by applicant]
JP 2009296298A · 2009 [cited by applicant]
JP 2010508545 · 2010 [cited by applicant]
JP 2010537233 · 2010 [cited by applicant]
JP 2011030228A · 2011 [cited by applicant]
JP 2011035459 · 2011 [cited by applicant]
JP 2012034295 · 2012 [cited by applicant]
JP 2012504260 · 2012 [cited by applicant]
JP 2013034295 · 2012 [cited by applicant]
JP 2012525600 · 2012 [cited by applicant]
JP 2013519918 · 2013 [cited by applicant]
JP 2013521539A · 2013 [cited by applicant]
JP 2013157659A · 2013 [cited by applicant]
JP 3186472 · 2013 [cited by applicant]
JP 2015531498 · 2015 [cited by applicant]
RU 2183034 · 2002 [cited by applicant]
RU 2010154747 · 2012 [cited by applicant]
WO 2002091361A1 · 2002 [cited by applicant]
WO 2006113062A1 · 2006 [cited by applicant]
WO 2011100155 · 2011 [cited by applicant]
WO 2011110525 · 2011 [cited by applicant]
WO 2011131732 · 2011 [cited by applicant]
WO 20120026092 · 2012 [cited by applicant]
WO 20120045816 · 2012 [cited by applicant]
WO 2012075246 · 2012 [cited by applicant]
WO 2013006338A2 · 2013 [cited by applicant]
WO 2013006342 · 2013 [cited by applicant]
WO 2013078056 · 2013 [cited by applicant]
WO 2014111290 · 2014 [cited by applicant]
WO 2014160849 · 2014 [cited by applicant]
WO 2014160895 · 2014 [cited by applicant]
WO 2015059087 · 2015 [cited by applicant]
WO 2015088697 · 2015 [cited by applicant]
WO 2015144587 · 2015 [cited by applicant]
WO 2015148046 · 2015 [cited by applicant]
WO 2016075053 · 2016 [cited by applicant]
WO 2016193033 · 2016 [cited by applicant]
WO 2016202682 · 2016 [cited by applicant]
WO 2017023423 · 2017 [cited by applicant]
WO 2017023601 · 2017 [cited by applicant]
WO 2017058731 · 2017 [cited by applicant]
WO 2016002738 · 2017 [cited by applicant]
107th MPEG San Jose (CA), USA, Jan. 13-17, 2014, Meeting Report Panos Kudumakis qMedia, Queen Mary University of London https://code.soundsoftware.ac.uk/attachments/download/1094/1PanosSanJose1-07MPEGMeetingReport.pdf (… [cited by applicant]
108th MPEG Valencia, Spain, Mar. 31-Apr. 4, 2014, Meeting Report Panos Kudumakis qMedia, Queen Mary University of London https://code.soundsoftware.ac.uk/attachments/download/1119/1PanosValencia-108MPEGMeetingReport.pdf… [cited by applicant]
A Guide to Dolby Metadata Jan. 1, 2005, pp. 1-28, 28 pages, (available at http://www.dolby.com/us/en/technologies/a-guide-to-dolby-metadata.pdf). [cited by applicant]
ATSC Standard Digital Audio Compression (AC-3, E-AC-3), Dec. 17, 2012, pp. 1-270, 270 pages. [cited by applicant]
Ebu, “Digital Audio Compression (AC-3, Enhanced AC-3) Standard”, ETSI TS 102 366, V1.2.1. Aug. 2008, pp. 1-214, 214 pages. [cited by applicant]
Guy, J. et al.“Mixed-Signal Audio Subsystem Enables High-Performance Audio in Portable Electronics” Dec. 2010, China Academic Journal Electronic Publishing House, pp. 1-3. [cited by applicant]
Hatanaka et al., Proposed Update to the family of AAC LC Based Profiles, MPEG Meeting, ISO/IEC JTC1/SC29/ WG11, Jul. 11, 2012, Stockholm, Sweden, pp. 1-20, 21 pages. [cited by applicant]
Jiwei, Wu, Design and Implementation of the Dual-Channel Mixing Audio System, Electronic Sci. & Tech. Jul. 15, 2013, China Academic Journal Electronic Publishing House, pp. 1-4, 5 pages. [cited by applicant]
Kudumakis—107th MPEG San Jose, CA, USA, Jan. 13-17, 2014, Meeting Report Panos Kudumakis qMedia, Queen Mary University of London, pp. 1-8, 8 pages. [cited by applicant]
Kudumakis—108th MPEG Valencia, Spain, Mar. 31-Apr. 4, 2014, Meeting Report Panos Kudumakis qMedia, Queen Mary University of London, pp. 1-9, 9 pages. [cited by applicant]
Lu Xugang Chen Daowen, A Nonlinear Dynamic Adaptive Auditory Model Based on I/O Characteristics for Forward Masking Effect, National Laboratory of Pattern Recognition the Institute of Automation Chinese Academy of Scien… [cited by applicant]
Neuendorf, M et al., MPEG Unified Speech and Audio Coding—The ISO/MPEG Standard for High-Efficiency Audio Coding of all Content Types, AES, presented at the 132nd Convention, Budapest, Hungary, Apr. 26-29, 2012, pp. 1-2… [cited by applicant]
Norcross, S. et al, The Effect of Downmixing on Measured Loudness, AES presented at the 131st Convention, Oct. 20-23, 2011, New York, USA, pp. 1-4, 5 pages. [cited by applicant]
Practical Guidelines for Production and Implementation in Accordance with EBU R 128 Mar. 4, 2011, p. 26-39. [cited by applicant]
Rettelbach, N., Proposed Update to the family of Aac Lc Based Profiles, MPEG Meeting, Iso/Iec JTC1/SC29/ WG11, Jul. 11, 2012, Stockholm, Sweden, pp. 1-20, 21 pages. [cited by applicant]
Sasaki, Y. et al, A Nested Infinite Gaussian Mixture Model for Identifying Known and Unknown Audio Events, IEEE, Dec. 31, 2013, pp. 1-4, 5 pages. [cited by applicant]
SMPTE Registered Disclosure Document for Television—Description and Guide to the Use of the Dolby E Audio Metadata Serial Bitstream, Jan. 1, 2009, pp. 1-53, 53 pages. [cited by applicant]
Specification of the Broadcast Wave Format: a format for Audio Data Files—Supplement 6: Dolby Metadata, EBU—Tech 3285 Suppl 6, Oct. 1, 2009, pp. 1-92, 92 pages. [cited by applicant]
Zhang Jun, Digitized Virtual Surround Sound Controller Based on PIC MCU, Computer Engineering Technical College, Guangdong Institute of Science and Technology, 2010, pp. 36-39, vol. 4, Guangzhou, China. [cited by applicant]