IP Library › Granted Patent US 12,210,799
Granted Patent B2
US 12,210,799 · App. 18/535,526 · Granted Jan 28, 2025

Dynamic range control for a wide variety of playback environments

Inventors: Jeroen Koppens (Nederweert, NL); Jeffrey Riedmiller (Novato, CA); Kristofer Kjoerling (Solna, SE); Alexander Stahlmann (Bubenreuth, DE); Holger Hoerich (Fürth, DE); Alan J. Seefeldt (Alameda, CA)
Assignees: DOLBY LABORATORIES LICENSING CORPORATION; DOLBY INTERNATIONAL AB
G06F3/165G10L19/167G10L21/0324H03G3/3005H03G3/3089H03G7/002H03G7/007H03G9/005H03G9/025H03G9/12H03G9/18H04S1/00H04S7/30H04S2400/13
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,210,799
App. No.
18/535,526
Granted
Jan 28, 2025
Kind
B2
Abstract

In an audio encoder, for audio content received in a source audio format, default gains are generated based on a default dynamic range compression (DRC) curve, and non-default gains are generated for a non-default gain profile. Based on the default gains and non-default gains, differential gains are generated. An audio signal comprising the audio content, the default DRC curve, and differential gains is generated. In an audio decoder, the default DRC curve and the differential gains are identified from the audio signal. Default gains are re-generated based on the default DRC curve. Based on the combination of the re-generated default gains and the differential gains, operations are performed on the audio content extracted from the audio signal.

Claims (18)

1. A method for dynamic range control (DRC) of audio signals, the method comprising:

receiving, by an audio decoder operating in a playback channel configuration different from a reference channel configuration, an audio signal for the reference channel configuration, the audio signal including audio sample data for each channel of the reference channel configuration, and encoder-generated DRC metadata, the encoder-generated DRC metadata comprising DRC gains for a plurality of channel configurations, including a set of DRC gains for the playback channel configuration and a set of DRC gains for the reference channel configuration;

downmixing the audio sample data into downmixed audio sample data for the audio channels of the playback channel configuration;

selecting, from the DRC gains for the plurality of channel configurations, the set of DRC gains for the playback channel configuration; and

applying the set of DRC gains for the playback channel configuration as a part of overall gains applied to the downmixed audio sample data to generate output audio sample data for each channel of the playback channel configuration;

wherein the playback channel configuration has a different number of audio channels than the reference channel configuration.

2. A non-transitory computer readable storage medium, storing software instructions, which when executed by one or more processors cause performing:

receiving, by an audio decoder operating in a playback channel configuration different from a reference channel configuration, an audio signal for the reference channel configuration, the audio signal including audio sample data for each channel of the reference channel configuration, and encoder-generated dynamic range control (DRC) metadata, the encoder-generated DRC metadata comprising DRC gains for a plurality of channel configurations, including a set of DRC gains for the playback channel configuration and a set of DRC gains for the reference channel configuration;

downmixing the audio sample data into downmixed audio sample data for the audio channels of the playback channel configuration;

selecting, from the DRC gains for the plurality of channel configurations, the set of DRC gains for the playback channel configuration; and

applying the set of DRC gains for the playback channel configuration as a part of overall gains applied to the downmixed audio sample data to generate output audio sample data for each channel of the playback channel configuration;

wherein the playback channel configuration has a different number of audio channels than the reference channel configuration.

3. An audio signal processing device for dynamic range control of audio signals, wherein the audio signal processing device comprises one or more processors configured to:

receive, by an audio decoder operating in a playback channel configuration different from a reference channel configuration, an audio signal for the reference channel configuration, the audio signal including audio sample data for each channel of the reference channel configuration, and encoder-generated DRC metadata, the encoder-generated DRC metadata comprising DRC gains for a plurality of channel configurations, including a set of DRC gains for the playback channel configuration and a set of DRC gains for the reference channel configuration;

downmix the audio sample data into downmixed audio sample data for the audio channels of the playback channel configuration;

select, from the DRC gains for the plurality of channel configurations, the set of DRC gains for the playback channel configuration; and

apply the set of DRC gains for the playback channel configuration as a part of overall gains applied to the downmixed audio sample data to generate output audio sample data for each channel of the playback channel configuration;

wherein the playback channel configuration has a different number of audio channels than the reference channel configuration.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jan 22, 2024
From: KOPPENS, JEROEN; RIEDMILLER, JEFFREY; KJÖRLING, KRISTOFER; STAHLMANN, ALEXANDER; HOERICH, HOLGER; SEEFELDT, ALAN J.
To: DOLBY LABORATORIES, INC.
Reel/Frame 066203/0943 →
Continuity (10)
Continuation 17898358 · Aug 29, 2022
Continuation 17209046 · Mar 22, 2021
Continuation 16827671 · Mar 23, 2020
Continuation 16387073 · Apr 17, 2019
Continuation 16151320 · Oct 3, 2018
Continuation 14916509
Provisional Application 61938043 · Feb 10, 2014
Provisional Application 61891324 · Oct 15, 2013
Provisional Application 61877230 · Sep 12, 2013
Related Publication 20240168706A1 · May 23, 2024
References Cited (190)
US 5297236A · Antill · 1994 [cited by applicant]
US 6530021B1 · Epstein · 2003 [cited by applicant]
US 6611607B1 · Davis · 2003 [cited by applicant]
US 6909743B1 · Ward · 2005 [cited by applicant]
US 6975254B1 · Sperschneider · 2005 [cited by applicant]
US 7072477B1 · Kincaid · 2006 [cited by applicant]
US 7369906B2 · Frindle · 2008 [cited by applicant]
US 7729673B2 · Romesburg · 2010 [cited by applicant]
US 8091025B2 · Ramos · 2012 [cited by applicant]
US 8204756B2 · Kim · 2012 [cited by applicant]
US 8285791B2 · Ratcliff · 2012 [cited by applicant]
US 8306406B2 · Morita · 2012 [cited by applicant]
US 8315396B2 · Schreiner · 2012 [cited by applicant]
US 8417531B2 · Kim · 2013 [cited by applicant]
US 8737802B2 · Baek · 2014 [cited by applicant]
US 8781820B2 · Seguin · 2014 [cited by applicant]
US 8903098B2 · Tsuji · 2014 [cited by applicant]
US 8903729B2 · Riedmiller · 2014 [cited by applicant]
US 8965774B2 · Eppolito · 2015 [cited by applicant]
US 8989884B2 · Guetta · 2015 [cited by applicant]
US 9240763B2 · Baumgarte · 2016 [cited by applicant]
US 9294062B2 · Hatanaka · 2016 [cited by applicant]
US 9300268B2 · Chen · 2016 [cited by applicant]
US 9372531B2 · Benson · 2016 [cited by applicant]
US 9542952B2 · Hatanaka · 2017 [cited by applicant]
US 9576585B2 · Bleidt · 2017 [cited by applicant]
US 9608588B2 · Baumgarte · 2017 [cited by applicant]
US 9633663B2 · Heuberger · 2017 [cited by applicant]
US 9830915B2 · Schreiner · 2017 [cited by applicant]
US 9836272B2 · Kono · 2017 [cited by applicant]
US 10318235B2 · Koppens · 2019 [cited by examiner]
US 10368181B2 · Ward · 2019 [cited by applicant]
US 10606550B2 · Koppens · 2020 [cited by examiner]
US 10956121B2 · Koppens · 2021 [cited by examiner]
US 10993062B2 · Ward · 2021 [cited by applicant]
US 11429341B2 · Koppens · 2022 [cited by examiner]
US 11842122B2 · Koppens · 2023 [cited by examiner]
US 20020001395A1 · Davis · 2002 [cited by applicant]
US 20020019733A1 · Erell · 2002 [cited by applicant]
US 20030123701A1 · Dorrell · 2003 [cited by applicant]
US 20040062267A1 · Minami · 2004 [cited by applicant]
US 20050172130A1 · Roberts · 2005 [cited by applicant]
US 20060018506A1 · Rodriguez · 2006 [cited by applicant]
US 20060106472A1 · Romesburg · 2006 [cited by applicant]
US 20070040934A1 · Ramaswamy et al. · 2007 [cited by applicant]
US 20070220168A1 · Parsons · 2007 [cited by applicant]
US 20070291959A1 · Seefeldt · 2007 [cited by applicant]
US 20080025530A1 · Romesburg · 2008 [cited by applicant]
US 20080059160A1 · Saunders · 2008 [cited by applicant]
US 20080080722A1 · Carroll · 2008 [cited by applicant]
US 20080267184A1 · Arisoylu · 2008 [cited by applicant]
US 20080288263A1 · Jung et al. · 2008 [cited by applicant]
US 20090063159A1 · Crockett · 2009 [cited by applicant]
US 20090080689A1 · Zhao · 2009 [cited by applicant]
US 20090097821A1 · Yahata · 2009 [cited by applicant]
US 20090210238A1 · Kim · 2009 [cited by applicant]
US 20090254339A1 · Seguin · 2009 [cited by applicant]
US 20100027837A1 · Levy · 2010 [cited by applicant]
US 20100076772A1 · Kim · 2010 [cited by applicant]
US 20100121647A1 · Beack et al. · 2010 [cited by applicant]
US 20100135507A1 · Kino · 2010 [cited by applicant]
US 20100286988A1 · Carroll · 2010 [cited by applicant]
US 20110002469A1 · Ojala · 2011 [cited by applicant]
US 20110013790A1 · Hilpert et al. · 2011 [cited by applicant]
US 20110150242A1 · Zong · 2011 [cited by applicant]
US 20110164855A1 · Crockett · 2011 [cited by applicant]
US 20110305344A1 · Sole · 2011 [cited by applicant]
US 20120016680A1 · Thesing · 2012 [cited by applicant]
US 20120033816A1 · Lee et al. · 2012 [cited by applicant]
US 20120046956A1 · Stewart · 2012 [cited by applicant]
US 20120057715A1 · Johnston · 2012 [cited by applicant]
US 20120063615A1 · Crockett · 2012 [cited by applicant]
US 20120065753A1 · Choo et al. · 2012 [cited by applicant]
US 20120110335A1 · Sandler · 2012 [cited by applicant]
US 20120130721A1 · Sirivara · 2012 [cited by applicant]
US 20120233467A1 · Whillock · 2012 [cited by applicant]
US 20120237039A1 · Thesing · 2012 [cited by applicant]
US 20120243692A1 · Ramamoorthy · 2012 [cited by applicant]
US 20120259643A1 · Engdegard · 2012 [cited by applicant]
US 20120275625A1 · Kono · 2012 [cited by applicant]
US 20120310654A1 · Riedmiller · 2012 [cited by examiner]
US 20120328115A1 · Wolters · 2012 [cited by applicant]
US 20130054251A1 · Eppolito · 2013 [cited by applicant]
US 20130094669A1 · Kono · 2013 [cited by applicant]
US 20130246077A1 · Riedmiller · 2013 [cited by applicant]
US 20140068274A1 · Kasatkin · 2014 [cited by applicant]
US 20140074783A1 · Alsina · 2014 [cited by applicant]
US 20140297291A1 · Baumgarte · 2014 [cited by applicant]
US 20140304515A1 · Feuerman · 2014 [cited by applicant]
US 20140310010A1 · Seo et al. · 2014 [cited by applicant]
US 20150025879A1 · Liu et al. · 2015 [cited by applicant]
US 20160196830A1 · Riedmiller · 2016 [cited by applicant]
US 20160225376A1 · Honma · 2016 [cited by applicant]
US 20160307580A1 · Riedmiller et al. · 2016 [cited by applicant]
US 20160315722A1 · Holman · 2016 [cited by applicant]
US 20160322060A1 · Riedmiller et al. · 2016 [cited by applicant]
US 20160351202A1 · Baumgarte · 2016 [cited by applicant]
US 20170092280A1 · Hirabayashi · 2017 [cited by applicant]
US 20170223429A1 · Schreiner · 2017 [cited by applicant]
CN 1291377A · 2001 [cited by applicant]
CN 1520069 · 2004 [cited by applicant]
CN 1886780 · 2006 [cited by applicant]
CN 101156209 · 2008 [cited by applicant]
CN 101167250B · 2008 [cited by applicant]
CN 101189662 · 2008 [cited by applicant]
CN 101248484 · 2008 [cited by applicant]
CN 101390335 · 2009 [cited by applicant]
CN 101432965B · 2009 [cited by applicant]
CN 101513009 · 2009 [cited by applicant]
CN 101542596 · 2009 [cited by applicant]
CN 101903944 · 2010 [cited by applicant]
CN 102171755 · 2011 [cited by applicant]
CN 102203854 · 2011 [cited by applicant]
CN 102342020A · 2012 [cited by applicant]
CN 102428514 · 2012 [cited by applicant]
CN 102483925 · 2012 [cited by applicant]
CN 102610229 · 2012 [cited by applicant]
CN 102668374A · 2012 [cited by applicant]
CN 102682780B · 2012 [cited by applicant]
CN 102687198 · 2012 [cited by applicant]
CN 102739178A · 2012 [cited by applicant]
CN 102754151A · 2012 [cited by applicant]
CN 102792588 · 2012 [cited by applicant]
CN 104995677 · 2015 [cited by applicant]
CN 105556837 · 2016 [cited by applicant]
EP 2290564 · 2011 [cited by applicant]
EP 2341709 · 2011 [cited by applicant]
EP 3089161 · 2016 [cited by applicant]
JP 0746140 · 1995 [cited by applicant]
JP 11330980 · 1999 [cited by applicant]
JP 2003525466 · 2003 [cited by applicant]
JP 2009296298A · 2009 [cited by applicant]
JP 2010508545 · 2010 [cited by applicant]
JP 2010537233 · 2010 [cited by applicant]
JP 2011030228A · 2011 [cited by applicant]
JP 2011035459 · 2011 [cited by applicant]
JP 2012034295 · 2012 [cited by applicant]
JP 2012504260 · 2012 [cited by applicant]
JP 2013034295 · 2012 [cited by applicant]
JP 2012525600 · 2012 [cited by applicant]
JP 2013519918 · 2013 [cited by applicant]
JP 2013521539A · 2013 [cited by applicant]
JP 2013157659A · 2013 [cited by applicant]
JP 3186472 · 2013 [cited by applicant]
JP 2015531498 · 2015 [cited by applicant]
KR 20070121813 · 2007 [cited by applicant]
RU 2183034 · 2002 [cited by applicant]
RU 2010154747 · 2012 [cited by applicant]
WO 2002091361A1 · 2002 [cited by applicant]
WO 2006113062 · 2006 [cited by applicant]
WO 2011100155 · 2011 [cited by applicant]
WO 2011110525 · 2011 [cited by applicant]
WO 2011131732 · 2011 [cited by applicant]
WO 20120026092 · 2012 [cited by applicant]
WO 20120045816 · 2012 [cited by applicant]
WO 2012075246 · 2012 [cited by applicant]
WO 2013006338 · 2013 [cited by applicant]
WO 2013006342 · 2013 [cited by applicant]
WO 2013078056 · 2013 [cited by applicant]
WO 2014111290 · 2014 [cited by applicant]
WO 2014160849 · 2014 [cited by applicant]
WO 2014160895 · 2014 [cited by applicant]
WO 2015059087 · 2015 [cited by applicant]
WO 2015088697 · 2015 [cited by applicant]
WO 2015144587 · 2015 [cited by applicant]
WO 2015148046 · 2015 [cited by applicant]
WO 2016075053 · 2016 [cited by applicant]
WO 2016193033 · 2016 [cited by applicant]
WO 2016202682 · 2016 [cited by applicant]
WO 2017023423 · 2017 [cited by applicant]
WO 2017023601 · 2017 [cited by applicant]
WO 2017058731 · 2017 [cited by applicant]
WO 2016002738 · 2017 [cited by applicant]
A Guide to Dolby Metadata Jan. 1, 2005, pp. 1-28 (available at http://www.dolby.com/us/en/technologies/a-guide-to-dolby-metadata.pdf). [cited by applicant]
ATSC Standard Digital Audio Compression (AC-3, E-AC-3), Dec. 17, 2012, 270 pages. [cited by applicant]
Ebu, “Digital Audio Compression (AC-3, Enhanced AC-3) Standard”, ETSI TS 102 366, V1.2.1. Aug. 2008 pp. 1-214. [cited by applicant]
Guy, J. et al.“Mixed-Signal Audio Subsystem Enables High-Performance Audio in Portable Electronics” Dec. 2010, China Academic Journal Electronic Publishing House, pp. 1-3. [cited by applicant]
Hatanaka et al., Proposed Update to the family of AAC LC Based Profiles, MPEG Meeting, ISO/IEC JTC1/SC29/WG11, Jul. 11, 2012, Stockholm, Sweden, pp. 1-20, 21 pages. [cited by applicant]
Jiwei, Wu, Design and Implementation of the Dual-Channel Mixing Audio System, Electronic Sci. & Tech. Jul. 15, 2013, China Academic Journal Electronic Publishing House, pp. 1-4, 5 pages. [cited by applicant]
Kudumakis—107th MPEG San Jose (CA), USA, Jan. 13-17, 2014, Meeting Report Panos Kudumakis qMedia, Queen Mary University of London (7 pgs.). [cited by applicant]
Kudumakis—108th MPEG Valencia, Spain, Mar. 31-Apr. 4, 2014, Meeting Report Panos Kudumakis qMedia, Queen Mary University of London (9 pgs.). [cited by applicant]
Lu Xugang Chen Daowen, A Nonlinear Dynamic Adaptive Auditory Model Based On I/O Characteristics For Forward Masking Effect, National Laboratory of Pattern Recognition the Institute of Automation Chinese Academy of Scien… [cited by applicant]
Neuendorf, M. et al., MPEG Unified Speech and Audio Coding—The ISO/MPEG Standard for High-Efficiency Audio Coding of all Content Types, AES, presented at the 132nd Convention, Budapest, Hungary, Apr. 26-29, 2012, pp. 1-… [cited by applicant]
Norcross, S. et al., The Effect of Downmixing on Measured Loudness, AES presented at the 131st Convention, Oct. 20-23, 2011, New York, USA, pp. 1-4, 4 pages. [cited by applicant]
Practical Guidelines for Production and Implementation in Accordance with EBU R 128 Mar. 4, 2011, p. 26-39. [cited by applicant]
Rettelbach, N., Proposed Update to the family of AAC LC Based Profiles, MPEG Meeting, ISO/IEC JTC1/SC29/WG11, Jul. 11, 2012, Stockholm, Sweden, pp. 1-20, 20 pages. [cited by applicant]
Sasaki, Y. et al., A Nested Infinite Gaussian Mixture Model for Identifying Known and Unknown Audio Events, IEEE, Dec. 31, 2013, pp. 1-4, 5 pages. [cited by applicant]
SMPTE Registered Disclosure Document for Television—Description and Guide to the Use of the Dolby E Audio Metadata Serial Bitstream, Jan. 1, 2009, pp. 1-53. [cited by applicant]
Specification of the Broadcast Wave Format: a format for Audio Data Files—Supplement 6: Dolby Metadata, EBU—Tech 3285 Suppl 6, Oct. 1, 2009, pp. 1-92. [cited by applicant]
Zhang Jun, Digitized Virtual Surround Sound Controller Based on PIC MCU, Computer Engineering Technical College, Guangdong Institute of Science and Technology, 2010, pp. 36-39, vol. 4, Guangzhou, China. [cited by applicant]