IP Library › Granted Patent US 12,260,869
Granted Patent B2
US 12,260,869 · App. 18/633,112 · Granted Mar 25, 2025

Decoding audio bitstreams with enhanced spectral band replication metadata in at least one fill element

Inventors: Lars Villemoes (Järfälla, SE); Heiko Purnhagen (Sundbyberg, SE); Per Ekstrand (Saltsjöbaden, SE)
Assignee: DOLBY INTERNATIONAL AB
G10L19/167G10L19/035G10L19/24G10L21/038
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,260,869
App. No.
18/633,112
Granted
Mar 25, 2025
Kind
B2
Abstract

Embodiments relate to an audio processing unit that includes a buffer, bitstream payload deformatter, and a decoding subsystem. The buffer stores at least one block of an encoded audio bitstream. The block includes a fill element that begins with an identifier followed by fill data. The fill data includes at least one flag identifying whether enhanced spectral band replication (eSBR) processing is to be performed on audio content of the block. A corresponding method for decoding an encoded audio bitstream is also provided.

Claims (17)

1. An audio processing device comprising:

a decoding subsystem configured to decode at least a portion of a block of an encoded audio bitstream, wherein the block of the encoded audio bitstream includes:

a fill element with an identifier indicating a start of the fill element and fill data after the identifier, wherein the fill data includes an extension payload, the extension payload includes spectral band replication extension data, and the extension payload is identified with a four bit unsigned integer transmitted most significant bit first and having a value of ‘1101’ or ‘1110’, and, wherein the spectral band replication extension data includes:

a spectral band replication header, spectral band replication data, and

wherein the extension payload further includes a spectral band replication extension element after the spectral band replication data, and wherein the flag is included in the spectral band replication extension element,

wherein the fill data further includes:

at least one flag identifying whether enhanced spectral band replication processing is to be performed on audio content of the block of the encoded audio bitstream, and

enhanced spectral band replication metadata which does not include one or more parameters used for both spectral patching and harmonic transposition, wherein the enhanced spectral band replication metadata is metadata configured to enable at least one eSBR tool which is described or mentioned in the MPEG USAC standard and which is not described or mentioned in the MPEG-4 AAC standard.

2. A method for decoding an encoded audio bitstream, the method comprising:

decoding at least a portion of a block of an encoded audio bitstream,

wherein the block of the encoded audio bitstream includes:

a fill element with an identifier indicating a start of the fill element and fill data after the identifier, wherein the fill data includes an extension payload, the extension payload includes spectral band replication extension data, and the extension payload is identified with a four bit unsigned integer transmitted most significant bit first and having a value of ‘1101’ or ‘1110’, and, wherein the spectral band replication extension data includes:

a spectral band replication header, spectral band replication data, and

wherein the extension payload further includes a spectral band replication extension element, and wherein the flag is included in the spectral band replication extension element,

wherein the fill data further includes:

a flag identifying whether enhanced spectral band replication processing is to be performed on audio content of the block of the encoded audio bitstream, and

enhanced spectral band replication metadata which does not include one or more parameters used for both spectral patching and harmonic transposition, wherein the enhanced spectral band replication metadata is metadata configured to enable at least one eSBR tool which is described or mentioned in the MPEG USAC standard and which is not described or mentioned in the MPEG-4 AAC standard.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 5, 2024
From: VILLEMOES, LARS; PURNHAGEN, HEIKO; EKSTRAND, PER
To: DOLBY INTERNATIONAL AB
Reel/Frame 068181/0200 →
Priority Claims (1)
EP 15159067 · Mar 13, 2015 · regional
Continuity (9)
Continuation 18318443 · May 16, 2023
Continuation 17831080 · Jun 2, 2022
Continuation 16932479 · Jul 17, 2020
Division 16568802 · Sep 12, 2019
Continuation 16269161 · Feb 6, 2019
Continuation 16208325 · Dec 3, 2018
Continuation 15546965
Provisional Application 62133800 · Mar 16, 2015
Related Publication 20240355345A1 · Oct 24, 2024
References Cited (185)
US 6502069B1 · Grill · 2002 [cited by applicant]
US 6680972B1 · Liljeryd · 2004 [cited by applicant]
US 7283955B2 · Liljeryd · 2007 [cited by applicant]
US 7447631B2 · Truman · 2008 [cited by applicant]
US 8200481B2 · Xu et al. · 2012 [cited by applicant]
US 8332059B2 · Herre · 2012 [cited by applicant]
US 8391371B2 · Klein · 2013 [cited by applicant]
US 8489391B2 · Kurniawati · 2013 [cited by applicant]
US 8494843B2 · Sung · 2013 [cited by applicant]
US 8515768B2 · Baumgarte · 2013 [cited by applicant]
US 8781843B2 · Oh · 2014 [cited by examiner]
US 8831958B2 · Lee · 2014 [cited by applicant]
US 10134413B2 · Villemoes · 2018 [cited by applicant]
US 10262668B2 · Villemoes · 2019 [cited by applicant]
US 10262669B1 · Villemoes · 2019 [cited by applicant]
US 10453468B2 · Villemoes · 2019 [cited by applicant]
US 10553232B2 · Villemoes · 2020 [cited by applicant]
US 10734010B2 · Villemoes · 2020 [cited by applicant]
US 10818306B2 · Villemoes · 2020 [cited by applicant]
US 10943595B2 · Villemoes · 2021 [cited by applicant]
US 11289106B2 · Kjoerling · 2022 [cited by applicant]
US 11367455B2 · Villemoes · 2022 [cited by applicant]
US 11417350B2 · Villemoes · 2022 [cited by applicant]
US 20030093271A1 · Tsushima · 2003 [cited by applicant]
US 20030233234A1 · Truman · 2003 [cited by applicant]
US 20040078194A1 · Liljeryd et al. · 2004 [cited by applicant]
US 20040078205A1 · Liljeryd · 2004 [cited by applicant]
US 20070156397A1 · Chong · 2007 [cited by applicant]
US 20070160043A1 · Kim · 2007 [cited by applicant]
US 20070276656A1 · Solbach · 2007 [cited by applicant]
US 20090319283A1 · Schnell · 2009 [cited by applicant]
US 20100023336A1 · Shmunk · 2010 [cited by applicant]
US 20100217607A1 · Neuendorf · 2010 [cited by applicant]
US 20100262427A1 · Chivukula · 2010 [cited by applicant]
US 20110170711A1 · Rettelbach et al. · 2011 [cited by applicant]
US 20110257984A1 · Virette · 2011 [cited by applicant]
US 20120016667A1 · Gao · 2012 [cited by applicant]
US 20120029923A1 · Rajendran · 2012 [cited by applicant]
US 20120029924A1 · Duni · 2012 [cited by applicant]
US 20120035918A1 · Frankkila · 2012 [cited by applicant]
US 20120035936A1 · Kurniawati · 2012 [cited by applicant]
US 20120065753A1 · Choo · 2012 [cited by applicant]
US 20120209612A1 · Bilobrov · 2012 [cited by applicant]
US 20120243692A1 · Ramamoorthy · 2012 [cited by applicant]
US 20120245947A1 · Neuendorf · 2012 [cited by applicant]
US 20120265540A1 · Fuchs · 2012 [cited by applicant]
US 20120328124A1 · Kjoerling · 2012 [cited by applicant]
US 20130006644A1 · Jiang · 2013 [cited by applicant]
US 20130041673A1 · Nagel et al. · 2013 [cited by applicant]
US 20140016785A1 · Neuendorf et al. · 2014 [cited by applicant]
US 20140016787A1 · Neuendorf et al. · 2014 [cited by applicant]
US 20140019146A1 · Neuendorf · 2014 [cited by applicant]
US 20140039890A1 · Mundt · 2014 [cited by applicant]
US 20140133683A1 · Robinson · 2014 [cited by applicant]
US 20140222434A1 · Nagel · 2014 [cited by applicant]
US 20140236605A1 · Rettelbach · 2014 [cited by applicant]
US 20140310011A1 · Biswas · 2014 [cited by applicant]
US 20140358565A1 · Peters · 2014 [cited by examiner]
US 20140365231A1 · Hoerich · 2014 [cited by applicant]
US 20140372131A1 · Disch · 2014 [cited by applicant]
US 20150127354A1 · Peters · 2015 [cited by examiner]
US 20150187360A1 · Nagel · 2015 [cited by examiner]
US 20150287417A1 · Disch · 2015 [cited by applicant]
US 20180081645A1 · Alurralde Iturri · 2018 [cited by applicant]
US 20190103123A1 · Villemoes · 2019 [cited by applicant]
CN 1484822A · 2004 [cited by applicant]
CN 1571993A · 2005 [cited by applicant]
CN 1659626A · 2005 [cited by applicant]
CN 1669072 · 2005 [cited by applicant]
CN 102089817 · 2011 [cited by applicant]
CN 102144259 · 2011 [cited by applicant]
CN 102254560B · 2011 [cited by applicant]
CN 102449692B · 2012 [cited by applicant]
CN 102648494 · 2012 [cited by applicant]
CN 102687198 · 2012 [cited by applicant]
CN 102194457B · 2013 [cited by applicant]
CN 102177545B · 2013 [cited by applicant]
CN 103026408 · 2013 [cited by applicant]
CN 102446506B · 2013 [cited by applicant]
CN 102282612B · 2013 [cited by applicant]
CN 102388418B · 2013 [cited by applicant]
CN 101925950B · 2013 [cited by applicant]
CN 102318004B · 2013 [cited by applicant]
CN 101540171B · 2013 [cited by applicant]
CN 101855918B · 2014 [cited by applicant]
CN 102089808B · 2014 [cited by applicant]
CN 102754151B · 2014 [cited by applicant]
CN 103620678 · 2014 [cited by applicant]
CN 103918029B · 2014 [cited by applicant]
CN 102687198B · 2014 [cited by applicant]
CN 102144259B · 2015 [cited by applicant]
CN 103038819B · 2015 [cited by applicant]
CN 103262164B · 2015 [cited by applicant]
CN 102789782B · 2015 [cited by applicant]
CN 103548077B · 2016 [cited by applicant]
CN 103650539B · 2016 [cited by applicant]
CN 102754159B · 2016 [cited by applicant]
CN 103562994B · 2016 [cited by applicant]
CN 103959375B · 2016 [cited by applicant]
CN 103971694B · 2016 [cited by applicant]
CN 103620679B · 2017 [cited by applicant]
CN 103703511B · 2017 [cited by applicant]
CN 104240709B · 2019 [cited by applicant]
EP 1455345 · 2004 [cited by applicant]
EP 1590800B1 · 2009 [cited by applicant]
EP 2392005B1 · 2011 [cited by applicant]
EP 2182513B1 · 2013 [cited by applicant]
EP 2631906 · 2013 [cited by applicant]
EP 1926084B1 · 2013 [cited by applicant]
EP 2491555B1 · 2014 [cited by applicant]
EP 2711924 · 2014 [cited by applicant]
EP 2676264B1 · 2015 [cited by applicant]
EP 2830047A1 · 2015 [cited by applicant]
EP 2830054A1 · 2015 [cited by applicant]
EP 2830065A1 · 2015 [cited by applicant]
EP 2146344B1 · 2016 [cited by applicant]
HK 1106824A1 · 2008 [cited by applicant]
JP 2001521648 · 2001 [cited by applicant]
JP 2009116371 · 2009 [cited by applicant]
JP 2011527447 · 2011 [cited by applicant]
JP 2013525824 · 2013 [cited by applicant]
JP 2013125187A · 2013 [cited by applicant]
JP 2014512020 · 2014 [cited by applicant]
JP 2016539377 · 2016 [cited by applicant]
KR 20050051046A · 2005 [cited by applicant]
KR 20070003574A · 2007 [cited by applicant]
KR 20070038439A · 2007 [cited by applicant]
KR 20100087661A · 2010 [cited by applicant]
KR 20130008061A · 2013 [cited by applicant]
RU 2411594C2 · 2011 [cited by applicant]
RU 2408089 · 2011 [cited by applicant]
RU 2494478C1 · 2013 [cited by applicant]
RU 2520329C2 · 2014 [cited by applicant]
TW 201246183 · 2012 [cited by applicant]
TW 201438003 · 2014 [cited by applicant]
TW I524330 · 2016 [cited by applicant]
WO 2007013775 · 2007 [cited by applicant]
WO 2007138419A2 · 2007 [cited by applicant]
WO 2010003546W · 2010 [cited by applicant]
WO 2010087614A2 · 2010 [cited by applicant]
WO 2010090427A2 · 2010 [cited by applicant]
WO 2011026083 · 2011 [cited by applicant]
WO 2011048010A1 · 2011 [cited by applicant]
WO 2011110500A1 · 2011 [cited by applicant]
WO 2011124608A1 · 2011 [cited by applicant]
WO 2012110415 · 2012 [cited by applicant]
WO 20120110481W · 2012 [cited by applicant]
WO 2012126866A1 · 2012 [cited by applicant]
WO 2012126893 · 2012 [cited by applicant]
WO 2012137617A1 · 2012 [cited by applicant]
WO 2013068587A2 · 2013 [cited by applicant]
WO 2013158804 · 2013 [cited by applicant]
WO 2014115225 · 2014 [cited by applicant]
WO 2014118155 · 2014 [cited by applicant]
WO 2014118185 · 2014 [cited by applicant]
WO 2014118185A1 · 2014 [cited by applicant]
WO 2014124377A2 · 2014 [cited by applicant]
WO 2014165668 · 2014 [cited by applicant]
WO 2014199632A1 · 2014 [cited by applicant]
Guo, Qing-Wei, et al “Testing and Analysis of Spectral Band Replication Technology” Quality Engineering, Dec. 2007. [cited by applicant]
Zhang, Haibo “Research on Spectral Band Extension of Audio Coding” Jan. 2008, China Academic Journal. [cited by applicant]
3GPP TS 26,404, 3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; General Audio Codec audio processing functions; Enhanced aacPlus general audio codec; Enhanced aacPlus encod… [cited by applicant]
3GPP TS 26.404, “Generation Partnership Project; Technical Specification Group Services and System Aspects; General Audio Codec audio processing functions; Enhanced aacPlus general audio codec; Enhanced aacPlus encoder … [cited by applicant]
Anonymous: “ISO/IEC 14496-3:2009, Fourth Edition, subpart 4”, MPEG Meeting Oct. 22-26, 2007, Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11, May 15, 2009. [cited by applicant]
Anonymous: “ISO/IEC 23003-3:201x/DIS of Unified Speech and Audio Coding”, No. N11863, Feb. 9, 2011. [cited by applicant]
Dongbing Liu, “A brief analysis of frequency band replication in audio coding”, Journal of Liaoning University (Natural Science Edition), published on Apr. 30, 2011. [cited by applicant]
Haishan Zhong et al., “QMF Based Harmonic Spectral Band Replication”, AES E-Library, published on Oct. 19, 2011. [cited by applicant]
Hu, Rui-Min, “AVS-P10 Mobile Speech and Audio Standard and Primary Technology” 2010. [cited by applicant]
Jiang, Lin et al “AVS2 Speech and Audio Coding Scheme for High Quality at Low Bitrates” IEEE International Conference on Multimedia and Expo Workshops Sep. 8, 2014. [cited by applicant]
Liang, D. “Research on Unified Speech and Audio Coding Algorithm” 2010. [cited by applicant]
Liu, Dantong “Research and Implementation of a New Type Hi-Fi Wideband Audio Coding Algorithm” 2009. [cited by applicant]
Nagel, F. et al.“A Continuous Modulated Single Sideband Bandwidth Extension” IEEE 2010, pp. 357-360. [cited by applicant]
Qingwei Guo, “Analysis and testing of band replication techniques”, Electronics Quality, published on Dec. 20, 2007. [cited by applicant]
Quackenbush, Schuyler, et al “MPEG Unified Speech and Audio Coding” IEEE Multimedia, vol. 20, Issue 2, Apr.-Jun. 2013, pp. 72-78. [cited by applicant]
Ravi K. Chivukula, Fast Algorithms for Low-Delay SBR Filterbanks in MPEG-4 AAC-ELD, «IEEE Transactions on Audio, Speech, and Language Processing», published on Oct. 10, 2011. [cited by applicant]
Rongshan Yu, et al., “Perceptually Enhanced Bit-Plane Coding for Scalable Audio”, «2006 IEEE International Conference on Multimedia and Expo», published on Dec. 31, 2006. [cited by applicant]
Rose Matthias “MPEG Audio Codec: From MP3 to xHE-ACC” 2012. [cited by applicant]
Seng, Chong Kok, et al “Low Power Spectral Band Replication Technology for the MPEG-4 Audio Standard” ICICS-PCM, Dec. 15-18, 2003, pp. 1408-1412. [cited by applicant]
Werner, Michael et al “An Enhanced SBR Tool for Low-Delay Applications” AES Convention 127, Oct. 1, 2009, USA. [cited by applicant]
Xiaoming Li, “Research on general coding methods for speech and audio signals”, Chinese Doctor's Theses Full-text Database (Information Science and Technology Series), published on Mar. 15, 2015. [cited by applicant]
Yamamoto, Y et al., “A New Bandwidth Extention Technology for MPEG Unified Speech and Audio Coding”, IEEE International Conference on Acoustics, Speech and Signal Processing, published on May 31, 2013. [cited by applicant]
Yang Lu, “An improved frequency band replication method”, «Semiconductor Technology», vol. 6, published on Dec. 31, 2004. [cited by applicant]
Zernicki, T. et al “Enhanced Coding of High-Frequency Tonal Components in MPEG-D USAC Through Joint Application of ESBR and Sinusoidal Modeling” IEEE 2011, pp. 501-504. [cited by applicant]
Zhai Zhibo, “Research on audio codec algorithm and DSP implementation”, «Chinese Master's Theses Full-text Database», vol. 5, published on May 15, 2006. [cited by applicant]
Zhong, H. et al.“QMF Based Harmonic Spectral Band Replication” AES Convention Signal Processing, Oct. 19, 2011, pp. 1-7. [cited by applicant]