IP Library › Granted Patent US 12,475,903
Granted Patent B2
US 12,475,903 · App. 18/221,964 · Granted Nov 18, 2025

Audio encoder and bandwidth extension decoder

Inventors: Frederik Nagel (Nuremberg, DE); Sascha Disch (Fuerth, DE); Guillaume Fuchs (Erlangen, DE); Juergen Herre (Buckenhof, DE); Christian Griebel (Nuremberg, DE)
Assignee: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
G10L19/265G10L19/00G10L21/038G10L19/24
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,475,903
App. No.
18/221,964
Granted
Nov 18, 2025
Kind
B2
Abstract

An audio encoder for providing an output signal using an input audio signal includes a patch generator, a comparator and an output interface. The patch generator generates at least one bandwidth extension high-frequency signal, wherein a bandwidth extension high-frequency signal includes a high-frequency band. The high-frequency band of the bandwidth extension high-frequency signal is based on a low frequency band of the input audio signal. A comparator calculates a plurality of comparison parameters. A comparison parameter is calculated based on a comparison of the input audio signal and a generated bandwidth extension high-frequency signal. Each comparison parameter of the plurality of comparison parameters is calculated based on a different offset frequency between the input audio signal and a generated bandwidth extension high-frequency signal. Further, the comparator determines a comparison parameter from the plurality of comparison parameters, wherein the determined comparison parameter fulfils a predefined criterion.

Claims (35)

1 . A bandwidth extension audio decoder, comprising:

a core decoder configured to decode a received bit stream comprising an input audio signal and a parameter signal, wherein the parameter signal comprises an indication of an offset frequency or an indication of a power density parameter;

a patch generator configured to generate a bandwidth extension high-frequency signal comprising a high-frequency band using the input audio signal and the parameter signal comprising the indication of the offset frequency or the indication of the power density parameter;

a parameter extraction unit configured for separating the parameter signal from the received bit stream and for providing a separated parameter signal to the patch generator;

a combiner configured to combine the bandwidth extension high-frequency signal and the input audio signal to acquire a bandwidth extended audio signal; and

an output interface configured to output the bandwidth extended audio signal;

wherein the core decoder is connected to the patch generator and the combiner, wherein the parameter extraction unit is connected to the patch generator and to the output interface, wherein the patch generator is connected to the combiner, and wherein the combiner is connected to the output interface, and

wherein the core decoder is configured to provide the input audio signal to the patch generator and the combiner.

2 . The bandwidth extension audio decoder according to claim 1 , wherein the combiner is configured to ignore a part of the high-frequency band of the bandwidth extension high-frequency signal, wherein an ignored part of the high-frequency band of the bandwidth extension high-frequency signal comprises frequencies lower than an upper cutoff frequency of the input audio signal.

3 . The bandwidth extension audio decoder according to claim 2 , wherein the core decoder is configured to generate the input audio signal with a constant upper cutoff frequency, and wherein the patch generator is configured to generate the high-frequency band of the bandwidth extension high-frequency signal by shifting a frequency band of the input audio signal by a frequency equal to the upper cutoff frequency of the input audio signal plus the offset frequency.

4 . The bandwidth extension audio decoder according to claim 1 , wherein the patch generator is configured to generate the bandwidth extension high-frequency signal in the time domain.

5 . The bandwidth extension audio decoder according to claim 4 , wherein the patch generator is configured to generate the bandwidth extension high-frequency signal based on a single side band modulation.

6 . The bandwidth extension audio decoder according to claim 1 , comprising an interpolator, wherein a time frame comprises a plurality of time steps, wherein each time frame comprises a corresponding offset frequency, wherein the interpolator is configured to interpolate an offset frequency of a time frame or a plurality of offset frequencies of different time frames for each time step of a time frame to acquire an interpolated offset frequency for each time step.

7 . The bandwidth extension audio decoder according to claim 1 , wherein the power density parameter indicates a ratio of the high-frequency band of the bandwidth extension high-frequency signal with the offset frequency and a corresponding frequency band of the input audio signal.

8 . The bandwidth extension audio decoder according to claim 7 , wherein the ratio relates to a power density ratio, a power ratio, or another ratio of a quantity related to the power density of a frequency band.

9 . The bandwidth extension audio decoder according to claim 1 , wherein the indication of the offset frequency comprises the offset frequency itself, a quantized offset frequency or another quantity based on the offset frequency.

10 . The bandwidth extension audio decoder according to claim 1 , wherein the low frequency band of the input audio signal is spread and shifted to generate a bandwidth extension high frequency signal.

11 . The bandwidth extension audio decoder according to claim 1 , wherein the patch generator is configured to generate the bandwidth extension high-frequency signal by shifting the frequency band of the input audio signal by a constant frequency plus the offset frequency.

12 . The bandwidth extension audio decoder according to claim 1 , wherein the patch generator is configured to generate the bandwidth extension high-frequency signal in a frequency domain.

13 . The bandwidth extension audio decoder according to claim 1 , wherein the output interface is configured to amplify the bandwidth extended audio signal before providing the same.

14 . The bandwidth extension audio decoder according to claim 1 , wherein the input audio signal comprises an upper cutoff frequency equal to a crossover frequency of the core decoder, or wherein the crossover frequency is constant or is variable over time.

15 . The bandwidth extension audio decoder according to claim 1 , wherein the parameter extraction unit is configured to provide the parameter signal or an extracted noise and/or tonality parameter to the output interface.

16 . The bandwidth extension audio decoder according to claim 1 , wherein the patch generator is configured to generate the high-frequency band of the bandwidth extension high-frequency signal based on a frequency shift of a frequency band of the input audio signal, wherein the frequency shift is based on the offset frequency, or wherein the patch generator is configured to amplify or attenuate the high-frequency band of the bandwidth extension high-frequency signal by a factor equal to the value of the power density parameter or equal to the reciprocal value of the power density parameter, respectively.

17 . A method for performing a bandwidth extension audio decoding, the method comprising:

core decoding a received bit stream comprising an input audio signal and a parameter signal, wherein the parameter signal comprises an indication of an offset frequency or an indication of a power density parameter;

generating a bandwidth extension high-frequency signal comprising a high-frequency band using the input audio signal and the parameter signal comprising the indication of the offset frequency or the indication of the power density parameter;

separating the parameter signal from the received bit stream; and

combining the bandwidth extension high-frequency signal and the input audio signal to acquire a bandwidth extended audio signal,

wherein an output of the core decoding is transmitted to the generating and the combining, wherein an output of the separating is transmitted to the patch generating and to an output interface, wherein an output of the patch generating is transmitted to the combining, and wherein an output of the combining is transmitted to the output interface.

18 . A non-transitory storage medium having stored thereon a computer program with a program code for performing, when the computer program runs on a computer or a microcontroller, a method for performing a bandwidth extension audio decoding, the method comprising:

core decoding a received bit stream comprising an input audio signal and a parameter signal, wherein the parameter signal comprises an indication of an offset frequency or an indication of a power density parameter;

generating a bandwidth extension high-frequency signal comprising a high-frequency band using the input audio signal and the parameter signal including the indication of the offset frequency or the indication of the power density parameter;

separating the parameter signal from the received bit stream; and

combining the bandwidth extension high-frequency signal and the input audio signal to acquire a bandwidth extended audio signal,

wherein an output of the core decoding is transmitted to the generating and the combining, wherein an output of the separating is transmitted to the patch generating and to an output interface, wherein an output of the patch generating is transmitted to the combining, and wherein an output of the combining is transmitted to the output interface.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Jul 17, 2023
From: NAGEL, FREDERIK; DISCH, SASCHA; FUCHS, GUILLAUME; HERRE, JUERGEN; GRIEBEL, CHRISTIAN
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 064277/0668 →
Continuity (9)
Continuation 17965830 · Oct 14, 2022
Continuation 17159331 · Jan 27, 2021
Continuation 16260487 · Jan 29, 2019
Continuation 14709804 · May 12, 2015
Continuation 13691950 · Dec 3, 2012
Continuation 13158547 · Jun 13, 2011
Continuation PCTEP2009066980 · Dec 11, 2009
Provisional Application 61122552 · Dec 15, 2008
Related Publication 20230377590A1 · Nov 23, 2023
References Cited (98)
US 5657422A · Janiszewski et al. · 1997 [cited by applicant]
US 6549884B1 · Laroche · 2003 [cited by examiner]
US 7873064B1 · Li et al. · 2011 [cited by applicant]
US 8401862B2 · Nagel · 2013 [cited by examiner]
US 8438015B2 · Schnell · 2013 [cited by examiner]
US 8560329B2 · Qi et al. · 2013 [cited by applicant]
US 9058802B2 · Nagel · 2015 [cited by examiner]
US 9280982B1 · Kushner · 2016 [cited by applicant]
US 9805736B2 · Liu · 2017 [cited by examiner]
US 10229696B2 · Nagel · 2019 [cited by examiner]
US 10249313B2 · Gao · 2019 [cited by examiner]
US 10373629B2 · Liu · 2019 [cited by examiner]
US 10937437B2 · Nagel · 2021 [cited by examiner]
US 11594237B2 · Nagel · 2023 [cited by examiner]
US 11705146B2 · Nagel · 2023 [cited by examiner]
US 20030158726A1 · Philippe · 2003 [cited by examiner]
US 20040078205A1 · Liljeryd · 2004 [cited by examiner]
US 20040125878A1 · Liljeryd · 2004 [cited by examiner]
US 20050096917A1 · Kjorling · 2005 [cited by examiner]
US 20060190245A1 · Iser · 2006 [cited by examiner]
US 20060271373A1 · Khalil et al. · 2006 [cited by applicant]
US 20070174063A1 · Mehrotra · 2007 [cited by examiner]
US 20070206645A1 · Sundqvist et al. · 2007 [cited by applicant]
US 20070239462A1 · Makinen et al. · 2007 [cited by applicant]
US 20070285815A1 · Herre · 2007 [cited by examiner]
US 20080049795A1 · Lakaniemi · 2008 [cited by applicant]
US 20080147414A1 · Son et al. · 2008 [cited by applicant]
US 20080294429A1 · Su et al. · 2008 [cited by applicant]
US 20090326930A1 · Kawashima et al. · 2009 [cited by applicant]
US 20100049511A1 · Ma et al. · 2010 [cited by applicant]
US 20100085102A1 · Lee · 2010 [cited by examiner]
US 20100114583A1 · Lee · 2010 [cited by examiner]
US 20110004479A1 · Ekstrand · 2011 [cited by examiner]
US 20110112670A1 · Disch · 2011 [cited by examiner]
US 20110125505A1 · Vaillancourt et al. · 2011 [cited by applicant]
US 20110196673A1 · Sharma et al. · 2011 [cited by applicant]
US 20110231195A1 · Nongpiur · 2011 [cited by examiner]
US 20120136670A1 · Ishikawa · 2012 [cited by examiner]
US 20120195442A1 · Villemoes · 2012 [cited by examiner]
US 20120209604A1 · Sehlstedt · 2012 [cited by applicant]
US 20120271644A1 · Bessette et al. · 2012 [cited by applicant]
US 20130144632A1 · Sung · 2013 [cited by applicant]
US 20130332177A1 · Helmrich et al. · 2013 [cited by applicant]
US 20140188465A1 · Choo et al. · 2014 [cited by applicant]
US 20150073784A1 · Gao · 2015 [cited by examiner]
US 20150235653A1 · Liu · 2015 [cited by examiner]
US 20170221498A1 · Gao · 2017 [cited by examiner]
US 20180018989A1 · Liu · 2018 [cited by examiner]
US 20190355378A1 · Liu · 2019 [cited by examiner]
CN 101364854B · 2011 [cited by applicant]
EP 0424016A2 · 1991 [cited by applicant]
EP 0985328B1 · 2006 [cited by applicant]
EP 1850327A1 · 2007 [cited by applicant]
EP 1088302B1 · 2008 [cited by applicant]
EP 2107556A1 · 2009 [cited by applicant]
FR 2830970A1 · 2003 [cited by applicant]
WO 9847313A2 · 1998 [cited by applicant]
WO 2011042464A1 · 2011 [cited by applicant]
WO 2011048094A1 · 2011 [cited by applicant]
WO 2012110415A1 · 2012 [cited by applicant]
WO 2012110448A1 · 2012 [cited by applicant]
WO 2014096279A1 · 2014 [cited by applicant]
Nagel et al., “Audio Encoder and Bandwidth Extension Decoder”, U.S. Appl. No. 17/965,830, filed Oct. 14, 2022. [cited by applicant]
Schnell et al., “Low Delay Filterbanks for Enhanced Low Delay Audio Coding”, 2007 IEEE Workshop on Applications of Signal Processing to Audio and Acoustics, Oct. 21-24, 2007, pp. 235-238. [cited by applicant]
Malvar, “Signal Processing with Lapped Transforms”, Chapter 5, Computer Science Engineering, 1992, 378 pages. [cited by applicant]
Bosi al., “Introduction To Digital Audio Coding And Standards”, Springer Science+Business Media, LLC, 2003, 442 pages. [cited by applicant]
Wikipedia, “Convolution theorem”, retrieived Feb. 12, 2025, pp. 1-7. [cited by applicant]
Clark et al., “A Unified Approach to Time- and Frequency-Domain Realization of FIR Adaptive Digital Filters”, IEEE Transactions on Acoustics, Speech, and Signal Processing, vol. ASSP-31, No. 5, Oct. 1983, pp. 1073-1083. [cited by applicant]
International Telecommunication Union, Series G: Transmission Systems and Media, Digital Systems and Networks Digital terminal equipments—Coding of analogue signals by methods other than PCM, Wideband coding of speech a… [cited by applicant]
International Telecommunication Union, Series G: Transmission Systems and Media, Digital Systems and Networks Digital terminal equipements—Coding of analogue signals by methods other than PCM, Wideband coding of speech … [cited by applicant]
Kondoz, “Digital Speech: Coding for Low Bit Rate Communication Systems”, John Wiley & Sons, 2004, 446 pages. [cited by applicant]
Lecomte et al., “An Improved Low Complexity AMR-WB+ Encoder using Neural Networks for Mode Selection”, Audio Engineering Society (AES), 123rd Audio Engineering Society Convention, Convention Paper 7294, section 2.1.2, O… [cited by applicant]
International Telecommunication Union, “General Aspects of Digital Transmission Systems, Dual Rate Speech Coder for Multimedia Communications Transmitting At 5.3 AND 6.3 kbit/s”, ITU-T G.723.1, 31 pages. [cited by applicant]
Ravishankar, “Speech Coding”, Lawrence Livermore National Laboratory, UCRL-ID-130167, https://doi.org/10.2172/325392, May 8, 1998, 144 pages. [cited by applicant]
Hou et al., “Real-time Audio Error Concealment Method Based on Sinusoidal Model”, International Conference on audio Language and Image Processing, IEEE, Aug. 2008, 8 pages. [cited by applicant]
International Telecommunication Union, “Series G: Transmission Systems and Media, Digital Systems and Networks Digital terminal equipments—Coding of voice and audio signals, Frame error robust narrow-band and wideband e… [cited by applicant]
Warren et al., “Analysis of the spectral envelope of sounds by the human brain”, NeuroImage vol. 24 Issue 4, https://pubmed.ncbi.nlm.nih.gov/15670682/#:˜:text=Spectral%20envelope%20is%20the%20shape,of%20sounds%20such%20… [cited by applicant]
Virette, “Low Delay Transform for High Quality Low Delay Audio Coding”, Signal and Image processing, Université de Rennes, Jan. 2012, 197 pages. [cited by applicant]
Ostergaard et al., “Real-time Perceptual Moving-Horizon Multiple-Description Audio Coding”, IEEE Transactions On Signal Processing 59(9), 2011, 14 pages. [cited by applicant]
Oh et al., “A Fast Quantization Loop Algorithm for MP3/AAC Encoders”, The Proceedings of the AES 29th International Conference, Sep. 2-4, 2006, 5 pages. [cited by applicant]
Fraunhofer IIS, “Qualification Deliverables for the Fraunhofer IIS Candidate for EVS (including Technical Description and Report on Compliance to Design Constraints”, TSG SA4#72bis meeting, Tdoc S4-130345, Mar. 11-15, 2… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Service and System Aspects; Audio codec processing functions; Extended AMR Wideband codec; Transcoding fuinctions (Release 6)”, 3GPP TS 26.290 V2.0.0, S… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Service and System Aspects; Audio codec processing functions; Extended Adaptive Multi-Rate—Wideband (AMR-WB+) codec; Transcoding fuinctions (Release 10)… [cited by applicant]
“Universal Mobile Telecommunications System (UMTS); Audio codec processing functions; Extended Adaptive Multi-Rate—Wideband (AMR-WB+) codec; Transcoding functions (3GPP TS 26.290 version 6.1.0, Release 6)”, ETSI TS 126 … [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; General audio codec audio processing functions; Enhanced aacPlus general audio codec; Encoder specification AAC part (Relea… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); ANSI C code (fixed-point) (Release 14)”, 3GPP TS 26.442 V14.0.0, Mar. 2017, pp. 1-… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); ANSI C code (floating-point) (Release 14)”, 3GPP TS 26.443 14.0.0, Mar. 2017, pp. … [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); Detailed Algorithmic Description (Release 12)”, 3GPP TS 26.445 V12.0.0, Sep. 2014,… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); Detailed Algorithmic Description (Release 14)”, 3GPP TS 26.445 V14.0.0, Mar. 2017,… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); Detailed Algorithmic Description (Release 14)”, 3GPP TS 26.445 V14.2.0, Dec. 2017,… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); Detailed Algorithmic Description (Release 16)”,3GPP TS 26.445 V16.2.0, Dec. 2021, … [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); Detailed Algorithmic Description (Release 17)”, 3GPP TS 26.445 V17.0.0, Apr. 2022,… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); Error Concealment of Lost Packets (Release 14)”, 3GPP TS 26.447 V14.0.0, Mar. 2017… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); Error Concealment of Lost Packets (Release 14)”, 3GPP TS 26.447 V14.2.0, Jun. 2020… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); Error Concealment of Lost Packets (Release 16)”, 3GPP TS 26.447 V16.0.0, Mar. 2019… [cited by applicant]
“3rd Generation Partnership Project; Technical Specification Group Services and System Aspects; Codec for Enhanced Voice Services (EVS); Performance Characterization (Release 17)”, 3GPP TR 26.952 V17.0.0, Apr. 2022, 176… [cited by applicant]
Fuchs et al, “MDCT-Based Coder for Highly Adaptive Speech and Audio Coding”, 17th European Signal Processing Conference (EUSIPCO 2009), Aug. 24-28, 2009, 5 pages. [cited by applicant]
Schnell et al., “Proposed Core Experiment on AAC-ELD”, International Organisation for Standardisation, ISO/IEC JTC1/SC29/WG11, Apr. 18, 2007, 17 pages. [cited by applicant]