IP Library › Granted Patent US 12,406,680
Granted Patent B2
US 12,406,680 · App. 18/940,575 · Granted Sep 2, 2025

Low bitrate audio encoding/decoding scheme having cascaded switches

Inventors: Bernhard Grill (Lauf, DE); Roch Lefebvre (Canton de Magog, CA); Bruno Bessette (Sherbrooke, CA); Jimmy Lapierre (Sherbrooke, CA); Philippe Gournay (Sherbrooke, CA); Redwan Salami (Saint-Laurent, CA); Stefan Bayer (Nuremberg, DE); Guillaume Fuchs (Nuremberg, DE); Stefan Geyersberger (Wuerzburg, DE); Ralf Geiger (Nuremberg, DE); Johannes Hilpert (Nuremberg, DE); Ulrich Kraemer (Stuttgart, DE); Jérémie Lecomte (Nuremberg, DE); Markus Multrus (Nuremberg, DE); Max Neuendorf (Nuremberg, DE); Harald Popp (Tuchenbach, DE); Nikolaus Rettelbach (Nuremberg, DE)
Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
G10L19/008G10L19/173G10L19/18G10L2019/0008G10L19/0017G10L19/0212
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,406,680
App. No.
18/940,575
Granted
Sep 2, 2025
Kind
B2
Abstract

An audio encoder has a first information sink oriented encoding branch such as a spectral domain encoding branch, a second information source or SNR oriented encoding branch such as an LPC-domain encoding branch, and a switch for switching between the first and second encoding branches, the second encoding branch having a converter into a specific domain different from the spectral domain such as an LPC analysis stage generating an excitation signal, and the second encoding branch having a specific domain coding branch such as LPC domain processing branch, and a specific spectral domain coding branch such as LPC spectral domain processing branch, and an additional switch for switching between the specific domain coding branch and the specific spectral domain coding branch. An audio decoder has a first domain decoder, a second domain decoder, and a third domain decoder as well as two cascaded switches for switching between the decoders.

Claims (37)

1. Method of decoding an encoded audio signal, the encoded audio signal comprising a first encoded signal, a first processed signal in a second domain, and a second processed signal in a third domain, comprising:

decoding the first encoded signal to obtain a decoded first signal;

decoding the first processed signal or the second processed signal,

wherein the decoding the first processed signal or the second processed signal comprises:

inverse processing the first processed signal to acquire a first inverse processed signal in the second domain;

inverse processing the second processed signal to acquire a second inverse processed signal in the second domain;

combining the first inverse processed signal and the second inverse processed signal to acquire a combined signal in the second domain; and

converting the combined signal in the second domain to a first domain to obtain a converted signal; and

combining the converted signal and the decoded first signal to acquire a combined signal in the first domain;

wherein the method comprises post-processing the combined signal in the first domain, wherein an output signal of the post-processing is an expanded version of the combined signal in the first domain.

2. Method of the claim 1 , in which the combining the first inverse processed signal and the second inverse processed signal or the combining the converted signal and the decoded first signal comprises switching, the switching comprising a cross fading functionality.

3. Method of claim 1 , in which the first domain is a time domain, the second domain is an LPC domain, and the third domain is an LPC spectral domain.

4. Method of claim 1 , wherein the first encoded signal is encoded in a fourth domain, which is a time-spectral domain acquired by time/frequency converting a signal in the first domain.

5. Method of claim 1 , in which the decoding the first encoded signal comprises inverse coding and de-quantizing and frequency domain time domain converting.

6. Method of claim 1 , wherein the decoding the first processed signal or the second processed signal comprises inverse coding and de-quantizing in the inverse processing the first processed signal.

7. Method of claim 1 , wherein the decoding the first processed signal or the second processed signal comprises inverse coding and de-quantizing and LPC spectral domain to LPC domain converting in the inverse processing the second processed signal.

8. Method of claim 1 , in which the decoding the first encoded signal or the inverse processing the second processed signal comprises overlap-adding for performing a time domain aliasing cancellation functionality.

9. Method of claim 1 , in which the decoding the first encoded signal or the inverse processing the second processed signal comprises de-warping controlled by a warping characteristic comprised in the encoded audio signal.

10. Method of claim 1 , in which the encoded signal comprises, as side information, an indication whether the encoded signal is to be decoded by the decoding the first encoded signal or the decoding the first processed signal or the second processed signal or the inverse processing the first processed signal or the inverse processing the second processed signal-, and

which further comprises parsing the encoded signal to determine, based on the side information, whether the encoded signal is to be processed by the decoding the first encoded signal, or the decoding the first processed signal or the second processed signal, or the inverse processing the first processed signal or the inverse processing the second processed signal-.

11. Method of claim 1 , in which the post-processing comprises at least one of a joint multichannel decoding method or a bandwidth extension processing.

12. Method of claim 11 ,

in which the joint multichannel decoding method comprises a parameter decoding method and an upmixing controlled by a parameter decoding method output.

13. Method of claim 11 ,

in which the bandwidth extension processing comprises patching for creating a high band signal, adjusting the high band signal to obtain an adjusted high band signal, and combining the adjusted high band signal and a low band signal to acquire a bandwidth extended signal.

14. Method of claim 1 ,

wherein the converting comprises an LPC synthesis controlled by LPC information.

15. A non-transitory storage medium having stored thereon a computer program for performing, when running on a computer, a method of decoding an encoded audio signal, the encoded audio signal comprising a first encoded signal, a first processed signal in a second domain, and a second processed signal in a third domain, the method of decoding comprising:

decoding the first encoded signal to obtain a decoded first signal;

decoding the first processed signal or the second processed signal,

wherein the decoding the first processed signal or the second processed signal comprises:

inverse processing the first processed signal to acquire a first inverse processed signal in the second domain;

inverse processing the second processed signal to acquire a second inverse processed signal in the second domain;

combining the first inverse processed signal and the second inverse processed signal to acquire a combined signal in the second domain; and

converting the combined signal in the second domain to a first domain to obtain a converted signal; and

combining the converted signal and the decoded first signal to acquire a combined signal in the first domain;

wherein the method comprises post-processing the combined signal in the first domain, wherein an output signal of the post-processing is an expanded version of the combined signal in the first domain.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Nov 12, 2024
From: GRILL, BERNHARD; LEFEBVRE, ROCH; BESSETTE, BRUNO; LAPIERRE, JIMMY; GOURNAY, PHILIPPE; SALAMI, REDWAN; BAYER, STEFAN; FUCHS, GUILLAUME; GEYERSBERGER, STEFAN; GEIGER, RALF; HILPERT, JOHANNES; KRAEMER, ULRICH; LECOMTE, JÉRÉMIE; MULTRUS, MARKUS; NEUENDORF, MAX; POPP, HARALD; RETTELBACH, NIKOLAUS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 069229/0769 →
Priority Claims (2)
EP 08017663 · Oct 8, 2008 · regional
EP 09002271 · Feb 18, 2009 · regional
Continuity (9)
Continuation 18451067 · Aug 16, 2023
Continuation 17933567 · Sep 20, 2022
Continuation 16834601 · Mar 30, 2020
Continuation 16398082 · Apr 29, 2019
Continuation 14580179 · Dec 22, 2014
Continuation 13004385 · Jan 11, 2011
Continuation PCTEP2009004652 · Jun 26, 2009
Provisional Application 61079854 · Jul 11, 2008
Related Publication 20250061903A1 · Feb 20, 2025
References Cited (70)
US 5890110A · Gersho et al. · 1999 [cited by applicant]
US 6134518A · Cohen et al. · 2000 [cited by applicant]
US 6785645B2 · Khalil et al. · 2004 [cited by applicant]
US 6978241B1 · Sluijter et al. · 2005 [cited by applicant]
US 7139700B1 · Stachurski et al. · 2006 [cited by applicant]
US 7222070B1 · Stachurski et al. · 2007 [cited by applicant]
US 7605722B2 · Beack et al. · 2009 [cited by applicant]
US 7663513B2 · Pang et al. · 2010 [cited by applicant]
US 7739120B2 · Maekinen · 2010 [cited by applicant]
US 7751485B2 · Pang et al. · 2010 [cited by applicant]
US 7860709B2 · Maekinen · 2010 [cited by applicant]
US 8069034B2 · Maekinen et al. · 2011 [cited by applicant]
US 8275626B2 · Neuendorf et al. · 2012 [cited by applicant]
US 8321210B2 · Grill et al. · 2012 [cited by applicant]
US 8447620B2 · Neuendorf et al. · 2013 [cited by applicant]
US 8484038B2 · Bessette et al. · 2013 [cited by applicant]
US 8577483B2 · Oh et al. · 2013 [cited by applicant]
US 8744843B2 · Geiger et al. · 2014 [cited by applicant]
US 8744863B2 · Neuendorf et al. · 2014 [cited by applicant]
US 8751246B2 · Lecomte et al. · 2014 [cited by applicant]
US 8804970B2 · Grill et al. · 2014 [cited by applicant]
US 8930198B2 · Grill et al. · 2015 [cited by applicant]
US 8959017B2 · Grill et al. · 2015 [cited by applicant]
US 9043215B2 · Neuendorf et al. · 2015 [cited by applicant]
US 10319384B2 · Grill et al. · 2019 [cited by applicant]
US 10621996B2 · Grill et al. · 2020 [cited by applicant]
US 11475902B2 · Grill et al. · 2022 [cited by applicant]
US 11823690B2 · Grill · 2023 [cited by examiner]
US 11942101B2 · Multrus et al. · 2024 [cited by applicant]
US 12334086B2 · Grill · 2025 [cited by examiner]
US 20030004711A1 · Koishida et al. · 2003 [cited by applicant]
US 20050192797A1 · Makinen · 2005 [cited by applicant]
US 20050192798A1 · Vainio et al. · 2005 [cited by applicant]
US 20050256701A1 · Makinen · 2005 [cited by applicant]
US 20050261892A1 · Makinen et al. · 2005 [cited by applicant]
US 20050261900A1 · Ojala et al. · 2005 [cited by applicant]
US 20050267742A1 · Makinen · 2005 [cited by applicant]
US 20060206334A1 · Kapoor et al. · 2006 [cited by applicant]
US 20070106502A1 · Kim et al. · 2007 [cited by applicant]
US 20070147518A1 · Bessette · 2007 [cited by applicant]
US 20070174051A1 · Oh et al. · 2007 [cited by applicant]
US 20070282599A1 · Choo et al. · 2007 [cited by applicant]
US 20080004869A1 · Herre et al. · 2008 [cited by applicant]
US 20080033732A1 · Seefeldt et al. · 2008 [cited by applicant]
US 20080147414A1 · Son et al. · 2008 [cited by applicant]
US 20080162121A1 · Son et al. · 2008 [cited by applicant]
US 20080172223A1 · Oh et al. · 2008 [cited by applicant]
US 20080234846A1 · Malvar · 2008 [cited by applicant]
US 20090110201A1 · Kim et al. · 2009 [cited by applicant]
US 20090110203A1 · Taleb · 2009 [cited by applicant]
US 20090210234A1 · Sung et al. · 2009 [cited by applicant]
US 20250061902A1 · Grill · 2025 [cited by examiner]
US 20250061903A1 · Grill · 2025 [cited by examiner]
US 20250069608A1 · Grill · 2025 [cited by examiner]
CN 1677492A · 2005 [cited by applicant]
EP 0932141A2 · 1999 [cited by applicant]
EP 2144230A1 · 2010 [cited by applicant]
EP 2144231A1 · 2010 [cited by applicant]
EP 2146344A1 · 2010 [cited by applicant]
EP 1719120B1 · 2019 [cited by applicant]
FI 118835B · 2008 [cited by applicant]
RU 2006139794A · 2008 [cited by applicant]
WO 2005112004A1 · 2005 [cited by applicant]
WO 2008045846A1 · 2008 [cited by applicant]
WO 2008071353A2 · 2008 [cited by applicant]
WO WO2010003532A1 · 2010 [cited by examiner]
WO WO2010040522A2 · 2010 [cited by examiner]
3GPP TS 26.290 version 2.0.0 Extended Adaptive Multi-Rate—Wideband codec; Transcoding functions, Release 6; TSG-SA WG4, TSG SA Meeting #25, Palm Springs, USA, Sep. 2004, 86 pages. [cited by applicant]
Ramprashad, Sean, “The Multimode Transform Predictive Coding Paradigm”, IEEE Transactions on Speech and Audio Processing, vol. 11, No. 2, Mar. 2003, pp. 117-129. [cited by applicant]
Spanias, Andreas S, “Speech Coding: A Tutorial Review”, and Falk, H. “Prolog to Speech Coding: A Tutorial Review—A tutorial introduction to the paper by Spanias”; Proceedings of the IEEE vol. 82; Tempe, AZ, Oct. 10, 199… [cited by applicant]
Cited By (1)
US 12,573,411