IP Library › Granted Patent US 12,658,193
Granted Patent B2
US 12,658,193 · App. 17/001,722 · Granted Jun 16, 2026

Multi-channel audio decoder, multi-channel audio encoder, methods and computer program using a residual-signal-based adjustment of a contribution of a decorrelated signal

Inventors: Sascha Dick (Nuremberg, DE); Christian Helmrich (Erlangen, DE); Johannes Hilpert (Nuremberg, DE); Andreas Hoelzer (Erlangen, DE)
Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V
G10L19/008G10L19/22H04S1/007H04S3/02G10L19/20H04S2400/03H04S2420/07
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,658,193
App. No.
17/001,722
Granted
Jun 16, 2026
Kind
B2
Abstract

A multi-channel audio decoder for providing at least two output audio signals on the basis of an encoded representation is configured to perform a weighted combination of a downmix signal, a decorrelated signal and a residual signal, to obtain one of the output audio signals. The multi-channel audio decoder is configured to determine a weight describing a contribution of the decorrelated signal in the weighted combination in dependence on the residual signal. A multi-channel audio encoder for providing an encoded representation of a multi-channel audio signal is configured to obtain a downmix signal on the basis of the multi-channel audio signal, to provide parameters describing dependencies between the channels of the multi-channel audio signal, and to provide a residual signal. The multi-channel audio encoder is configured to vary an amount of residual signal included into the encoded representation in dependence on the multi-channel audio signal.

Claims (26)

1 . A multi-channel audio decoder for providing at least two output audio signals on the basis of an encoded representation,

wherein the multi-channel audio decoder is configured to acquire one of the at least two output audio signals on the basis of a downmix signal, a decorrelated signal and a residual signal using a weighted combination of the downmix signal, the decorrelated signal and the residual signal,

wherein the downmix signal, the decorrelated signal and the residual signal are determined by the multi-channel audio decoder on the basis of the encoded representation;

wherein the multi-channel audio decoder is configured to determine a weighting of the decorrelated signal in the weighted combination in dependence on the residual signal and in dependence on the decorrelated signal,

wherein the multi-channel audio decoder is configured to put a comparatively higher weight on the decorrelated signal if the residual signal is comparatively weak, and to put a comparatively smaller weight on the decorrelated signal if the residual signal is comparatively strong;

wherein the multi-channel audio decoder is configured to variably adjust a weighting of the residual signal in the weighted combination in dependence on the downmix signal.

2 . A multi-channel audio decoder for providing at least two output audio signals on the basis of an encoded representation,

wherein the multi-channel audio decoder is configured to acquire one of the at least two output audio signals on the basis of a downmix signal, a decorrelated signal and a residual signal using a weighted combination of the downmix signal, the decorrelated signal and the residual signal,

wherein the downmix signal, the decorrelated signal and the residual signal are determined by the multi-channel audio decoder on the basis of the encoded representation;

wherein the multi-channel audio decoder is configured to determine a weighting of the decorrelated signal in the weighted combination in dependence on the residual signal and in dependence on the decorrelated signal,

wherein the multi-channel audio decoder is configured to put a comparatively higher weight on the decorrelated signal if the residual signal is comparatively weak, and to put a comparatively smaller weight on the decorrelated signal if the residual signal is comparatively strong; and

wherein the multi-channel audio decoder is configured to variably adjust a weighting of the residual signal in the weighted combination in dependence on the decorrelated signal.

3 . A method for providing at least two output audio signals on the basis of an encoded representation, the method comprising:

obtaining a downmix signal, a decorrelated signal and a residual signal on the basis of the encoded representation;

acquiring one of the at least two output audio signals on the basis of the downmix signal, the decorrelated signal and the residual signal using a weighted combination of the downmix signal, the decorrelated signal and the residual signal,

determining a weighting of the decorrelated signal in the weighted combination in dependence on the residual signal and in dependence on the decorrelated signal,

putting a comparatively higher weight on the decorrelated signal if the residual signal is comparatively weak, and putting a comparatively smaller weight on the decorrelated signal if the residual signal is comparatively strong; and

wherein a weight of the residual signal in the weighted combination is variably adjusted in dependence on the downmix signal.

4 . A non-transitory digital storage medium having a computer program stored thereon to perform the method for providing at least two output audio signals based on an encoded representation according to claim 3 when said computer program is run by a computer.

5 . A method for providing at least two output audio signals on the basis of an encoded representation, the method comprising:

obtaining a downmix signal, a decorrelated signal and a residual signal on the basis of the encoded representation;

acquiring one of the at least two output audio signals on the basis of the downmix signal, the decorrelated signal and the residual signal using a weighted combination of the downmix signal, the decorrelated signal and the residual signal,

determining a weighting of the decorrelated signal in the weighted combination in dependence on the residual signal and in dependence on the decorrelated signal,

putting a comparatively higher weight on the decorrelated signal if the residual signal is comparatively weak, and putting a comparatively smaller weight on the decorrelated signal if the residual signal is comparatively strong; and

wherein a weight of the residual signal in the weighted combination is variably adjusted in dependence on the decorrelated signal.

6 . A non-transitory digital storage medium having a computer program stored thereon to perform the method for providing at least two output audio signals based on an encoded representation according to claim 5 when said computer program is run by a computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Aug 25, 2020
From: DICK, SASCHA; HELMRICH, CHRISTIAN; HILPERT, JOHANNES; HOELZER, ANDREAS
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 053583/0049 →
Priority Claims (3)
EP 13177375 · Jul 22, 2013 · regional
EP 13189309 · Oct 18, 2013 · regional
WO PCT/EP2014/065416 · Jul 17, 2014 · international
Continuity (5)
Continuation 15784332 · Oct 16, 2017
Division 15167085 · May 27, 2016
Continuation 15004571 · Jan 22, 2016
Continuation PCTEP2014065416 · Jul 17, 2014
Related Publication 20200388293A1 · Dec 10, 2020
References Cited (104)
US 5717764A · Johnston et al. · 1998 [cited by applicant]
US 5970152A · Klayman · 1999 [cited by applicant]
US 7573912B2 · Lindblom · 2009 [cited by applicant]
US 7668722B2 · Villemoes et al. · 2010 [cited by applicant]
US 8255228B2 · Hilpert et al. · 2012 [cited by applicant]
US 8731950B2 · Herre et al. · 2014 [cited by applicant]
US 9245530B2 · Herre et al. · 2016 [cited by applicant]
US 9502040B2 · Kuntz et al. · 2016 [cited by applicant]
US 10354661B2 · Dick et al. · 2019 [cited by applicant]
US 20040181399A1 · Gao · 2004 [cited by applicant]
US 20050157883A1 · Herre et al. · 2005 [cited by applicant]
US 20050216262A1 · Fejzo · 2005 [cited by applicant]
US 20060140412A1 · Villemoes · 2006 [cited by applicant]
US 20060165184A1 · Purhagen et al. · 2006 [cited by applicant]
US 20060190247A1 · Lindblom · 2006 [cited by examiner]
US 20060233379A1 · Villemoes · 2006 [cited by examiner]
US 20070019813A1 · Hilpert · 2007 [cited by applicant]
US 20070067162A1 · Villemoes et al. · 2007 [cited by applicant]
US 20070081597A1 · Disch · 2007 [cited by examiner]
US 20070121952A1 · Engdegard · 2007 [cited by examiner]
US 20070171944A1 · Schuijers et al. · 2007 [cited by applicant]
US 20070172070A1 · Cho · 2007 [cited by applicant]
US 20080004883A1 · Vilermo et al. · 2008 [cited by applicant]
US 20090083040A1 · Myburg · 2009 [cited by examiner]
US 20090125313A1 · Hellmuth · 2009 [cited by applicant]
US 20090248424A1 · Koishida et al. · 2009 [cited by applicant]
US 20100027819A1 · Van Den Berghe et al. · 2010 [cited by applicant]
US 20100142731A1 · Oh · 2010 [cited by examiner]
US 20100153097A1 · Hotho et al. · 2010 [cited by applicant]
US 20100332239A1 · Kim et al. · 2010 [cited by applicant]
US 20110046964A1 · Moon et al. · 2011 [cited by applicant]
US 20110096932A1 · Schuijers · 2011 [cited by examiner]
US 20110106540A1 · Schuijers et al. · 2011 [cited by applicant]
US 20110182432A1 · Ishikawa et al. · 2011 [cited by applicant]
US 20110200198A1 · Grill · 2011 [cited by examiner]
US 20110211702A1 · Mundt · 2011 [cited by applicant]
US 20120002818A1 · Heiko et al. · 2012 [cited by applicant]
US 20120070007A1 · Kim et al. · 2012 [cited by applicant]
US 20120163608A1 · Kishi et al. · 2012 [cited by applicant]
US 20120177204A1 · Hellmuth · 2012 [cited by applicant]
US 20120275607A1 · Kjoerling et al. · 2012 [cited by applicant]
US 20120275609A1 · Beack et al. · 2012 [cited by applicant]
US 20120281841A1 · Kim et al. · 2012 [cited by applicant]
US 20120314876A1 · Vilkamo · 2012 [cited by applicant]
US 20130028426A1 · Purnhagen · 2013 [cited by examiner]
US 20130030819A1 · Purnhagen et al. · 2013 [cited by applicant]
US 20130054253A1 · Shirakawa et al. · 2013 [cited by applicant]
US 20130121411A1 · Robillard · 2013 [cited by applicant]
US 20130124751A1 · Ando et al. · 2013 [cited by applicant]
US 20130138446A1 · Hellmuth et al. · 2013 [cited by applicant]
US 20130156200A1 · Kishi et al. · 2013 [cited by applicant]
US 20130173274A1 · Kuntz et al. · 2013 [cited by applicant]
US 20140019146A1 · Neuendorf · 2014 [cited by applicant]
US 20150086022A1 · Engdegard et al. · 2015 [cited by applicant]
US 20160142845A1 · Dick et al. · 2016 [cited by applicant]
US 20160247508A1 · Dick · 2016 [cited by applicant]
US 20170134875A1 · Schuijers · 2017 [cited by applicant]
CN 102037507 · 2011 [cited by applicant]
CN 102074242 · 2011 [cited by applicant]
CN 102483921 · 2012 [cited by applicant]
CN 102687405 · 2012 [cited by applicant]
CN 105556596 · 2016 [cited by applicant]
EP 2194526A1 · 2010 [cited by applicant]
EP 2477188 · 2012 [cited by applicant]
GB 2485979A · 2012 [cited by applicant]
JP 2006253776 · 2006 [cited by applicant]
JP 2011522472 · 2011 [cited by applicant]
JP 2016531483 · 2016 [cited by applicant]
KR 1020130069770 · 2013 [cited by applicant]
TW 200627380A · 1994 [cited by applicant]
TW 309691 · 1997 [cited by applicant]
TW 201007695A · 2010 [cited by applicant]
WO 2009141775A1 · 2009 [cited by applicant]
WO 2010125104 · 2010 [cited by applicant]
WO 2010149700 · 2010 [cited by applicant]
WO 2011045409 · 2011 [cited by applicant]
“MPEG Surround—The ISO/MPEG Standard for Efficient and Compatible Multichannel Audio Coding” by Jurgen Herre et al, J. of AES, vol. 56, No. 11, November, p. 932-955 (Year: 2008). [cited by examiner]
“Unified Speech and Audio Coding Scheme for High Quality at Low Bitrates” by M. Neuendorf, et al, IEEE ICASSP, p. 1-4, (Year: 2009). [cited by examiner]
“Combined Stereo Coding” by Jurgen Herre, et al, AES, the 93rd Convention 1992, Oct. 1-4, San Francisco, USA, p. 1-18 (Year: 1992). [cited by examiner]
“MPEG Surround—The ISO/MPEG Standard for Efficient and Compatible Multichannel Audio Coding” by Jurgen Herre et al, J. of AES, vol. 56, No. 11, November, p. 932-955 (Year: 2008) (attached in the prevous office action). [cited by examiner]
“Unified Speech and Audio Coding Scheme for High Quality at Low Bitrates” by M. Neuendorf, et al, IEEE ICASSP, p. 1-4, (Year: 2009) (attached in the previous office action). [cited by examiner]
“Combined Stereo Coding” by Jurgen Herre, et al, AES, the 93rd Convention 1992, Oct. 1-4, San Francisco, USA, p. 1-18 (Year: 1992) (attached in the previous office action). [cited by examiner]
“MPEG Surround—The ISO/MPEG Standard for Efficient and Compatible Multichannel Audio Coding” by Jurgen Herre et al, J. of AES, vol. 56, No. 11, November, p. 932-955 (attached in the prevous office action) (Year: 2008). [cited by examiner]
“Unified Speech and Audio Coding Scheme for High Quality at Low Bitrates” by M. Neuendorf, et al, IEEE ICASSP, p. 1-4, (attached in the previous office action) (Year: 2009). [cited by examiner]
“Combined Stereo Coding” by Jurgen Herre, et al, AES, the 93rd Convention 1992, Oct. 1-4, San Francisco, USA, p. 1-18 (attached in the previous office action) (Year: 1992). [cited by examiner]
International Search Report and Written Opinion dated Oct. 20, 2014, PCT/EP2014/065416, 10 pages. [cited by applicant]
Breebaart J. et al., MPEG Spatial Audio Coding / MPEG Surround: Overview and Current Status, Audio Engineering Society Convention Paper, New York, NY, US, Oct. 7, 2005, pp. 1-17 (18 pages). [cited by applicant]
International Search Report and Written Opinion dated Dec. 10, 2014, PCT/EP2014/064915, 22 pages. [cited by applicant]
ISO/IEC 23003-3: 2012—Information Technology—MPEG Audio Technologies, Part 3: Unified Speech and Audio Coding (286 pages). [cited by applicant]
ISO/IEC 13818-7: 2003—Information Technology—Generic coding of moving pictures and associated audio information, Part 7: Advanced audio coding (AAC), (198 pages). [cited by applicant]
ISO/IEC 23003-2: 2010—Information Technology—MPEG Audio Technologies, Part 2: Spatial Audio Object Coding (SAOC), (134 pages). [cited by applicant]
ISO/IEC 23003-1: 2007—Information Technology—MPEG Audio Technologies, Part 1: MPEG Surround (288 pages). [cited by applicant]
Neuendorf Max et al: “MPEG Unified Speech and Audio Coding—The ISO/MPEG Standard for High-Efficiency Audio Coding of All Content Types”, AES Convention 132; Apr. 26, 2012, 22 pages. [cited by applicant]
International Search Report, dated Oct. 6, 2014, PCT/EP2014/065021, 5 pages. [cited by applicant]
Pontus Carlsson et al., Technical description of CE on Improved Stereo Coding in USAC, 93. MPEG Meeting; Jul. 26, 2010-Jul. 30, 2010; Geneva; (Motion Picture Expert Group or ISO/IEC JTC1/SC29/WG11), No. M17825, Jul. 22,… [cited by applicant]
Tsingos Nicolas et al.; Surround Sound with Height in Games Using Dolby Pro Logic Ilz, Conference: 41st International Conference: Audio for Games; Feb. 2011, AES, 60 East 42nd Street, Room 2520, New York, NY 10165-2520,… [cited by applicant]
Tzagkarakis C. et al., A Multichannel Sinusoidal Model Applied to Spot Microphone Signals for Immersive Audio, IEEE Transactions on Audio, Speech and Language Processing, IEEE Service Center, New York, NY, USA, vol. 17,… [cited by applicant]
Decision to Grant in parallel Korean Patent Application No. 10-2016-7003911. [cited by applicant]
ISO/IEC FDIS 23003-3:2011(E), “Information technology—MPEG Audio Technologies—Part 3: Unified Speech and Audio Coding”, ISO-IEC JTC 1/SC 29/WG 11, Sep. 20, 2011. [cited by applicant]
Korean Office Action in parallel Korean Patent Application No. 10-2017-7019086 dated Sep. 25, 2017. [cited by applicant]
Decision to Grant in parallel Japanese Patent Application No. 2016-528444 mailed Nov. 7, 2017. [cited by applicant]
JP Office Action mailed Sep. 25, 2018 in parallel JP Application No. 2017-163479. [cited by applicant]
RU Office Action mailed Oct. 11, 2018 in parallel RU Application No. 2016105647. [cited by applicant]
Corresponding Chinese Office Action dated Jan. 25, 2019 in CN Application No. 201480041263.5. [cited by applicant]