IP Library Granted Patent US 12,198,708
Granted Patent B2
US 12,198,708 · App. 18/628,632 · Granted Jan 14, 2025

Audio entropy encoder/decoder with different spectral resolutions and transform lengths and upsampling and/or downsampling

Inventors: Markus Multrus (Nuremberg, DE); Bernhard Grill (Lauf, DE); Guillaume Fuchs (Nuremberg, DE); Stefan Geyersberger (Wuerzburg, DE); Nikolaus Rettelbach (Nuremberg, DE); Virgilio Bacigalupo (Nuremberg, DE)
Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
G10L19/02G10L19/022H03M7/30
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 12,198,708
App. No.
18/628,632
Filed
Apr 5, 2024
Granted
Jan 14, 2025
Kind
B2
Art Unit
2658
USPC
704/501
Abstract

An audio encoder for encoding segments of coefficients, the segments of coefficients representing different time or frequency resolutions of a sampled audio signal, the audio encoder including a processor for deriving a coding context for a currently encoded coefficient of a current segment based on a previously encoded coefficient of a previous segment, the previously encoded coefficient representing a different time or frequency resolution than the currently encoded coefficient. The audio encoder further includes an entropy encoder for entropy encoding the current coefficient based on the coding context to obtain an encoded audio stream.

Claims (22)

1. Method for encoding, comprising the steps of

spectrally decomposing, in a segment-wise manner and using different transform lengths, a sampled audio signal to obtain a sequence of segments of coefficients such that segments of coefficients for which different transform lengths are used, spectrally represent the sampled audio signal at different spectral resolutions and comprise different numbers of coefficients;

entropy encoding a currently encoded coefficient of a current segment having a first spectral resolution based on an entropy coding context derived from a previously encoded coefficient of a previous segment having a second spectral resolution, which is different from the first spectral resolution,

wherein the current segment is spectrally subdivided at the first spectral resolution into a first sequence of tuples of a first number spectrally neighboring coefficients,

wherein the previous segment is spectrally subdivided at the second spectral resolution into a second sequence of tuples of a second number of spectrally neighboring coefficients, the first number being equal to the second number,

computing the entropy coding context for a current tuple comprising the currently encoded coefficient by

downsampling the second sequence of tuples of the previous segment when the second spectral resolution is finer than the first spectral resolution, and/or up-sampling the second sequence of tuples of the previous segment, when the second spectral resolution is coarser than the first spectral resolution so as to obtain a third sequence of tuples so that a tuple of the third sequence at an index k equals a tuple of the second sequence at an index k*ratio, wherein ratio corresponds to the second resolution divided by the first resolution,

selecting a set of tuples out of the third sequence, and

computing the entropy coding context for the current tuple on the basis of the set of tuples, and

entropy encoding the currently encoded coefficient by entropy encoding the current tuple using the entropy coding context for the current tuple,

wherein the entropy encoding is based on an arithmetic coding or a variable length coding rule.

2. An audio decoding method, comprising

receiving a decoded audio stream into which an audio signal is encoded in a manner spectrally decomposed, in a segment-wise manner and using different transform lengths, a sampled audio signal thereby obtaining a sequence of segments of coefficients, wherein segments of coefficients for which different transform lengths are used, spectrally represent the audio signal at different spectral resolutions and comprise different numbers of coefficients, and

entropy decoding a currently decoded coefficient of a current segment having a first spectral resolution based on an entropy coding context derived from a previously decoded coefficient of a previous segment having a second spectral resolution, which is different from the first spectral resolution,

wherein the current segment is spectrally subdivided at the first spectral resolution into a first sequence of tuples of a first number spectrally neighboring coefficients,

wherein the previous segment is spectrally subdivided at the second spectral resolution into a second sequence of tuples of a second number spectrally neighboring coefficients, the first number being equal to the second number,

computing the entropy coding context for a current tuple comprising the currently decoded coefficient by

downsampling the second sequence of tuples of the previous segment when the second spectral resolution is finer than the first spectral resolution, and/or up-sampling the second sequence of tuples of the previous segment, when the second spectral resolution is coarser than the first spectral resolution so as to obtain a third sequence of tuples so that a tuple of the third sequence at an index k equals a tuple of the second sequence at an index k*ratio, wherein ratio corresponds to the second resolution divided by the first resolution,

selecting a set of tuples out of the third sequence, and

computing the entropy coding context for the current tuple on the basis of the set of tuples, and

entropy decoding the currently decoded coefficient by entropy decoding the current tuple using the entropy coding context for the current tuple, and

wherein the entropy decoding is based on an arithmetic decoding or a variable length decoding rule.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Apr 11, 2024
From: MULTRUS, MARKUS; GRILL, BERNHARD; FUCHS, GUILLAUME; GEYERSBERGER, STEFAN; RETTELBACH, NIKOLAUS; BACIGALUPO, VIRGILIO
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 067082/0687 →
Continuity (9)
Continuation 18301191 · Apr 14, 2023
Continuation 16888176 · May 29, 2020
Continuation 16283591 · Feb 22, 2019
Continuation 14589881 · Jan 5, 2015
Continuation 13004282 · Jan 11, 2011
Continuation PCTEP2009003521 · May 18, 2009
Provisional Application 61103820 · Oct 8, 2008
Provisional Application 61079842 · Jul 11, 2008
Related Publication 20240249736A1 · Jul 25, 2024
References Cited (102)
US 5233055A · Blytas et al. · 1993 [cited by applicant]
US 5852806A · Johnston et al. · 1998 [cited by applicant]
US 6226608B1 · Fielder et al. · 2001 [cited by applicant]
US 6931291B1 · Alvarez-tinoco et al. · 2005 [cited by applicant]
US 7275031B2 · Hoerich et al. · 2007 [cited by applicant]
US 7275936B1 · Ju · 2007 [cited by applicant]
US 7433824B2 · Mehrotra et al. · 2008 [cited by applicant]
US 7509161B2 · Viertioe-Oja · 2009 [cited by applicant]
US 7617110B2 · Kim et al. · 2009 [cited by applicant]
US 7729903B2 · Schuller et al. · 2010 [cited by applicant]
US 7774205B2 · Koishida et al. · 2010 [cited by applicant]
US 7860720B2 · Thumpudi et al. · 2010 [cited by applicant]
US 8095359B2 · Boehm et al. · 2012 [cited by applicant]
US 8447591B2 · Mehrotra · 2013 [cited by applicant]
US 8447620B2 · Neuendorf et al. · 2013 [cited by applicant]
US 8494865B2 · Fuchs et al. · 2013 [cited by applicant]
US 8612240B2 · Fuchs et al. · 2013 [cited by applicant]
US 8645145B2 · Subbaraman et al. · 2014 [cited by applicant]
US 8655669B2 · Fuchs et al. · 2014 [cited by applicant]
US 8682681B2 · Fuchs et al. · 2014 [cited by applicant]
US 8706510B2 · Fuchs et al. · 2014 [cited by applicant]
US 8930202B2 · Multrus et al. · 2015 [cited by applicant]
US 9455739B2 · Tanida et al. · 2016 [cited by applicant]
US 9633664B2 · Subbaraman et al. · 2017 [cited by applicant]
US 9978380B2 · Fuchs et al. · 2018 [cited by applicant]
US 10115401B2 · Fuchs et al. · 2018 [cited by applicant]
US 10242681B2 · Multrus et al. · 2019 [cited by applicant]
US 10685659B2 · Multrus et al. · 2020 [cited by applicant]
US 20030115041A1 · Chen et al. · 2003 [cited by applicant]
US 20030115052A1 · Chen et al. · 2003 [cited by applicant]
US 20030187634A1 · Li · 2003 [cited by applicant]
US 20040002854A1 · Ha et al. · 2004 [cited by applicant]
US 20040044520A1 · Chen et al. · 2004 [cited by applicant]
US 20040044534A1 · Chen · 2004 [cited by examiner]
US 20040136459A1 · Yavits et al. · 2004 [cited by applicant]
US 20050015249A1 · Mehrotra et al. · 2005 [cited by applicant]
US 20050091051A1 · Moriya et al. · 2005 [cited by applicant]
US 20050114126A1 · Geiger et al. · 2005 [cited by applicant]
US 20050185541A1 · Neuman · 2005 [cited by applicant]
US 20050192799A1 · Kim et al. · 2005 [cited by applicant]
US 20050203731A1 · Oh et al. · 2005 [cited by applicant]
US 20060133682A1 · Tu et al. · 2006 [cited by applicant]
US 20060136229A1 · Kjoerling et al. · 2006 [cited by applicant]
US 20060235679A1 · Sperschneider et al. · 2006 [cited by applicant]
US 20060238386A1 · Huang et al. · 2006 [cited by applicant]
US 20070011013A1 · Liebchen · 2007 [cited by applicant]
US 20070016427A1 · Thumpudi et al. · 2007 [cited by applicant]
US 20070078645A1 · Niemisto et al. · 2007 [cited by applicant]
US 20070100606A1 · Rogers · 2007 [cited by applicant]
US 20070185706A1 · Chen et al. · 2007 [cited by applicant]
US 20070271092A1 · Ehara et al. · 2007 [cited by applicant]
US 20070296614A1 · Lee et al. · 2007 [cited by applicant]
US 20080021704A1 · Thumpudi et al. · 2008 [cited by applicant]
US 20080094259A1 · Yu et al. · 2008 [cited by applicant]
US 20080097757A1 · Vasilache · 2008 [cited by applicant]
US 20080109230A1 · Thumpudi et al. · 2008 [cited by applicant]
US 20080221908A1 · Thumpudi et al. · 2008 [cited by applicant]
US 20080262855A1 · Mehrotra et al. · 2008 [cited by applicant]
US 20080294446A1 · Guo et al. · 2008 [cited by applicant]
US 20090240491A1 · Reznik · 2009 [cited by applicant]
US 20090279605A1 · Holcomb et al. · 2009 [cited by applicant]
US 20100080284A1 · Lee et al. · 2010 [cited by applicant]
US 20100118971A1 · Tanida et al. · 2010 [cited by applicant]
US 20110173007A1 · Multrus et al. · 2011 [cited by applicant]
US 20110238426A1 · Fuchs et al. · 2011 [cited by applicant]
EP 1333679A1 · 2003 [cited by applicant]
EP 1395980A1 · 2004 [cited by applicant]
EP 1400954A2 · 2004 [cited by applicant]
EP 1574093A1 · 2005 [cited by applicant]
EP 2282310A1 · 2011 [cited by applicant]
EP 2717261A1 · 2014 [cited by examiner]
EP 2830058A1 · 2015 [cited by examiner]
EP 3300076A1 · 2018 [cited by applicant]
EP 3937167A1 · 2022 [cited by applicant]
GB 2305089 · 1997 [cited by applicant]
JP 2005242363 · 2005 [cited by applicant]
KR 1020050087956 · 2005 [cited by applicant]
RU 2289858C2 · 2006 [cited by applicant]
TW 1246256B · 2005 [cited by applicant]
TW 200644448A · 2006 [cited by applicant]
TW 200707275A · 2007 [cited by applicant]
TW 200746044A · 2007 [cited by applicant]
WO 0060759A1 · 2000 [cited by applicant]
WO 2002091363 · 2002 [cited by applicant]
WO 03083856A1 · 2003 [cited by applicant]
WO 2004057892A1 · 2004 [cited by applicant]
WO 2005078704A1 · 2005 [cited by applicant]
WO 2006108464A1 · 2006 [cited by applicant]
WO 2007096808A1 · 2007 [cited by applicant]
WO 2010003479A1 · 2010 [cited by applicant]
WO 2015055800A1 · 2015 [cited by applicant]
“Golomb Coding”, Wikipedia, 6 Pages, downloaded Aug. 2, 2023 (Year: 2023). [cited by applicant]
Malvar, Henrique S, “Biorthogonal and Nonuniform Lapped Transforms for Transform Coding with Reduced Blocking and Ringing Artifacts”, IEEE Transactions on Signal Processing, IEEE Service Center. US vol. 46 No. 4199 xp11… [cited by applicant]
Marpe, et al., “Context-based adaptive binary arithmetic coding in the H.264/AVC video compression standard”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, No. 7, XP011099255, Jul. 2003, pp. 6… [cited by applicant]
N., Meine, et al., “Improved Quantization and Lossless Coding for Subband Audio Coding”, Audio Engineering Society Convention Paper 6468, AES 118th Convention, XP008071322, vol. 1-4,, 1-9, (May 31, 2005). [cited by applicant]
Wikipedia, “Bit plane”, 5 pages, downloaded Feb. 6, 2017. [cited by applicant]
Yokotani, Yoshikazu, et al., “Lossless Audio Compression Using Integer Modified Discrete Cosine Transform”, Proceedings of ISPACS 2003. xp007909333, 120-126. [cited by applicant]
Yu, et al., “MPEG-4 Scalable to Lossless Audio Coding”, Audio Engineering Society, San Francisco, 2004. [cited by applicant]
Bryan A. Garner, “Law Prose Lesson #209”, May 6, 2015, 6 Pages, Law Prose, https://lawprose.org/lawprose-lesson-209-ban-andor/ (Year: 2015). [cited by applicant]
Ira Robbins, ‘And/Or’ and the Proper Use of Legal Language, Maryland Law Review, Apr. 4, 2018, 28 Pages, https://papers.ssrn.com/sol3/papers.cfm?abstract_id=2928061. (Year: 2018). [cited by applicant]
John P. O'Herron, Stop Using ‘And/Or’ in Your Complaints, Dec. 13, 2021, 4 Pages, Thompson McMullan LLP, https://www.t-mlaw.com/commentary/stop-using-and-or-in-your-complaints/ (Year: 2021). [cited by applicant]
Ted Tjaden, “Do Not Use ‘and/or’ in Legal Writing”, Slaw, Jul. 27, 2011, 17 Pages, https://www.slaw.ca/2011/07/27/grammar-legal-writing/ (Year: 2011). [cited by applicant]