IP Library › Granted Patent US 11,922,961
Granted Patent B2
US 11,922,961 · App. 17/479,151 · Granted Mar 5, 2024

Audio decoder, method and computer program using a zero-input-response to obtain a smooth transition

Inventors: Emmanuel Ravelli (Erlangen, DE); Guillaume Fuchs (Bubenreuth, DE); Sascha Disch (Fuerth, DE); Markus Multrus (Nuremberg, DE); Grzegorz Pietrzyk (Nuremberg, DE); Benjamin Schubert (Nuremberg, DE)
Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.
G10L19/20G10L19/02G10L19/12
View Patent ↗
Loading inventors, assignments & file history…
Monitor This Case
Get email alerts when status or documents change.
Order Certified Copies
Most orders are placed with the USPTO same day — all within 24 business hours.
Order via The Patent Place →
Pre-filled with this patent's details
Quick Facts
Patent No.
US 11,922,961
App. No.
17/479,151
Granted
Mar 5, 2024
Kind
B2
Abstract

An audio decoder for providing a decoded audio information on the basis of an encoded audio information includes a linear-prediction-domain decoder configured to provide a first decoded audio information on the basis of an audio frame encoded in a linear prediction domain, a frequency domain decoder configured to provide a second decoded audio information on the basis of an audio frame encoded in a frequency domain, and a transition processor. The transition processor is configured to obtain a zero-input-response of a linear predictive filtering, wherein an initial state of the linear predictive filtering is defined depending on the first decoded audio information and the second decoded audio information, and modify the second decoded audio information depending on the zero-input-response, to obtain a smooth transition between the first and the modified second decoded audio information.

Claims (217)

1. An audio decoder for providing a decoded audio information on the basis of an encoded audio information, the audio decoder comprising:

a linear-prediction-domain decoder configured to provide a first decoded audio information on the basis of an audio frame encoded in a linear prediction domain;

a frequency domain decoder configured to provide a second decoded audio information on the basis of an audio frame encoded in a frequency domain; and

a transition processor,

wherein the transition processor is configured to obtain a zero-input-response of a linear predictive filtering, wherein an initial state of the linear predictive filtering is defined in dependence on the first decoded audio information, and

wherein the transition processor is configured to modify the second decoded audio information, which is provided on the basis of an audio frame encoded in the frequency domain following an audio frame encoded in the linear prediction domain, in dependence on the zero-input-response,

wherein the audio decoder is implemented using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer.

2. The audio decoder according to claim 1 ,

wherein the transition processor is configured to obtain a first zero-input-response of a linear predictive filter in response to a first initial state of the linear predictive filter defined by the first decoded audio information, and

wherein the transition processor is configured to obtain a second zero-input-response of the linear predictive filter in response to a second initial state of the linear predictive filter defined by a modified version of the first decoded audio information, which is provided with an artificial aliasing, and which comprises a contribution of a portion of the second decoded audio information, or

wherein the transition processor is configured to obtain a combined zero-input-response of the linear predictive filter in response to an initial state of the linear predictive filter defined by a combination of the first decoded audio information and of a modified version of the first decoded audio information, which is provided with an artificial aliasing, and which comprises a contribution of a portion of the second decoded audio information;

wherein the transition processor is configured to modify the second decoded audio information, which is provided on the basis of an audio frame encoded in the frequency domain following an audio frame encoded in the linear prediction domain, in dependence on the first zero-input-response and the second zero-input-response, or in dependence on the combined zero-input-response, to obtain a smooth transition between the first decoded audio information and the modified second decoded audio information.

3. The audio decoder according to claim 1 , wherein the frequency-domain decoder is configured to perform an inverse lapped transform, such that the second decoded audio information comprises an aliasing.

4. The audio decoder according to claim 1 , wherein the frequency-domain decoder is configured to perform an inverse lapped transform, such that the second decoded audio information comprises an aliasing in a time portion which is temporally overlapping with a time portion for which the linear-prediction-domain decoder provides a first decoded audio information, and such that the second decoded audio information is aliasing-free for a time portion following the time portion for which the linear-prediction-domain decoder provides a first decoded audio information.

5. The audio decoder according to claim 1 , wherein the portion of the second decoded audio information, which is used to obtain the modified version of the first decoded audio information, comprises an aliasing.

6. The audio decoder according to claim 5 , wherein the artificial aliasing, which is used to obtain the modified version of the first decoded audio information, at least partially compensates an aliasing which is comprised in the portion of the second decoded audio information, which is used to obtain the modified version of the first decoded audio information.

7. The audio decoder according to claim 1 , wherein the transition processor is configured to obtain the first zero-input-response, or a first component of the combined zero-input-response, according to

s

Z

1

(

n

)

=

-

∑

m

=

1

M

a

m

⁢

s

Z

1

(

n

-

m

)

,

n

=

0

,

…

,

N

-

1

or according to

s

Z

1

(

n

)

=

+

∑

m

=

1

M

a

m

⁢

s

Z

1

(

n

-

m

)

,

n

=

0

,

…

,

N

-

1

with

s Z 1 ( n )= S C ( n ), n=−L, . . . ,− 1

M≤L

wherein n designates a time index,

wherein s Z 1 (n) for n=0, . . . , N−1 designates the first zero input response for time index n, or a first component of the combined zero-input-response for time index n;

wherein s Z 1 (n) for n=−L, . . . , −1 designates the first initial state for time index n, or a first component of the initial state for time index n;

wherein m designates a running variable,

wherein M designates a filter length of the linear predictive filter;

wherein a m designates filter coefficients of the linear predictive filter;

wherein S c (n) designates a previously decoded value of the first decoded audio information for time index n;

wherein N designates a processing length.

8. The audio decoder according to claim 1 , wherein the transition processor is configured to apply a first windowing to the first decoded audio information, to obtain a windowed version of the first decoded audio information, and to apply a second windowing to a time-mirrored version of the first decoded audio information, to obtain a windowed version of the time-mirrored version of the first decoded audio information, and

wherein the transition processor is configured to combine the windowed version of the first decoded audio information and the windowed version of the time-mirrored version of the first decoded audio information, in order to obtain the modified version of the first decoded audio information.

9. The audio decoder according to claim 1 , wherein the transition processor is configured to obtain the modified version of the first decoded audio information according to

( n )= S C ( n ) w (− n− 1) w (− n− 1)+ S C (− n−L− 1) w ( n+L ) w (− n− 1)+ S M ( n ), n=−L, . . . ,− 1,

wherein n designates a time index,

wherein w(−n−1) designates a value of a window function for time index (−n−1);

wherein w(n+L) designates a value of a window function for time index (n+L);

wherein S c (n) designates a previously decoded value of the first decoded audio information for time index (n);

wherein S c (−n−L−1) designates a previously decoded value of the first decoded audio information for time index (−n−L−1);

wherein S M (n) designates a decoded value of the second decoded audio information for time index n; and

wherein L describes a length of a window.

10. The audio decoder according to claim 1 , wherein the transition processor is configured to obtain the second zero-input-response, or a second component of the combined zero-input-response according to

s

Z

2

(

n

)

=

-

∑

m

=

1

M

a

m

⁢

s

Z

2

(

n

-

m

)

,

n

=

0

,

…

,

N

-

1

or according to

s

Z

2

(

n

)

=

+

∑

m

=

1

M

a

m

⁢

s

Z

2

(

n

-

m

)

,

n

=

0

,

…

,

N

-

1

with

s Z 2 ( n )= ( n ), n=−L, . . . ,− 1

M≤L

wherein n designates a time index,

wherein s Z 2 (n) for n=0, . . . , N−1 designates the second zero input response for time index n, or a second component of the combined zero-input-response for time index n;

wherein s Z 2 (n) for n=−L, . . . , − 1 designates the second initial state for time index n, or a second component of the initial state for time index n;

wherein m designates a running variable,

wherein M designates a filter length of the linear predictive filter;

wherein a m designates filter coefficients of the linear predictive filter;

wherein (n) designates values of the modified version of the first decoded audio information for time index n;

wherein N designates a processing length.

11. The audio decoder according to claim 1 , wherein the transition processor is configured to linearly combine the second decoded audio information with the first zero-input-response and the second zero-input-response, or with the combined zero-input-response, for a time portion for which no first decoded audio information is provided by the linear-prediction-domain decoder, in order to obtain the modified second decoded audio information.

12. The audio decoder according to claim 1 , wherein the transition processor is configured to obtain the modified second decoded audio information according to

( n )= S M ( n )− s Z 2 ( n )+ s Z 1 ( n ), for n= 0, . . . , N− 1,

or according to

( n )= S M ( n )− v ( n ) s Z 2 ( n )+ v ( n ) s Z 1 ( n ), for n= 0, . . . , N− 1,

wherein

wherein n designates a time index;

wherein S M (n) designates values of the second decoded audio information for time index n;

wherein s Z 1 (n) for n=0, . . . , N−1 designates the first zero input response for time index n, or a first component of the combined zero-input-response for time index n; and

wherein s Z 2 (n) for n=0, . . . , N−1 designates the second zero input response for time index n, or a second component of the combined zero-input-response for time index n;

wherein v(n) designates values of a window function;

wherein N designates a processing length.

13. The audio decoder according to claim 1 , wherein the transition processor is configured to leave the first decoded audio information unchanged by the second decoded audio information when providing a decoded audio information for an audio frame encoded in a linear-prediction domain, such that the decoded audio information provided for an audio frame encoded in the linear-prediction-domain is provided independent from decoded audio information provided for a subsequent audio frame encoded in the frequency domain.

14. The audio decoder according to claim 1 , wherein the audio decoder is configured to provide a fully decoded audio information for an audio frame encoded in the linear-prediction domain, which is followed by an audio frame encoded in the frequency domain, before decoding the audio frame encoded in the frequency domain.

15. The audio decoder according to claim 1 , wherein the transition processor is configured to window the first zero-input-response and the second zero-input-response, or the combined zero-input-response, before modifying the second decoded audio information in dependence on the windowed first zero-input-response and the windowed second zero-input-response, or in dependence on the windowed combined zero-input-response.

16. The audio decoder according to claim 15 , wherein the transition processor is configured to window the first zero-input-response and the second zero-input-response, or the combined zero-input-response, using a linear window.

17. A method for providing a decoded audio information on the basis of an encoded audio information, the method comprising:

providing a first decoded audio information on the basis of an audio frame encoded in a linear prediction domain;

providing a second decoded audio information on the basis of an audio frame encoded in a frequency domain; and

obtaining a zero-input-response of a linear predictive filtering, wherein an initial state of the linear predictive filtering is defined in dependence on the first decoded audio information, and

modifying the second decoded audio information, which is provided on the basis of an audio frame encoded in the frequency domain following an audio frame encoded in the linear prediction domain, in dependence on the zero-input-response,

wherein the method is performed using a hardware apparatus, or using a computer, or using a combination of a hardware apparatus and a computer.

18. A non-transitory digital storage medium having a computer program stored thereon to perform the method for providing a decoded audio information on the basis of an encoded audio information, the method comprising:

providing a first decoded audio information on the basis of an audio frame encoded in a linear prediction domain;

providing a second decoded audio information on the basis of an audio frame encoded in a frequency domain; and

obtaining a zero-input-response of a linear predictive filtering, wherein an initial state of the linear predictive filtering is defined in dependence on the first decoded audio information, and

modifying the second decoded audio information, which is provided on the basis of an audio frame encoded in the frequency domain following an audio frame encoded in the linear prediction domain, in dependence on the zero-input-response,

when said computer program is run by a computer.

Assignments (1)
ASSIGNMENT OF ASSIGNOR'S INTEREST Recorded Sep 20, 2021
From: RAVELLI, EMMANUEL; FUCHS, GUILLAUME; DISCH, SASCHA; MULTRUS, MARKUS; SCHUBERT, BENJAMIN; PIETRZYK, GRZEGORZ
To: FRAUNHOFER-GESELLSCHAFT ZUR FOERDERUNG DER ANGEWANDTEN FORSCHUNG E.V.
Reel/Frame 057529/0789 →
Priority Claims (1)
EP 14178830 · Jul 28, 2014 · regional
Continuity (4)
Continuation 16427488 · May 31, 2019
Continuation 15416052 · Jan 26, 2017
Continuation PCTEP2015066953 · Jul 23, 2015
Related Publication 20220076685A1 · Mar 10, 2022
Cited By (1)
US 12,361,957