Granted Patent B2

US 12,462,822 · App. 17/402,202 · Granted Nov 4, 2025

Inventors: Adrian Tomasek (Erlangen, DE); Ralph Sperschneider (Erlangen, DE); Jan Buethe (Erlangen, DE); Conrad Benndorf (Erlangen, DE); Martin Dietz (Erlangen, DE); Markus Schnell (Erlangen, DE); Maximilian Schlegel (Erlangen, DE)

Assignee: Fraunhofer-Gesellschaft zur Foerderung der angewandten Forschung e.V.

G10L19/035G10L19/022G10L21/0324H03M13/07H03M13/09H03M13/1515H04B17/309H04L1/0009H04L1/0032H04L1/0046H04L1/0084

Abstract

Claims (119)

1 . A decoder for decoding a frame to reconstruct a signal portion of a signal, wherein the signal portion is encoded within the frame, wherein the frame comprises a bitstream payload and two or more redundancy bits, wherein the bitstream payload comprises a plurality of payload bits, wherein each of the payload bits exhibits a position within the bitstream payload, wherein the decoder comprises:

a channel decoding module, being configured to detect, depending on the two or more redundancy bits, whether the bitstream payload comprises one or more corrupted bits being one or more of the payload bits that are distorted or that are likely to be distorted,

a source decoding module,

wherein, if the channel decoding module has not detected any corrupted bits within the bitstream payload, the source decoding module is configured to decode the bitstream payload without conducting error concealment to reconstruct the signal portion,

wherein, if the channel decoding module has detected the one or more corrupted bits within the bitstream payload, the source decoding module is configured to select a selected error concealment mode of two or more error concealment modes depending on the position of at least one of the one or more corrupted bits within the bitstream payload and depending on a signal characteristic of the signal portion of the signal, and is configured to conduct error concealment depending on the selected error concealment mode to reconstruct the signal portion;

wherein the bitstream payload is partitioned into a first part of the plurality of payload bits of the bitstream payload, and into a second part of the plurality of payload bits of the bitstream payload;

wherein the bitstream payload is a current bitstream payload;

wherein, if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select a full frame loss concealment mode of the two or more error concealment modes as the selected error concealment mode, if a highest spectral line among a plurality of spectral lines of a current audio signal portion exhibits a frequency being smaller than or equal to a threshold frequency.

2 . A decoder according to claim 1 ,

wherein the channel decoding module is an error detection and error correction module being configured to conduct error correction on the bitstream payload before detecting whether the bitstream payload comprises the one or more corrupted bits.

3 . A decoder according to claim 1 ,

wherein a first one of the two or more error concealment modes is the full frame loss concealment mode,

wherein, if the channel decoding module has indicated that the bitstream payload comprises the one or more corrupted bits, and if the selected error concealment mode is the full frame loss concealment mode, the source decoding module is configured to conduct error concealment without using the bitstream payload.

4 . A decoder according to claim 3 ,

wherein a second one of the two or more error concealment modes is a partial frame loss concealment mode,

wherein, if the channel decoding module has indicated that the bitstream payload comprises the one or more corrupted bits, and if the selected error concealment mode is the partial frame loss concealment mode, the source decoding module is configured to obtain the decoded signal by decoding other bits of the payload bits that are not indicated by the channel decoding module to be the one or more corrupted bits without conducting error concealment on the other bits, and by conducting error concealment on the one or more of the payload bits that are indicated by the channel decoding module to be the one or more corrupted bits.

5 . A decoder according to claim 4 ,

wherein the two or more error concealment modes comprise exactly two error concealment modes,

wherein a first one of the exactly two error concealment modes is the full frame loss concealment mode,

wherein a second one of the exactly two error concealment modes is the partial frame loss concealment mode.

6 . A decoder according to claim 4 ,

wherein, if the channel decoding module has indicated that the bitstream payload comprises the one or more corrupted bits, and if the first part of the bitstream payload comprises at least one of the one or more corrupted bits, the source decoding module is configured to select the full frame loss concealment mode as the selected error concealment mode, and

wherein, if the channel decoding module has indicated that the bitstream payload comprises the one or more corrupted bits, and if the first part of the bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the selected error concealment mode depending on the signal characteristic of the signal portion of the signal.

7 . A decoder according to claim 6 ,

wherein the frame is a current frame,

wherein the plurality of payload bits is a plurality of current payload bits, wherein the signal portion of the signal is a current signal portion of the signal, and wherein the signal characteristic is a current signal characteristic,

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, the source decoding module is configured to select the selected error concealment mode of two or more error concealment modes depending on the current signal characteristic of the current signal portion of the signal being encoded by the plurality of current payload bits of the current frame, and depending on a previous signal characteristic of a previous signal portion of the signal being encoded by a plurality of previous payload bits of a previous bitstream payload of a previous frame.

8 . A decoder according to claim 7 , wherein the decoder is an audio decoder,

wherein the current signal portion of the signal being encoded by the plurality of current payload bits of the current bitstream payload is the current audio signal portion of an audio signal, and

wherein the previous signal portion of the signal being encoded by the plurality of previous payload bits of the previous bitstream payload is a previous audio signal portion of the audio signal

wherein the current bitstream payload encodes the plurality of spectral lines of the current audio signal portion.

9 . A decoder according to claim 8 ,

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, and if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the full frame loss concealment mode as the selected error concealment mode, if the previous frame was concealed using full frame loss concealment.

10 . A decoder according to claim 8 ,

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, and if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the full frame loss concealment mode as the selected error concealment mode, if a stability factor is smaller than a predefined threshold, wherein said stability factor indicates a stability of the current audio signal portion and of the previous audio signal portion.

11 . A decoder according to claim 8 ,

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, and if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the full frame loss concealment mode as the selected error concealment mode,

if the previous frame was concealed using full frame loss concealment; or

if a stability factor is smaller than a predefined threshold, wherein said stability factor indicates a stability of the current audio signal portion and of the previous audio signal portion.

12 . A decoder according to claim 10 ,

wherein the predefined threshold is equal to 0.5.

13 . A decoder according to claim 10 ,

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, and if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the full frame loss concealment mode as the selected error concealment mode,

if the highest spectral line among the plurality of spectral lines of the current audio signal portion exhibits a frequency being smaller than or equal to a threshold frequency, and

if the first part of the current bitstream payload encodes a signal component which is tonal or harmonic, and

if the previous signal portion encodes at least one peak of the audio signal being greater than a peak threshold value and which corresponds to a frequency being greater than all frequencies being indicated by the plurality of spectral lines of the current audio signal portion.

14 . A decoder according to claim 13 ,

wherein a pitch of the audio signal exhibits a pitch frequency, and

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, and if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the full frame loss concealment mode as the selected error concealment mode,

if the highest spectral line among the plurality of spectral lines of the current audio signal portion exhibits said frequency being smaller than or equal to said threshold frequency, and

if the first part of the current bitstream payload encodes a signal component which is tonal or harmonic, and

if all frequencies being indicated by the plurality of spectral lines of the current audio signal portion are smaller than the pitch frequency; or

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, and if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the full frame loss concealment mode as the selected error concealment mode,

if the highest spectral line among the plurality of spectral lines of the current audio signal portion exhibits said frequency being smaller than or equal to said threshold frequency, and

if the first part of the current bitstream payload encodes a signal component which is tonal or harmonic, and

if all frequencies being indicated by the plurality of spectral lines of the current audio signal portion are smaller than a maximal supported pitch frequency.

15 . A decoder according to claim 14 ,

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, and if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the full frame loss concealment mode as the selected error concealment mode, if the highest spectral line among the plurality of spectral lines of the current audio signal portion exhibits said frequency being smaller than or equal to said threshold frequency, and if the first part of the current bitstream payload does not encode a signal component of the audio signal which is tonal or harmonic, and if the ratio between the energy from 0 to the frequency bin k be −1 of the previous quantized spectrum of the previous audio signal to the energy from 0 to the top of the previous quantized spectrum of the previous audio signal is smaller than a ratio threshold, wherein k be is a first spectral bin which cannot be recovered.

16 . A decoder according to claim 15 , wherein the ratio threshold is 0.3.

17 . A decoder according to claim 15 ,

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, and if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the partial frame loss concealment mode as the selected error concealment mode,

if the previous frame was not concealed using full frame loss concealment, and

if the highest spectral line among the plurality of spectral lines of the current audio signal portion exhibits a frequency being greater than said threshold frequency.

18 . A decoder according to claim 17 ,

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, and if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the partial frame loss concealment mode as the selected error concealment mode,

if the previous frame was not concealed using full frame loss concealment, and

if the highest spectral line among the plurality of spectral lines of the current audio signal portion exhibits said frequency being greater than said threshold frequency, and

if said stability factor is greater than or equal to said predefined threshold, and

if the first part of the current bitstream payload does not encode a signal component of the audio signal which is tonal or harmonic, and if the ratio between the energy from 0 to the frequency bin k be −1 of the previous quantized spectrum of the previous audio signal to the energy from 0 to the top of the previous quantized spectrum of the previous audio signal is greater than or equal to said ratio threshold.

19 . A decoder according to claim 17 ,

wherein, if the channel decoding module has indicated that the current bitstream payload comprises the one or more corrupted bits, and if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select the partial frame loss concealment mode as the selected error concealment mode,

if the previous frame was not concealed using full frame loss concealment, and

if the highest spectral line among the plurality of spectral lines of the current audio signal portion exhibits said frequency being greater than said threshold frequency, and

if said stability factor is greater than or equal to said predefined threshold, and

if the first part of the current bitstream payload encodes a signal component which is tonal or harmonic, and if said highest spectral line among the plurality of spectral lines of the current audio signal portion exhibits a frequency being greater than the pitch frequency, and if the previous signal portion does not encode any peak of the audio signal being greater than said peak threshold value and which corresponds to said frequency being greater than all frequencies being indicated by the plurality of spectral lines of the current audio signal portion.

20 . A decoder according to claim 8 ,

wherein, if the selected error concealment mode is the partial frame loss concealment mode, the source decoding module is configured to determine for each code word of a plurality of code words of the second part of the bitstream payload, depending on a number of corrected symbols of said code word, whether or not to conduct error concealment for those of the plurality of spectral lines of the current audio signal portion being represented by said code word, and to conduct error concealment for said those of the plurality of spectral lines of the current audio signal portion, for which the source decoding module has determined that error concealment shall be conducted.

21 . A decoder according to claim 20 ,

wherein, for each code word of a plurality of code words of the second part of the bitstream payload, the source decoding module is configured to determine a risk value indicating an approximation of a probability that said code word is corrupt, and to determine whether or not said risk value is greater than a risk threshold.

22 . A decoder according to claim 20 ,

wherein, if said risk value is greater than said risk threshold, the source decoding module is configured to conduct error concealment for those of the plurality of spectral lines of the current audio signal portion being represented by said code word.

23 . A decoder according to claim 22 ,

wherein the risk threshold is 2 −16 .

24 . A decoder according to claim 20 ,

wherein the source decoding module is configured to conduct said error concealment for said code word in the partial frame loss error concealment mode.

25 . A decoder according to claim 1 ,

wherein the channel decoding module is configured to detect that the bitstream payload comprises one or more corrupted bits,

if the channel decoding module encounters an uncorrectable code word within the bitstream payload and/or

if the channel decoding module, after conducting error correction on a plurality of code words of the bitstream payload, determines a re-calculated hash value, which depends on said plurality of code words after the error correction, that differs from a received hash value.

26 . A system for decoding a frame to reconstruct a signal portion of a signal, wherein the system comprises:

an encoder for encoding a signal portion of a signal within a frame, and

a decoder for decoding the frame to reconstruct the signal portion of the signal,

wherein the decoder is configured for decoding the frame to reconstruct the signal portion of the signal, wherein the signal portion is encoded within the frame, wherein the frame comprises a bitstream payload and two or more redundancy bits, wherein the bitstream payload comprises a plurality of payload bits, wherein each of the payload bits exhibits a position within the bitstream payload, wherein the decoder comprises:

a channel decoding module, being configured to detect, depending on the two or more redundancy bits, whether the bitstream payload comprises one or more corrupted bits being one or more of the payload bits that are distorted or that are likely to be distorted,

a source decoding module,

wherein, if the channel decoding module has not detected any corrupted bits within the bitstream payload, the source decoding module is configured to decode the bitstream payload without conducting error concealment to reconstruct the signal portion,

wherein, if the channel decoding module has detected the one or more corrupted bits within the bitstream payload, the source decoding module is configured to select a selected error concealment mode of two or more error concealment modes depending on the position of at least one of the one or more corrupted bits within the bitstream payload and depending on a signal characteristic of the signal portion of the signal, and is configured to conduct error concealment depending on the selected error concealment mode to reconstruct the signal portion;

wherein the bitstream payload is partitioned into a first part of the plurality of payload bits of the bitstream payload, and into a second part of the plurality of payload bits of the bitstream payload;

wherein the bitstream payload is a current bitstream payload;

wherein, if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the source decoding module is configured to select a full frame loss concealment mode of the two or more error concealment modes as the selected error concealment mode, if a highest spectral line among a plurality of spectral lines of a current audio signal portion exhibits a frequency being smaller than or equal to a threshold frequency.

27 . A system according to claim 25 , wherein the encoder comprises:

a source encoding module for encoding a signal portion of a signal within a frame, wherein the source encoding module is configured to generate the frame so that the frame comprises a bitstream payload and two or more redundancy bits, wherein the bitstream payload comprises a plurality of payload bits, wherein each of the payload bits exhibits a position within the bitstream payload, wherein the frame being generated by the source encoding module is suitable for being processed by the decoder, and

a channel encoding module being configured to generate the two or more redundancy bits depending on the bitstream payload.

28 . A method for decoding a frame to reconstruct a signal portion of a signal, wherein the signal portion is encoded within the frame, wherein the frame comprises a bitstream payload and two or more redundancy bits, wherein the bitstream payload comprises a plurality of payload bits, wherein each of the payload bits exhibits a position within the bitstream payload, wherein the method comprises:

detecting, depending on the two or more redundancy bits, whether the bitstream payload comprises one or more corrupted bits being one or more of the payload bits that are distorted or that are likely to be distorted,

if no corrupted bits have been detected within the bitstream payload, decoding the bitstream payload without conducting error concealment to reconstruct the signal portion, and

if one or more corrupted bits have been detected within the bitstream payload, selecting a selected error concealment mode of two or more error concealment modes depending on the position of at least one of the one or more corrupted bits within the bitstream payload and depending on a signal characteristic of the signal portion of the signal, and conducting error concealment depending on the selected error concealment mode to reconstruct the signal portion;

wherein the bitstream payload is partitioned into a first part of the plurality of payload bits of the bitstream payload, and into a second part of the plurality of payload bits of the bitstream payload;

wherein the bitstream payload is a current bitstream payload;

wherein, if the first part of the current bitstream payload does not comprise any of the one or more corrupted bits, the method comprises selecting a full frame loss concealment mode of the two or more error concealment modes as the selected error concealment mode, if a highest spectral line among a plurality of spectral lines of a current audio signal portion exhibits a frequency being smaller than or equal to a threshold frequency.

29 . A method, comprising:

encoding a signal portion of a signal within a frame, wherein the frame is generated so that the frame comprises a bitstream payload and two or more redundancy bits, wherein the bitstream payload comprises a plurality of payload bits, wherein each of the payload bits exhibits a position within the bitstream payload, and

conducting the method for decoding of claim 27 using the frame to decode the frame to reconstruct the signal portion of the signal.

30 . A method for encoding a signal portion of a signal within a frame, wherein the method comprises:

generating the frame so that the frame comprises a bitstream payload and two or more redundancy bits, wherein the bitstream payload comprises a plurality of payload bits, wherein each of the payload bits exhibits a position within the bitstream payload, wherein the frame is suitable for being decoded by the method of claim 27 .

31 . A non-transitory computer-readable medium comprising a computer program for implementing a method according to claim 27 when being executed on a computer or signal processor.

32 . A non-transitory computer-readable medium comprising a computer program for implementing a method according to claim 28 when being executed on a computer or signal processor.

33 . A non-transitory computer-readable medium comprising a computer program for implementing a method according to claim 29 when being executed on a computer or signal processor.

34 . A method for storing a frame, comprising storing the frame on a computer readable storage medium, the frame being generated according to the method of claim 29 .

Assignments (1)

Priority Claims (7)

Continuity (2)

References Cited (201)